Title: Data Engineer <\/b>
<\/b>
<\/div>
Location: Remote <\/b>
Visa Sponsorship: No <\/b>
â<\/b>
Role Summary
<\/b> We are looking for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining scalable data infrastructure that drives business intelligence, advanced analytics, and machine learning initiatives. You must be comfortable working autonomously, navigating complex challenges, and driving projects to successful completion in a dynamic cloud environment. <\/span>
<\/div>
Key Responsibilities
<\/b> ⢠Design and Optimization: Design, implement, and optimize clean, well\-structured, and performant analytical datasets to support high\-volume reporting, business analysis, and data science model development. <\/span>
<\/div>
⢠Pipeline Development: Architect, build, and maintain scalable and robust data pipelines for diverse applications, including business intelligence, advanced analytics <\/span>
⢠Big Data & Streaming: Implement and support Big Data solutions for both batch (scheduled) and real\-time\/streaming analytics. <\/span>
⢠Collaboration: Work closely with product managers and business teams to understand data requirements and translate them into technical solutions. <\/span>
Required Skills and Experience
<\/b> ⢠Cloud Platform Expertise (GCP Focus): Extensive hands\-on experience working in dynamic cloud environments, with a strong preference for Google Cloud Platform (GCP) services, specifically: <\/span>
<\/div>
? BigQuery: Expert\-level skills in data ingestion, performance optimization, and data modeling within a petabyte\-scale environment. <\/span>
? Experience with other relevant GCP services like Cloud Storage, Cloud Dataflow\/Beam, or Pub\/Sub <\/span>
⢠Programming & Querying: <\/span>
? Python: Expert\-level programming proficiency in Python, including experience with relevant data engineering libraries <\/span>
? SQL: A solid command of advanced SQL for complex querying, data processing, and performance tuning. <\/span>
⢠Data Pipeline Orchestration: Prior experience using workflow management and orchestration tools (e.g., Apache Airflow, Cloud Composer, Airflow,Dagster, or similar). <\/span>
⢠DevOps\/CI\/CD: Experience with version control (Git) and familiarity with CI\/CD practices and tools (e.g., GitLab, GitHub Actions) to automate deployment and testing processes. <\/span>
...over 450 locations across the U.S. and Canada with approximately 9,000 employees. What You'll Be Doing Lead and implement quality control programs to ensure product compliance with internal and external standards Monitor production processes and conduct audits...
...transportation industry has to offer. Now Hiring Part Time School Van Drivers for Normal, IL As a First Student Part Time School Van Driver... ...hours per school day, no working nights or weekends unless you want to. Additional hours gained through trips and charters when...
...Expansion: Actively network through professional associations and trade shows to expand our reach and influence in the industry. #... ...various channels. # Utilize Sales Tools: Effectively use proprietary sales systems ensuring use of our systematic approach to lead generation...
...healthcare. What Were Looking For: The Provider Practice Coding Consultant role is an opportunity to make a significant impact in the... ...NCCI edits. Chart mix includes both inpatient and outpatient. Epic 3M360 systems.******* What You Will Do: Review medical...
...About the job Work from Home Booking Agent We are looking for candidates who have strong interpersonal and communication skills for our organization as a Remote booking agent. The role of a booking agent involves providing support and guidance to others. The...