Data Engineer - Data Pipeline Team

We are looking for a Data Engineer to join our Data Pipeline Team within the Data Engineering (DE) organization! In this role, you will design, build, and optimize scalable data pipelines that enable seamless data ingestion, transformation, and delivery across the organization. You will work closely with internal product teams, external vendors, and analytics engineers to ensure high-quality, timely data availability that supports analytics, reporting, and machine learning initiatives.

The Data Pipeline Team is responsible for integrating diverse data sources, managing ingestion workflows, and ensuring data consistency across different environments (PHI, non-PHI). This role offers a great opportunity to work on high-impact data workflows while enhancing data quality, governance, and infrastructure.

You ll Enjoy This Role If You Are

• Passionate about building and maintaining reliable data pipelines at scale.
• Excited about working with large, complex datasets from multiple sources, including internal applications and third-party vendors.
• Interested in optimizing data ingestion and transformation workflows using modern ETL/ELT tools.
• Eager to collaborate with cross-functional teams to improve data accessibility and reliability.
• Proactive in automating and streamlining manual data processes.

Your Day-to-Day Responsibilities...

• Build and maintain ETL/ELT pipelines that ingest, transform, and deliver data to Snowflake and the data lake.
• Develop scalable data workflows using PySpark, SQL, and modern ETL tools like Stitch, Fivetran, and DBT.
• Optimize data ingestion processes to ensure efficiency, reliability, and minimal downtime.
• Ensure data quality and integrity by implementing validation frameworks, schema enforcement, and monitoring tools.
• Manage ingestion workflows for PHI, non-PHI, and DEID environments, ensuring compliance and governance.
• Collaborate with analytics engineers and product teams to standardize data ingestion practices and improve data transparency.
• Monitor pipeline performance, troubleshoot failures, and continuously improve data processing efficiencies.
• Document best practices and contribute to onboarding materials for data ingestion.

You ll Be Successful in This Role If You Have

• 2+ years of experience in data engineering or a related field, with hands-on experience in ETL/ELT pipeline development.
• Proficiency in Python (PySpark) and SQL for large-scale data processing.
• Experience with Snowflake or other cloud data warehouses, including performance optimization techniques.
• Familiarity with ETL/ELT tools like Stitch, Fivetran, DBT, Airflow, or Dagster.
• Experience working with cloud platforms, particularly AWS (S3, Glue, Lambda, Athena).
• Understanding of data governance, validation frameworks, and schema enforcement.
• Strong troubleshooting and debugging skills for resolving data pipeline failures.
• Ability to work collaboratively with data engineers, analytics teams, and product teams to design scalable solutions.

Benefits...

• An incredible team of smart and supportive people
• A competitive compensation package, including attractive medical insurance
• Amazing perks - think catered lunch every day, Ping Pong, etc.
• Daycare/creche facility for kids
• The chance to create a better healthcare experience for millions of patients!
• Corporate wellness programs with Headspace
• Cellphone and wifi reimbursement
• Competitive parental leave
• Sabbatical leave (over 5 years)
• Annual sponsored health check-ups
• Zocdoc is certified as a Great Place to Work 2024-2025