Moveworks - Data Engineer - Python/PySpark (6-10 yrs)

Responsibilities :

- Design and Develop Data Pipelines : Build and maintain scalable, performant data pipelines for ingesting, processing, and distributing large datasets across various teams and systems.

- Architect Data Models : Collaborate with Data Science and Engineering teams to design and implement abstracted, structured data models with strict upstream and downstream contracts.

- Ensure Data Quality : Establish frameworks and tools to validate and ensure data accuracy, consistency, and integrity.

- Security and Compliance : Implement best practices for securing sensitive data and ensure compliance with relevant regulations, including data access controls and encryption mechanisms.

- Build Tools and Automation : Develop tools and scripts to automate data ingestion, transformation, and management tasks.

- Collaborate Across Teams : Work closely with Data Science, Engineering, and the Data Platform teams to understand data needs and drive projects that align with Moveworks' business and product goals.

Requirements :

- 6+ years of experience in data engineering or software engineering, preferably in a fast-growing tech environment.

- Proficiency in Python, PySpark, and SQL or similar technologies.

- Strong experience with modern data architecture, including data lakes, data warehouses, and ETL frameworks.

- Expertise with orchestration tools such as Airflow.

- Deep understanding of data modeling and data quality concepts.

- Experience with cloud platforms like AWS (e. g., S3 EMR, Athena) or GCP.

- Experience with tools like Apache Hudi, Snowflake, and Kafka is a plus.

- Exceptional communication and collaboration skills, with a proven ability to work with cross-functional teams.