Data Engineer - Python/SQL (6-10 yrs)

Job Title : Data Engineer.

Experience : 6 years.

Location : Hybrid (Gurgaon, Pune).

Notice period : Immediate joiner.

Job Description :

We are looking for an experienced Data Engineer with 6 years of experience in building and maintaining ETL pipelines. The ideal candidate will have strong expertise in AWS Cloud services, including IAM, EC2, S3, Glue, Athena, Redshift, and CloudWatch.

The role involves working with programming languages such as Python, PySpark, and SQL to process and analyze large datasets.

Familiarity with Oracle SQL and Redshift data warehousing is required, and experience with development tools like PyCharm, Jupyter Notebook, and VS Code is preferred.

Key Responsibilities :

- Lead the design and implementation of scalable data pipelines.

- Collaborate with data scientists, analysts, and other stakeholders to ensure data availability and quality.

- Architect and manage data storage solutions (e.g., databases, data lakes) that meet the needs of the organization.

- Ensure data governance, security, and compliance with industry standards.

- Install/update disaster recovery procedures.

- Mentor and guide junior data engineers, fostering a culture of learning and innovation.

- Stay updated on industry trends and technologies to continuously improve our data practices.

Required Qualifications :

- Proficiency in Python and SQL.

- Experience with data warehousing solutions (e.g., Snowflake, Google Big Query) and data orchestration tools (e.g., Apache Airflow, Databricks Workflows, Dagster).

- Strong understanding of SQL and NoSQL databases such as MySQL and MongoDB

- Experience with Apache Spark and Apache Kafka

- Familiarity with cloud platforms (e.g., AWS, Google Cloud, Azure) and their data services.