Senior AWS Data Engineer - Python/ETL (6-7 yrs)

Job Description :

Responsibilities :

- Design, develop, and maintain scalable data pipelines and ETL processes on AWS.

- Collaborate with data architects, data scientists, and other stakeholders to understand data requirements and translate them into technical solutions.

- Implement data integration, transformation, and loading processes using AWS services such as Glue, Redshift, S3, and Lambda.

- Ensure data quality, integrity, and security throughout the data lifecycle.

- Optimize and tune data pipelines for performance and cost-efficiency.

- Develop and maintain documentation for data pipelines, processes, and architectures.

- Monitor and troubleshoot data pipelines, ensuring timely and accurate data delivery.

- Stay current with industry trends and emerging technologies, providing thought leadership and innovation.

- Mentor and coach junior data engineers, fostering a culture of continuous learning and improvement.

Qualifications :

- Proven experience in designing and implementing data pipelines and ETL processes on AWS.

- Extensive experience with AWS data services, including Glue, Redshift, S3, Lambda, and Athena.

- Strong understanding of data modeling, data warehousing, and data integration concepts.

- Excellent problem-solving skills and the ability to work under pressure.

- Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.

- AWS Certified Data Analytics - Specialty or equivalent certification is highly desirable.

- Strong Proficiency in programming languages such as Python, Java, or Scala.

- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

Preferred Skills :

- Experience with big data technologies and frameworks, such as Spark PySpark Knowledge of serverless data architectures and microservices.

- Familiarity with data visualization tools and techniques.

- Experience with AWS automation and orchestration tools.