Senior Cloud Data Engineer

Role

Senior Cloud Data Engineer

Visit our website bmwtechworks.in to know more.

Follow us on LinkedIn I Instagram I Facebook I X for the exciting updates.

Location

Pune/Chennai

Experience:

6 to 8 Years

What awaits you/ Job Profile

You will design, develop, and optimize large-scale data pipelines. You will take ownership of critical components of the data architecture, ensuring performance, security, and compliance.

• Design and implement scalable data pipelines for batch and real-time processing.
• Optimize data storage and computing resources to improve cost and performance.
• Ensure data security and compliance with industry regulations.
• Collaborate with data scientists, analysts, and application teams to align data storage strategies.
• Lead technical discussions with stakeholders to deliver the best possible solutions.
• Automate data workflows and develop reusable frameworks.
• Monitor and troubleshoot ETL pipelines, jobs, and cloud services.

What should you bring along

• 6+ years of experience in AWS cloud services and data engineering.
• Strong expertise in data modeling, ETL pipeline design, and SQL query optimization.
• Prior experience working with streaming solutions like Kafka.
• Excellent knowledge of Terraform and GitHub Actions.
• Experienced in being in the lead of a feature team.

Must have technical skill

• Python, PySpark, Hive, Unix
• AWS (S3, Lambda, Glue, Athena, RDS, Step Functions, SNS, SQS, API Gateway)
• MySQL, Oracle, NoSQL and experience in writing complex queries

Good to have technical skills

• Cloud Architect Certification.
• Terraform
• Git, GitHub Actions, Jenkins
• Delta Lake, Iceberg
• Experience in AI-powered data solutions