Cloud Destinations - Lead Data Engineer - SQL/Python (7-12 yrs)

Role : Lead Data Engineer/ Data Architect/Manager.

Location : Chennai/Coimbatore (Preferably Chennai candidates or someone willing to relocate to Chennai)

Work Model : 5 days WFO

Experience : 7+ years

Mandatory Skills : Expert in SQL, Python, Pyspark, Data bricks, Azure/AWS

Minimum qualification :

- BS, MS, Ph.D., or equivalent industry experience in Computer Science, Software Engineering, or other related Science/Technology/Engineering/Math fields.

- 3+ years' experience of near Real Time (Streaming) & Batch Data Pipeline development in a large-scale organization

- 5 years of relevant experience in Data Engineering.

- Experience in writing reusable/efficient code to automate analysis and data processes

- 2+ of business/marketing analytics experience, preferably in a consumer-based organization.

- Experience successfully working on an independent project with very minimal supervision

- Experience in processing structured and unstructured data into a form suitable for analysis and reporting with integration with a variety of data metric providers ranging from web analytics, consumer analytics, and advertising

- Strong Experience with data modelling, batch data pipeline design and implementation Strong Experience in software development and engineering principles

- Experience implementing scalable, distributed, and highly available systems using AWS services such Kinesis, DynamoDB, S3

- Exceptional communication skills, particularly in communicating and visualizing quantitative findings in a compelling and actionable manner for business stakeholders

- Experience in mentoring and supporting junior members of the team

- High Proficiency in Python/PySpark, Scala or Java

- High Proficiency in SQL

- Experience with Databricks/Spark

- Experience with orchestration tools such as Airflow (we use Astronomer)

- Comfortable with CI/CD (we use GitHub Actions) Pipelines

- Experience with Git version control, and other software adjacent tools

- Terraform used as Infra as service tool.