Staff Data Engineer - Python/SQL (12-15 yrs)

Core Areas of Responsibility :

- Implement robust data infrastructure, platforms, and solutions.

- Collaborate effectively with cross functional teams & CDI leaders, by ensuring the delivery of timely data load and jobs tailored to their unique needs.

- Guide & mentor the team of skilled data engineers, by prioritizing a service-oriented approach and quick response times.

- Advocate for the enhancement, and adherence to high data quality standards, KPI certification methods, and engineering best practices.

- Approach reporting platforms and analytical processes with innovative thinking, considering the evolving demands of the business.

- Implement the strategy for migrating from AWS to GCP with near real time events, machine learning pipelines using our customer data platform (Segment) and purpose built pipelines and DBs to activate systems of intelligence.

- Continuously improve reporting workflows and efficiency, harnessing the power of automation whenever feasible.

- Enhance the performance, reliability, and scalability of storage and compute layers of the data lake.

- In the role of Staff Data Engineer, you will report to the Director, Data Engineering. We are considering applicants for the location(s) of Hyderabad.

About You :

- 8+ years of hands-on experience in data engineering and/or software development.

- Highly skilled in programming languages like Python, Spark & SQL

- Comfortable using BI tools like Tableau, Looker, Preset, and so on

- Proficient in utilizing event data collection tools such as Snowplow, Segment, Google Tag Manager, Tealium, mParticle, and more.

- Comprehensive expertise across the entire lifecycle of implementing compute and orchestration tools like Databricks, Airflow, Talend, and others.

- Skilled in working with streaming OLAP engines like Druid, ClickHouse, and similar technologies.

- Experience leveraging AWS services including EMR Spark, Redshift, Kinesis, Lambda, Glue, S3, and Athena, among others.

- Nice to have exposure to GCP services like BigQuery, Google Storage, Looker, Google Analytics, and so on

- Good understanding of building real-time data systems as well AI/ML personalization products

- Experience with Customer Data Platforms (CDPs) and Data Management Platforms (DMPs), contributing to holistic data strategies.

- Familiarity with high-security environments like HIPAA, PCI, or similar contexts, highlighting a commitment to data privacy and security.

- Accomplished in managing large-scale data sets, handling Terabytes of data and billions of records effectively.

- You holds a Bachelor's degree in Computer Science, Information Systems, or a related field, providing a strong foundational knowledge