Info Services - Senior Data Engineer - Apache Airflow (3-8 yrs)

Title : Senior Data Engineer (Airflow Operations Specialist).

Location : Financial District, Hyderabad.

Mode : Hybrid Role.

Requirement :

Job Summary :

- We are looking for a Software Engineer to help us grow the data platform.

- You will be embedded on the Orchestration Platform team that runs workflow scheduling applications that helps power the analytics, operations, and data science behind our flagship streaming applications.

Responsibilities :

- Be a key player in a cross-functional team of engineers who build software for a large-scale data processing ecosystem, supporting real-time and batch data pipelines for analytics, data science, and operations.

- Build tools and services to support data discovery, lineage, resiliency, and privacy compliance across the data platform Design and develop CI/CD processes for infrastructure components that ensure high availability and agility

- Maintain software engineering and architecture best practices and standards within the team and wider organization, along with a culture of quality, innovation, and experimentation

- Evangelize the platform, best-practices, data driven decisions; identify new use cases and features and drive adoption

Basic Qualifications :

- Experience with Python Experience operating Airflow

- Experience deploying and running cloud-based applications (preferably AWS), utilizing infrastructure-as-code frameworks like Terraform Knowledge of Data Engineering practices and tools, such as Spark, Snowflake, ETL concepts, etc.

- Ability to dive deep into any technical component as well as understand the overall systems architecture.

- You care deeply about craftsmanship in your software, and can work backwards from the customer experience.

- You have excellent written and verbal communication skills.

- Manager's Pointers Experience with Operating Airflow Understand how the whole cycle works and have worked on operating it.

- Many people know airflow, but not everyone knows the operating part.

- So this person must know that.

- Work revolves around Airflow in this team.

- AWS Python Data Tools Knows and Understand the entire Data Ecosystem EMS, Spark

Nice to Have : Terraform.