Senior Software Engineer - Python (4-5 yrs)

We are looking for a Software Engineer to help us grow the data platform.

You will be embedded on the Orchestration Platform team that runs workflow scheduling applications that helps power the analytics, operations, and data science behind our flagship streaming applications Hulu, ESPN+, and Star+.

Responsibilities :

- Be a key player in a cross-functional team of engineers who build software for a large-scale data processing ecosystem, supporting real-time and batch data pipelines for analytics, data science, and operations.

- Build tools and services to support data discovery, lineage, resiliency, and privacy compliance across the data platform.

- Design and develop CI/CD processes for infrastructure components that ensure high availability and agility.

- Maintain software engineering and architecture best practices and standards within the team and wider organization, along with a culture of quality, innovation, and experimentation.

- Evangelize the platform, best-practices, data driven decisions; identify new use cases and features and drive adoption.

Basic Qualifications :

- Experience with Python.

- Experience operating Airflow.

- Experience deploying and running cloud-based applications (preferably AWS), utilizing infrastructure-as-code frameworks like Terraform.

- Knowledge of Data Engineering practices and tools, such as Spark, Snowflake, ETL concepts, etc.

- Ability to dive deep into any technical component as well as understand the overall systems architecture.

- You care deeply about craftsmanship in your software, and can work backwards from the customer experience.

- You have excellent written and verbal communication skills.

Must have Skill :

- Experience with Operating Airflow Understand how the whole cycle works and have worked on operating it.

- Many people know airflow, but not everyone knows the operating part.

- So this person must know that.

- Work revolves around Airflow in this team.

- AWS Python Data Tools Knows and Understand the entire Data Ecosystem EMS, Spark

Nice to Have : Terraform.