AWS Data Engineer - Python/Apache Airflow (5-6 yrs)

Responsibilities :

- Design, develop, and maintain core data pipelines using Python and Airflow on the AWS cloud platform.

- Collaborate with cross-functional teams (data analysts, product managers, business intelligence) to understand data needs and translate them into technical solutions.

- Implement data quality checks, lineage monitoring, and alerting to ensure data integrity and prevent data pipeline failures.

- Define and manage evolving data models and data schemas to optimize data storage and retrieval.

- Manage SLAs for critical data pipelines that power company metrics and reporting.

- Champion best practices for data management, storage, and security in accordance with industry regulations.

- Participate in code reviews to ensure code quality, maintainability, and knowledge sharing within the team.

- Stay up-to-date with the latest advancements in data engineering tools and technologies.

- Lead efforts to evaluate and integrate new technologies and tools to enhance the data infrastructure.

Qualifications :

- Minimum of 5+ years of experience as a Data Engineer or similar role.

- In-depth knowledge of Python and SQL programming languages.

- Proven experience with AWS cloud services (e.g, Redshift, S3, Airflow).

- Familiarity with data workflow development and management tools (dbt a plus).

- Strong understanding of data warehousing concepts and data modeling principles.

- Experience with data quality checks, data lineage, and data security best practices.

- Excellent problem-solving, analytical, and critical thinking skills.

- Effective communication, collaboration, and teamwork abilities