Senior Python Developer - Airflow (5-7 yrs)

Job Title: Senior Python Developer with Airflow Experience

Location: Bangalore (Work from office)

Job Description:

We are seeking a highly skilled and experienced Senior Python Developer with expertise in Airflow to join our team. As a Senior Python Developer, you will be responsible for designing, developing, testing, and maintaining scalable and reliable data pipelines using Airflow. You will collaborate with cross-functional teams to implement data solutions that drive business insights and improve data quality.

Responsibilities:

- Design, develop, and maintain data pipelines using Python and Apache Airflow.

- Collaborate with data engineers, data scientists, and other stakeholders to understand data requirements and translate them into technical solutions.

- Optimize and tune data pipelines for performance, reliability, and scalability.

- Implement monitoring, logging, and alerting for data pipelines to ensure data integrity and availability.

- Conduct code reviews, perform unit testing, and ensure code quality and best practices.

- Document technical designs, procedures, and guidelines for data pipeline development and maintenance.

- Stay updated with the latest technologies and industry trends related to data engineering and data processing.

Requirements:

- Bachelor's degree in Computer Science, Engineering, or related field.

- 5+ years of experience as a Python developer, with strong proficiency in Python programming and software development.

- Experience designing and implementing data pipelines using Apache Airflow orchestration tools.

- Solid understanding of distributed computing, data processing frameworks, and cloud platforms (e.g., AWS, Azure, GCP).

- Proficiency in SQL and database technologies (e.g., PostgreSQL, MySQL, MongoDB).

- Experience with version control systems (e.g., Git) and CI/CD pipelines.

- Strong problem-solving skills, attention to detail, and ability to work in a fast-paced environment.

- Excellent communication skills and ability to collaborate effectively with cross-functional teams.

Preferred Qualifications:

- Experience with containerization technologies (e.g., Docker, Kubernetes).

- Knowledge of data warehousing concepts and tools (e.g., Snowflake, Redshift).

- Familiarity with machine learning frameworks and data science workflows.

- Certifications related to Python development, data engineering, or cloud platforms.