10 Airflow Jobs in Noida

Role & responsibilities

• Responsibilities will include:
• As SRE with Data Engineering expertise, you will be responsible for managing, maintaining, and troubleshooting GCP data pipelines. The ideal candidate will have extensive experience in cloud data engineering, with in-depth knowledge of Google Cloud Platform services and data pipeline architecture. Additionally, you will leverage your software engineering skills to optimize data pipelines and enhance their reliability.
  Required skills:
  
• 5+ years of industry experience in the field of Data Engineering support and enhancement.
• Proficient in Google Cloud Platform (GCP) services such as Dataflow, BigQuery, Cloud Storage and Pub/Sub.
• Strong understanding of data pipeline architectures and ETL processes.
• Experience with Python programming language in terms of data processing.
• Knowledge of SQL and experience with relational databases.
• Familiarity with version control systems like Git.
• Ability to analyze, troubleshoot, and resolve complex data pipeline issues.
• Software engineering experience in optimizing data pipelines to improve performance and reliability.
• Continuously optimize data pipeline efficiency and reduce operational costs and reduce number of issues/failures
• Automate repetitive tasks in data processing and management
• Experience in monitoring and alerting for Data Pipelines.
• Continuously improve data pipeline reliability through analysis and testing
• Perform SLA-oriented monitoring for critical pipelines and provide suggestions as well implement post business approval for SLA adherence if needed.
• Monitor performance and reliability of GCP data pipelines, Informatica ETL workflows, MDM and Control-M jobs.
• Maintain infrastructure reliability for GCP data pipelines, Informatica ETL workflows, MDM and Control-M jobs.
• Conduct post-incident reviews and implement improvements for data pipelines.
• Develop and maintain documentation for data pipeline systems and processes 
• Excellent communication and documentation skills.
• Strong problem-solving and analytical skills.
• Open to work in a 24X7 shift.
• Qualifications:
• Bachelor's degree in Computer Science or related technical field, or equivalent practical experience.
• Holding GCP Professional Data Engineer certification is an added advantage.
• Excellent verbal and written communication skills.
• Working on Any cloud preferred.