SRE(Gcp Data pipeline Support)

Role & responsibilities

As SRE with Data Engineering expertise, you will be responsible for managing, maintaining, and troubleshooting GCP data pipelines. The ideal candidate will have extensive experience in cloud data engineering, with in-depth knowledge of Google Cloud Platform services and data pipeline architecture. Additionally, you will leverage your software engineering skills to optimize data pipelines and enhance their reliability.

Required skills:

• 4+ years of industry experience in the field of Data Engineering support and enhancement
• Proficient in Google Cloud Platform (GCP) services such as Dataflow, BigQuery, Cloud Storage and Pub/Sub.
• Strong understanding of data pipeline architectures and ETL processes.
• Experience with Python programming language in terms of data processing.
• Knowledge of SQL and experience with relational databases.
• Familiarity with version control systems like Git.
• Ability to analyze, troubleshoot, and resolve complex data pipeline issues.
• Software engineering experience in optimizing data pipelines to improve performance and reliability.
• Continuously optimize data pipeline efficiency and reduce operational costs and reduce number of issues/failures
• Automate repetitive tasks in data processing and management
• Experience in monitoring and alerting for Data Pipelines.
• Continuously improve data pipeline reliability through analysis and testing
• Perform SLA-oriented monitoring for critical pipelines and provide suggestions as well implement post business approval for SLA adherence if needed.
• Monitor performance and reliability of GCP data pipelines, Informatica ETL workflows, MDM and Control-M jobs.
• Maintain infrastructure reliability for GCP data pipelines, Informatica ETL workflows, MDM and Control-M jobs.
• Conduct post-incident reviews and implement improvements for data pipelines.
• Develop and maintain documentation for data pipeline systems and processes 
• Excellent communication and documentation skills.
• Strong problem-solving and analytical skills.
• Open to work in a 24X7 shift.

Qualifications:

• Bachelor's degree in Computer Science or related technical field, or equivalent practical experience.
• Holding GCP Professional Data Engineer certification is an added advantage.
• Excellent verbal and written communication skills.