Data Engineer

Job Overview:

To work on development, monitoring and maintenance of Data pipelines across AE clusters.

Primary responsibilities:

Develop, Monitor and Maintain data pipeline for various AE plants.

Create and maintain optimal data pipeline architecture.

Assemble large, complex data sets that meet functional / non-functional business requirements.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.

Work with stakeholders including the Data officers and stewards to assist with data-related technical issues and support their data infrastructure needs.

Work on incidents highlighted by the data officers.

Incident diagnosis, routing, evaluation & resolution.

Analyze the root cause of incidents.

Create incident closure report.