Data Engineer - Cloud Platform (6-12 yrs)

Job Title: Cloud Data Engineer

Location: Bangalore / Pune

Job Type: Full Time

Experience Required: 6-12 years

Notice Period: 0-30 Days

Job Category:

Digital, Cloud, Web Technologies

Job Description:

We are seeking an experienced Cloud Data Engineer with expertise in building and maintaining data pipelines and analytics solutions on AWS and Azure cloud platforms. The ideal candidate will have a strong background in cloud data services, particularly AWS Glue, Redshift, Azure Data Factory, and Synapse. Knowledge of IoT cloud services such as AWS IoT Core and Azure IoT Hub is preferred.

Responsibilities :

- Design, develop, and maintain scalable and efficient data pipelines using AWS (Glue, Redshift) and Azure (Data Factory, Synapse).

- Collaborate with cross-functional teams to understand data needs and provide solutions to integrate and process data from various sources.

- Optimize data storage and processing for performance, cost, and scalability.

- Implement and manage data workflows, ensuring data consistency and quality.

- Work with IoT data sources, leveraging AWS IoT Core and Azure IoT Hub for data ingestion and processing.

- Monitor pipeline performance and troubleshoot issues to ensure smooth operations.

- Collaborate with data scientists, analysts, and other stakeholders to deliver impactful data solutions.

Mandatory Skills :

- Strong expertise in AWS data services, including AWS Glue, Redshift.

- Proficiency in Azure Data Factory and Synapse for data processing and analytics.

- Experience in creating and managing cloud-based data pipelines and analytics workflows.

- Familiarity with data modeling and data warehousing concepts.

Preferred Skills :

- Experience with AWS IoT Core for IoT data management and processing.

- Experience with Azure IoT Hub for managing IoT data.

- Strong knowledge of SQL and scripting languages for data manipulation.

Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- 6-12 years of experience in data engineering, cloud computing, and data pipeline development.