RapinnoTech Solutions - Senior Data Integration Engineer - Talend/Azure Databricks (6-7 yrs)

Job Title : Senior Data Integration Engineer (Talend + Azure + Databricks)

Location : Bangalore, Pune, Mumbai, Noida, Chennai, Hyderabad

Working Hours : 12 PM IST to 9 PM IST

Experience Required : 6 to 8 Years

Notice Period : Immediate to 3 Weeks Max

Job Description :

We are seeking a highly skilled Senior Data Integration Engineer with expertise in Talend and Azure Data Engineering tools to join our team. The ideal candidate will have a robust background in designing, developing, and managing ETL processes, particularly in big data environments, and will be proficient in utilizing Talend and Azure technologies.

Key Responsibilities :

Talend Integration Development :

- Design, develop, and maintain Talend ETL processes including Talend Integration (Standard and Big Data Jobs) and Talend Data Integration (DI).

- Implement batch processing jobs for Talend Big Data, ensuring efficient data handling and processing.

Technical Architecture & Data Pipelines :

- Design and document technical architecture for data integration solutions.

- Develop and optimize data pipelines using Talend and Azure tools.

- Ensure data quality and integrity throughout the data lifecycle.

Big Data Environment Management :

- Work with Azure Data Bricks (ADB) to handle big data processing and analytics.

- Scale performance and optimize data workflows to handle large volumes of data efficiently.

Azure Data Factory (ADF) :

- Implement and manage data integration processes using Azure Data Factory (ADF).

- Coordinate data movement and transformation between various data sources and destinations.

SQL Development :

- Write and optimize SQL queries for data extraction, transformation, and loading.

- Ensure efficient data querying and processing.

DevOps & CI/CD :

- Implement and manage Continuous Integration/Continuous Deployment (CI/CD) pipelines for data integration processes.

- Ensure automated deployment and monitoring of Talend and Azure solutions.

Documentation & Reporting :

- Document ETL processes, data flows, and technical specifications.

- Provide regular updates and reports on project status, issues, and resolutions.

Required Skills & Experience :

Talend Big Data :

- Proven experience in Talend Big Data batch processing and Talend Data Integration.

Azure Data Bricks (ADB) :

- Hands-on experience with Azure Data Bricks for big data processing.

Azure Data Factory (ADF) :

- Expertise in Azure Data Factory for data integration and orchestration.

SQL :

- Strong SQL skills for querying and managing databases.

DevOps :

- Experience with DevOps practices including CI/CD for data engineering solutions.

Experience :

- 6 to 8 years of relevant experience in data integration, ETL processes, and big data environments.

Problem-Solving :

- Strong analytical and problem-solving skills to address and resolve technical issues.

Communication :

- Excellent verbal and written communication skills to interact with stakeholders and document processes.