3i infotech - Data Engineer - Azure Data Services (3-5 yrs)

Responsibilities :

- Data Fabric Implementation: Design and implement data fabric solutions to unify data across multiple sources and platforms, ensuring seamless data flow and integration.

- Data Pipeline Development: Build and maintain scalable, efficient data pipelines using modern data engineering tools like data fabric platform and frameworks.

- Data Integration: Work with diverse data sources, including structured, semi-structured, and unstructured data, to create integrated datasets that support business analytics and decision-making.

- Cloud Infrastructure Management: Leverage cloud platforms (such as Azure, AWS, or Google Cloud) to deploy and manage data infrastructure, ensuring performance, scalability, and cost-efficiency.

- Data Quality and Governance: Develop and enforce data quality standards and governance practices to ensure data accuracy, consistency, and security.

- Performance Optimization: Monitor and optimize the performance of data pipelines and data fabric solutions to handle large volumes of data effectively.

- Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions that meet business objectives.

- Documentation: Create and maintain comprehensive documentation for data engineering processes, architectures, and workflows.

Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- 2+ years of experience as a Data Engineer or in a similar role, with a strong focus on cloud-based data solutions.

- Proficiency in Azure data services, including Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.

- Experience with data fabric platforms and frameworks, as well as modern data engineering tools.

- Strong knowledge of ETL processes and data integration techniques.

- Understanding of data governance principles and data quality best practices.

- Excellent problem-solving skills and a detail-oriented mindset.

- Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams