Senior Data Mesh Engineer (3-7 yrs)

Job Description :

- Our IT client based in Malad, Mumbai is looking for a Data Mesh Engineer. The main purpose of the role is to design, build, and maintain data pipelines and infrastructure using Microsoft Fabric components. You'll play a crucial role in enabling data mesh architecture within the organization, ensuring scalability, reliability, and efficient data processing

Experience :

- 3+ years of practical experience as a full-time data engineer or business intelligence developer in a fast paced environment

- Prior work as part of an agile and interdisciplinary team within a startup or an international corporate

Mandatory Capabilities :

- Microsoft Fabric Expertise : In-depth knowledge of Microsoft Fabric and its components (or Azure Synapse) and their application in data engineering

- Data Modelling & Access : Deep know how in modelling data across medallion layers and providing data products

- Problem-Solving : Ability to troubleshoot complex data engineering challenges

- Collaboration : Effective communication and teamwork skills and experience in agile method

Good to have :

- Data Mesh Principles : Understanding of domain-driven design, data product thinking, and decentralized data ownership

- Big Data Technologies : Exposure to big data technologies (Hadoop, Spark) within the Microsoft ecosystem

- Real-Time Data Processing : Familiarity with streaming platforms (Azure Stream Analytics, Kafka)

- Machine Learning Integration : Knowledge of integrating ML pipelines with data mesh architecture

- DevOps Practices : Experience with containerization (Docker, Kubernetes) and CI/CD pipelines