Proclink - Azure Data Engineer - Synapse Analytics (5-10 yrs)

Job Description :

Job Summary :

As an Azure Data Engineer, you will design, build, and maintain data solutions on Microsoft Azure, leveraging your expertise in SQL , MySQL , Mongo DB to ensure high-quality data availability for analysis and reporting.

You will collaborate closely with cross-functional teams to meet data needs and enhance decision-making capabilities.

Key Responsibilities :

- Data Pipeline Development : Design and implement ETL processes using Azure Data Factory and Azure Databricks, ensuring data integration from various sources.

- Database Management : Develop and maintain relational databases using SQL and MySQL, ensuring optimal performance and reliability.

- Data Modelling : Create and maintain data models to support analytical needs, ensuring data is structured for efficient querying and reporting.

- Query Optimization : Write and optimize complex SQL queries for data retrieval and reporting, improving performance and efficiency.

- Collaboration : Work with data scientists, analysts, and business stakeholders to understand data requirements and ensure data quality.

- Security and Compliance : Implement data governance practices and ensure compliance with data protection regulations.

- Documentation : Create and maintain comprehensive documentation for data pipelines, databases, and architectural designs.

Technical Skills :

- 5+ years of experience in data engineering or related roles.

- Strong proficiency in Microsoft Azure services, particularly Azure Data Factory, Azure Databricks, Azure SQL Database , Synapse.

- Extensive experience with SQL and MySQL, including database design, optimization, and data manipulation.

- Familiarity with programming languages such as Python or spark for data processing and analysis.

- Understanding of data warehousing concepts and big data technologies (e., Hadoop, Spark) is a plus.

- Experience with real-time data processing and stream analytics.

- Familiarity with AWS services will be advantageous in our multi-cloud environment.

- Knowledge of machine learning concepts and tools.

- Excellent problem-solving skills and attention to detail.

- Strong communication skills and ability to work collaboratively in a team environment.

Preferred Qualifications :

- Bachelor's degree or equivalent.

- Microsoft Azure Data Engineer certification.