Data Engineer - Azure Services (5-7 yrs)

Job Summary :

A purposeful Azure Data Engineer with over 5-7 years of experience in designing, developing, implementing, and optimizing data solutions on Microsoft Azure. Proven expertise in leveraging Azure services for ETL processes, data warehousing and analytics, ensuring optimal performance and scalability.

Skills :

- Azure Services: Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake, etc.

- Programming Languages: T-SQL, PySpark, Spark SQL, Fair knowledge on KQL.

- Data Modeling: ERD, Dimensional Modeling.

- ETL Tools: Azure Data Factory, Fair Knowledge of SSIS.

- Big Data Technologies: Fair knowledge on Hadoop and Spark.

- Performance Tuning and Troubleshooting.

- Version Control: Git, Azure DevOps.

Responsibilities :

- Proficient T-SQL developer in developing complex queries, stored procedures and skilled in performance tuning and ensuring database integrity and security.

- Designed and implemented Azure-based data solutions, by reducing data processing and optimizing costs by implementing efficient resource utilization strategies.

- Conducted performance tuning and troubleshooting of Azure SQL databases, enhancing system stability.

- Developed and Managed end-to-end ETL pipelines using Azure Data Factory, with improvement in data integration efficiency.

- Implemented Azure Synapse Analytics to streamline analytics workflows.

- Implemented data integration solutions leveraging Azure Data Factory and Azure Synapse Analytics for seamless data flow.

- Managed the migration of legacy data systems to Azure Synapse Analytics ensuring minimal downtime and improved performance.

- Orchestrated the migration of data infrastructure to Azure Databricks, ensuring seamless integration and improved efficiency.

- Developed and deployed scalable data pipelines on Azure Databricks.

- Implemented robust security measures for data storage and processing in compliance with industry standards and regulations.

- Collaborated with cross-functional teams to optimize data architecture and improve data quality.

- Developed and maintained Azure Data Lake storage solutions, enabling seamless data ingestion and processing.

- SSIS exp is mandatory.