Senior Azure Data Engineer - Databricks/Data Factory (5-6 yrs)

Job Description :

Tech Skills Required :

- Minimum 5 years of experience with Azure development and data solutions.

- High proficiency with Azure data technologies (Azure Data Factory, Databricks, Azure Synapse Analytics).

- Strong proficiency in SQL and writing complex data queries.

- Deep experience in all stages of Data Analysis, including data source analysis, profiling, and mapping.

- Proven experience building data pipelines using ADF, Azure Databricks, Synapse Analytics, PySpark, and Scala.

- Hands-on experience with managing and maintaining large-scale data warehouses in the cloud.

- Experience migrating data from legacy systems to Azure-based solutions.

Tech Skills (Preferred) :

- Knowledge of US healthcare industry/Pharmacy data (a plus).

- Familiarity with other Azure services like Data Lakes, SQL DW, and Analysis Services.

- Proficiency in using Azure Notebooks with Python and PySpark.

- Expertise in both Azure Data Factory and Azure Databricks.

Additional Skills :

- Excellent problem-solving and analytical skills.

- Strong communication, collaboration, and teamwork abilities.

- Ability to learn and adapt to new technologies quickly.

- Attention to detail and a commitment to high-quality work.

- Passion for data engineering and a desire to contribute to innovative solutions