Azure Data Engineer - Databricks/Data Factory (5-9 yrs)

Salary : 10 - 21LPA

Job Title : Azure Data Engineer

Experience : 5+ years as Azure Data Engineer

Location : Hyderabad

Working Hours : 12.00pm to 9.00pm

Job Description :

Key Responsibilities :

- Ensure that Health and Safety is the number one goal by following policies, processes, and always acting in a safe manner.

- Design data storage systems that scale, perform, and are economical enough to satisfy the organization's requirements.

- Develop and implement data integration processes, frequently using Azure Data Factory, to extract, transform, and load (ETL) data from various sources into Azure data warehouses or data lakes.

- Use big data technologies like Apache Spark to handle and analyze enormous volumes of data.

- Collaborate with data scientists to create data sets and engineer features for AI Initiatives

- Implement and optimize data retrieval for Power BI solutions.

What does it take to work for our company?

- A master's degree in computer science, Statistics, Mathematics, or a related field is required. A bachelor's degree with significant relevant experience would suffice.

- 5+ years of data engineering experience leveraging technologies such as Azure Data Factory, Azure Synapse Analytics, Azure Stream Analytics, Azure Event Hubs, Azure Data Lake Storage, Azure Databricks

- Experience with data pipelines and engineering infrastructure: You should have experience designing and implementing data pipelines and engineering infrastructure for machine learning systems.

- Solid knowledge of data processing languages, including SQL, Python, Scala.

- Experience with AI implementations and Power BI.

- Experience with Microsoft Azure's data services: You should have hands-on experience with various data services offered by Microsoft Azure, such as Azure Machine Learning, Azure Databricks, and Azure Data Factory.

- Familiarity with Azure Cognitive Services for integrating AI capabilities (like vision, language, and decision functionalities) directly into applications.

- Ability to work with large datasets and experience with data processing tools like SQL, Pandas, and big data technologies such as Apache Spark.

- Proficiency in Python, .NET C#, API development

- Experience with SQL, NoSQL databases and Data Fabric architectures.

- Strong communication skills to effectively collaborate with team members and stakeholders.

- Strong problem-solving skills and ability to think algorithmically.

- Ability to translate complex findings into a compelling narrative for non-technical stakeholders.

- Certifications like Microsoft Certified: Azure Data Engineer Associate will be preferred.