Azure Data Engineer - Python/Scala/Java (6-8 yrs)

An Azure data engineer designs, implements, and manages data solutions on Microsoft Azure. They create and maintain data pipelines, storage, processing, and integration.

Responsibilities :

- Data security : Design and implement solutions to ensure data integrity, security, and privacy

- Data quality assurance : Combine raw data from different sources to create consistent, machine-readable formats

- Data processing: Build data processing pipelines using programming languages like Python, Scala, or Java

- Data storage : Manage data storage solutions

- Data mining, modeling, and warehousing : Perform data mining, modeling, and warehousing

- System improvement : Analyze business systems and look for areas of improvement

Skills

- Problem-solving and critical thinking : Analyze data challenges and devise effective solutions

- Collaboration and communication : Work closely with data scientists, business analysts, and stakeholders

- Programming and scripting : Create scalable, effective programming that can work with big datasets

- SQL : Be proficient in SQL

- Azure data services : Master the core components of Azure's data services, such as Azure SQL Database, Azure Blob Storage, and Azure Data Factory