We are looking for an experienced Azure Data Engineer to design, implement, and optimize our data infrastructure. The ideal candidate will have a strong background in data engineering and experience working with Azure cloud services. You will be responsible for building and maintaining data pipelines, ensuring data quality, and supporting analytics and machine learning initiatives.
Key Responsibilities:
Design and implement scalable data pipelines using Azure Data Factory, Databricks, and other Azure services.
Develop, construct, test, and maintain architectures such as databases and large-scale data processing systems.
Ensure data quality and integrity through the implementation of data validation and cleaning processes.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
Optimize and manage existing data pipelines and processes for performance and cost efficiency.
Implement and manage data security, ensuring compliance with industry standards and regulations.
Monitor and troubleshoot data-related issues, providing timely resolutions.
Stay updated with the latest developments in Azure and data engineering technologies.
Qualifications:
Bachelor s degree in Computer Science, Information Technology, or a related field.
Proven experience as a Data Engineer with a focus on Azure cloud services.
Proficiency in Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Data Lake Storage.
Strong knowledge of SQL and experience with data modeling, ETL processes, and data warehousing.
Experience with programming languages such as Python, Scala, or Java.
Familiarity with big data technologies such as Hadoop and Spark.
Understanding of data governance, security, and compliance best practices.
Excellent problem-solving skills and attention to detail.
Ability to work independently and as part of a team.
Strong communication skills, both verbal and written.
Preferred Qualifications:
Certification in Azure Data Engineering (e.g., Microsoft Certified: Azure Data Engineer Associate).
Experience with data visualization tools like Power BI or Tableau.
Knowledge of machine learning concepts and frameworks.
Experience with Agile/Scrum development methodologies.