Azure Cloud Data Engineer

We are seeking a highly skilled Azure Cloud Data Engineer with strong experience in Azure Synapse Analytics, Azure Kubernetes Service (AKS), Azure Databricks, and Delta Lake.

The ideal candidate will be responsible for designing, implementing, and optimizing cloud-based data solutions that enable large-scale data analytics and machine learning workloads.

This role requires a deep understanding of Azure cloud technologies and a passion for building scalable and efficient data pipelines.

We are looking for a seasonal Azure Synapse Cloud Engineer to Develop data ingestion & enrichment and model development/execution on Azure cloud

Help us build state of the art solutions that underpin monitoring & surveillance models and alert generation using cutting edge technologies like Scala, Apache spark, Azure Data Lake, Databricks, SQL etc.

Demonstrate superior problem solving skills.

Demonstrate superior collaboration skills in working closely with other development, testing and implementation teams to roll-out important regulatory and business improvement programs.

Key Responsibilities:

• Design and implement end-to-end data pipelines using Azure Synapse, Azure Databricks, and Delta Lake.
• Develop and manage Azure Data Lake, Azure Synapse Analytics, and related services to support data integration and analytics.
• Work with Azure Kubernetes Service (AKS) to deploy, scale, and manage containerized data applications and services.
• Build and maintain data models, data warehousing solutions, and data integration frameworks.
• Implement and optimize ETL processes for structured and unstructured data.
• Collaborate with data scientists, analysts, and other stakeholders to support business analytics and machine learning workflows.
• Ensure high availability, scalability, and security of cloud data solutions.
• Troubleshoot and resolve issues in production environments, ensuring data integrity and performance.
• Write efficient, reusable code for data processing and automation using Python, Scala, or similar languages.
• Manage version control and continuous integration processes for data pipelines.
• Optimize data storage and retrieval to reduce costs and improve performance, particularly within Delta Lake environments.
• Stay current with new Azure services and tools, and continuously innovate to improve cloud-based data systems.

Required Skills and Experience:

• Proven experience as a Data Engineer or Cloud Data Engineer with expertise in Azure Cloud technologies.
• Strong hands-on experience with Azure Synapse Analytics for big data processing and data warehousing solutions.
• Experience with Azure Databricks for developing data pipelines and performing advanced analytics.
• Proficiency in working with Delta Lake for efficient data storage, versioning, and management on Azure.
• Experience with Azure Kubernetes Service (AKS), including container orchestration and deployment for data pipelines and applications.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Strong programming skills in languages such as Python, Scala, or SQL for data manipulation, pipeline orchestration, and automation.
• Experience with data storage solutions such as Azure Data Lake, Azure Blob Storage, and Azure SQL Database.
• Familiarity with data processing frameworks like Apache Spark and Apache Kafka.
• Experience with monitoring, logging, and troubleshooting data solutions in cloud environments
• Knowledge of best practices for cloud security, compliance, and data privacy.
• Excellent problem-solving and communication skills, with the ability to collaborate across teams.

Mandatory Skills

Azure synapse, Azure AKS, DataBricks, Delta Lake. SQL and Oracle Pl/SQL Queries questions. And Python will be a big plus.