Senior Data Engineer

Design, develop, and optimize data pipelines on Azure and Fabric using services such as Azure Data Factory,. Azure Databricks, and Azure Synapse Analytics.

Architect scalable and efficient data storage solutions on Azure, leveraging technologies like Azure Blob Storage, Azure SQL Database, and Azure Cosmos DB.

Implement data integration workflows to ingest, process, and transform structured and unstructured data from various sources.

Ensure data quality and accuracy through data cleansing, transformation, and validation processes.

Collaborate with data scientists and analysts to deploy machine learning models and enable advanced analytics capabilities.

Ensure data security, compliance, and governance standards are met across all data processes and systems.

Lead and mentor a team of data engineers, providing technical guidance and driving continuous improvement.

Stay current with emerging trends and technologies in data engineering and cloud computing and evaluate their potential impact on our data strategy.

Qualifications. Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

6+ years of experience in data engineering, with a focus on cloud platforms, preferably Azure.

Proficiency in SQL, Python, PySpark or other programming languages commonly used in data engineering.

Strong understanding of data modelling, ETL processes, Data Marts and data warehousing concepts.

Experience with big data technologies such as Hadoop, Spark, or Kafka is a plus.

Azure certifications are highly preferred.

Prior experience in the banking sector is advantageous and preferred.

Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.

Effective communication skills with the ability to articulate technical concepts to non-technical stakeholders.

Preferred Skills. Experience with CI/CD pipelines for data engineering workloads on MS Azure Fabric. Hands-on experience in designing and managing data lakes, data warehouses and downstream marts. Hands-on experience with AZURE ecosystem (Databricks, Data factory, HDInsight, Event Hubs, AKS, Azure DevOps etc). Exposure to modern development approaches (containerization, microservices, CI/CD). Hands-on experience with relational database platforms (Oracle, SQL Server, Postgres, MySQL). Knowledge of data governance and security regulations. Experience with big data technologies (e.g., Apache Spark, Databricks). Familiarity with data visualization tools (e.g., Power BI).