Designing and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services.
Managing and optimizing data storage using Azure Data Lake Storage, Azure SQL Data Warehouse.
Developing data models and maintaining data architecture to support data analytics and business intelligence reporting.
Ensuring data quality and consistency through data cleaning, transformation, and integration processes.
Monitoring and troubleshooting data-related issues within the Azure environment to maintain high availability and performance.
Collaborating with data scientists, business analysts, and other stakeholders to understand data requirements and implement appropriate data solutions.
Implementing data security measures, including encryption, access controls, and auditing, to protect sensitive information.
Automating data pipelines and workflows to streamline data ingestion, processing, and distribution tasks.
Utilizing Azures analytics services, such as Azure Synapse Analytics, to provide insights and support data-driven decision-making.
Keeping abreast of the latest Azure features and technologies to enhance data engineering processes and capabilities.
Documenting data procedures, systems, and architectures to maintain clarity and ensure compliance with regulatory standards.
Providing guidance and support for data governance, including metadata management, data lineage, and data cataloging.
Educational Qualification:
BE / B-Tech in Computer Science from a premier institute
MBA is preferred
Azure Cloud Data Engineering Certifications
Experience:
10 years of overall exp and at least 5 years exp in Azure Data Engineering