Azure Data Engineer - Dai

Skills Required

• 3 - 6 years’ experience in one of the deep technical specializations below:
• Analytics: SQL DW, Azure Data Factory & Azure Databricks.
• Experience in ETL/Pipeline Development using tools such as Azure Databricks/Apache Spark and Azure Data Factory with development expertise in batch and Realtime data integration.
• Working experience on PostgreSQL is mandate.
• Design and Develop Data Processing
• Advanced Analytics including Azure Synapse Analytics, Azure Data Bricks, data visualization tools.
• Experience in programming using Pyspark / Python
• Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL
• Enterprise-scale technical experience with cloud and hybrid infrastructures, architecture designs, database migrations, and technology management.
• Hands-on experience on the Application migration from on premises to Azure cloud

Roles & Responsibilities

• Sound knowledge & hands-on experience in design and implementation of Azure Data Factory pipelines.
• Hands-on experience with GitHub, Azure DevOps, and Azure pipelines for CI/CD performance tuning ADF pipelines, Debugging issues with transformation, connectivity.
• Sound knowledge & hands-on experience in Azure Data factory, Azure Logic Apps flow, Azure Data Lake, Azure Synapse, Azure Databricks, PySpark.
• Knowledge on Azure DevOps CI/CD
• Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution.
• Build ADF pipelines and orchestrate end to end.
• Ability to multi-task under pressure and work independently with minimal supervision.
• Strong verbal and written communication skills.
• Must be a team player and enjoy working in a cooperative and collaborative team environment.
• Adaptable to new technologies and standards.
• Participate in all aspects of solution delivery life cycle including analysis, design, development, testing, production deployment.
• Must be well versed with agile way of delivery

Preferred Skills: - Azure Data Factory, Azure DevOps CI/CD, Azure Logic Apps flow, Azure Data Lake, Azure Synapse, Azure Databricks, PySpark, GitHub.