Azure Data Engineer - ETL/Spark/Python (5-8 yrs)

Mandatory skills :

Azure Databricks, Delta Lake, Spark, Python, SQL

Job Description :

Requirements :

- Candidate must be proficient in Databricks

- Understands where to obtain information needed to make the appropriate decisions

- Demonstrates ability to break down a problem to manageable pieces and implement effective timely solutions

- Identifies the problem versus the symptoms

- Manages problems that require involvement of others to solve

- Reaches sound decisions quickly

- Develops solutions to meet business needs that reflect a clear understanding of the

- Objectives, practices and procedures of the corporation department and business unit

Roles and Responsibilities :

- Provides innovative and cost-effective solution using Databricks

- Optimizes the use of all available resources

- Develop solutions to meet business needs that reflect a clear understanding of the objectives, practices and procedures of the corporation department and business unit

- Learn to adapt quickly to new Technologies as per the business need

- Develop a team of Operations Excellence, building tools and capabilities that the Development teams leverage to maintain high levels of performance, scalability, security, and availability

Skills :

- The Candidate must have 5-8 yrs of experience in Databricks Delta Lake

- Hands on experience on Azure

- Experience on Python scripting

- Relevant experience with ETL methods and with retrieving data from dimensional data models and data warehouses

- Strong experience with relational databases and data access methods especially SQL

-bKnowledge of Azure architecture and design