Azure Data Engineer - Python/SQL (4-6 yrs)

Primary Skills : ADF,Databricks

Secondary Skills : DBT, Python, Databricks, Airflow, Fivetran, Glue, Snowflake

Role Responsibility :

- Translate functional specifications and change requests into technical specifications

- Translate business requirement document, functional specification, and technical specification to related coding

- Develop efficient code with unit testing and code documentation

- Ensuring accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem solving

- Setting up the development environment and configuration of the development tools

- Communicate with all the project stakeholders on the project status

- Manage, monitor, and ensure the security and privacy of data to satisfy business needs

- Contribute to the automation of modules, wherever required To be proficient in written, verbal and presentation communication (English)

- Co-ordinating with the UAT team

Role Requirement :

- Proficient in basic and advanced SQL programming concepts (Procedures, Analytical functions etc.)

- Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing dimensions etc.)

- Knowledgeable in Shell / PowerShell scripting

- Knowledgeable in relational databases, nonrelational databases, data streams, and file stores

- Knowledgeable in performance tuning and optimization

- Experience in Data Profiling and Data validation

- Experience in requirements gathering and documentation processes and performing unit testing

- Understanding and Implementing QA and various testing process in the project

- Knowledge in any BI tools will be an added advantage

- Sound aptitude, outstanding logical reasoning, and analytical

Skills :

- Willingness to learn and take initiatives

- Ability to adapt to fast-paced Agile environment

Additional Requirement :

- Demonstrated expertise as a Data Engineer, specializing in Azure cloud services.

- Highly skilled in Azure Data Factory, Azure Data Lake, Azure Databricks, and Azure Synapse Analytics.

- Create and execute efficient, scalable, and dependable data pipelines utilizing Azure Data Factory.

- Utilize Azure Databricks for data transformation and processing.

- Effectively oversee and enhance data storage solutions, emphasizing Azure Data Lake and other

- Azure storage services.

- Construct and uphold workflows for data orchestration and scheduling using Azure Data Factory or equivalent tools.

- Proficient in programming languages like Python, SQL, and conversant with pertinent scripting languages.