Anblicks hiring For Data Engineer-Databricks

Data Engineer-

Expeirice-6+ years

Location-Hyderabad(Hybrid model)

Job type-Permanent

Role Purpose

We are looking for a highly motivated and experienced Data Engineer to join our team of data experts. The ideal candidate will have a strong background in designing, Development processes using technologies such as Python, Spark, PySpark, SQL and NoSQL. As a Data Engineer, you will work closely with the Lead Data Engineer and Data Architect to implement end-to-end data solutions, build, and maintain data pipelines, and ensure the quality and integrity of our organization's data.

Role & responsibilities

Primary Skill Set

• Experience in Azure components like Azure Data Bricks, ADLS Storage, Key Vault, and cosmos db.
• Able to understand Optimizations on Spark, and SQL
• Create and Manage API deployed in Azure.

Collaborate with the Lead Data Engineer and Data Architect to design and implement end-to-end data solutions

•    Develop and maintain data pipelines and ETL processes using Python, Spark, and SQL
•     Ensure data quality and integrity by developing and implementing data validation and testing strategies
•    Implement data security measures to protect the confidentiality, integrity, and availability of our organization's data
•    Continuously monitor and evaluate the performance of data systems and make recommendations for improvements
•   Stay up-to-date with the latest data technologies and trends and provide recommendations for their adoption
•    Design and create processes for contextualizing, cleaning, aggregating, and transforming data, making it better and more useful to the business
•       Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics

Skills & Experience

Note-Immediate candidates are preferred