Quadrant Technologies - Data Engineer - Azure Databricks (4-7 yrs)

We are looking for Azure Data Engineers!!.

Exp : 4 -7 Years.

Location : Hyderabad/Bangalore.

Mode : Hybrid.

Notice : 10 days.

Skills :

Mandatory : Pyspark,SQL,DAX,Cube,.

Preferred : ADF,ADB,SSIS/SSAS, Fabric.

Responsibilities :

Data Curation and Transformation :

- Translate business requirements into technical solutions for data curation and transformation, specifically using Databricks Lakehouse from a modeling and ELT perspective.

- Azure Data Engineering : Develop data pipelines and orchestration using Azure Data Factory and other

Azure Modern Data Warehouse platform components.

- SQL and Pyspark : Utilize SQL programming and Pyspark for data manipulation and processing tasks.

- Azure Services : Work with Azure services such as ADLS (Azure Data Lake Storage), ADX (Azure Data Explorer), and Databricks.

- Data Migration : Experience in SQL Server migration to the cloud and handling structured and unstructured datasets.

- DevOps and CI/CD : Good knowledge of DevOps tools and processes, and experience in automating data pipelines through a CI/CD delivery methodology.

- Databricks Expertise : In-depth hands-on implementation knowledge on Azure Databricks, Databricks Delta Lake, and managing Delta Tables.

- Data Modeling : Understand and implement data modeling for the data lake.

- Data Transfer and Oracle PL/SQL : Hands-on experience in using secure file transfer tools like Kiteworks, and Oracle PL/SQL knowledge will be a plus.

- Effort Estimation : Provide effort estimation for new projects related to data engineering.

- Complex Design and Agile Environment : Drive complex design and development efforts in an agile environment.

Qualifications :

- Minimum of 5-7 years of experience working on Azure and Databricks "Lakehouse" implementation.

- Strong experience in ADF (Azure Data Factory) and SQL as primary skills.

- Familiarity with Informatica PWC and Oracle PL/SQL.

- Experience in SQL programming and Pyspark.

- 2 or more years of experience as a Data Engineer, specifically in the Azure Modern Data Warehouse

platform.

- Good understanding of data modeling and data lake concepts.

- Expertise in Databricks, ADLS, ADX, and other Azure services.

- Prior experience in SQL Server migration to the cloud.

- Knowledge of DevOps tools and processes