Azure Data Engineer - PySpark/Databricks (3-5 yrs)

About the job :

Are you passionate about working with cutting-edge AI technologies, handling petabytes of data, and taking on world-class projects? This is your chance to work on a Fortune 100 project while collaborating with a developer-focused platform that empowers engineers to thrive!

Position : Azure Data Engineer

Experience : 3+ years relevant experience in Azure Data Engineering

Location : Remote / Work from Home

Notice Period : Immediate to 30 days (Only candidates currently serving notice)

Interview Process : Just 2 technical rounds

Education : A technical degree is required

If you're ready to fuel your career with high-impact work and join a team that values innovation, don't miss this opportunity! Apply now and be part of an exciting journey at Recro!

Required Skills :

- Proficiency in Python for data processing, including working with Pandas, PySpark, and handling large datasets.

- Experience with Azure Data Factory (ADF), Databricks, Azure SQL Database, and Azure Blob Storage.

- Strong SQL skills, including query optimization and database migration.

- Solid understanding of Apache Spark and Delta Lake for scalable data processing.

- Ability to design, build, and maintain data pipelines on Azure Cloud platforms.

- Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF), Databricks, and other Azure services.

- Ensure data integrity and optimize the performance of ETL processes.

- Utilize Python, Pandas, and PySpark for data processing tasks, handling large datasets and performing data transformations.

Implement solutions using Apache Spark and Delta Lake for efficient data processing and management.

- Manage and optimize Azure SQL Database, including database migrations and query optimization.

- Work with Azure Blob Storage for data storage and retrieval.

- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure data solutions align with business needs.

- Communicate effectively with team members and stakeholders regarding project status, challenges, and milestones.

- Hands-on experience with Azure Data Factory (ADF), Azure Databricks, Azure SQL Database, and Azure Blob Storage.

- Solid understanding of Apache Spark and Delta Lake for scalable data processing.

- Strong SQL skills, including proficiency in query optimization and database migration processes.