Azure Databricks Lead

About position:

The successful candidate will be responsible for designing, developing, and implementing data solutions using Databricks platform. This includes creating data models, establishing data architectures, and developing ETL processes. The role requires a deep understanding of big data technologies, data analysis, and the ability to work with large and complex data sets. The Databricks Developer will work closely with data scientists and other stakeholders to ensure the solutions meet business requirements and goals.

• Role: Azure Databricks Lead
• Location: All PSL Locations
• Experience: 5 9 Years
• Job Type: Full Time Employment

What You'll Do:

• Implementing and maintaining Azure Databricks.
• Responsible for the implementation and maintenance of Azure Databricks.
• Data Processing: The candidate will be responsible for processing raw data, cleaning it, and transforming it into a more usable format.
• The candidate will work closely with data scientists and other stakeholders to ensure that the data is accessible and useful.
• Continuous Improvement: The candidate will be expected to continuously improve and optimize the system, ensuring its efficiency and effectiveness.

Expertise You'll Bring:

• The candidate must have a strong understanding and hands-on experience with Azure, Microsoft’s cloud computing platform.
• Expertise in Azure Databricks: The candidate should have a deep understanding of Azure Databricks, an Apache Spark-based analytics platform.
• Knowledge of Databricks: The candidate should have a solid understanding of Databricks, a unified data analytics platform.
• A bachelor’s degree in computer science, Information Technology, Data Science, or a related field is required.
• Skills Experience with Python or Scala: Knowledge of these programming languages can be beneficial for data processing tasks.
• Familiarity with Spark: Experience with Apache Spark, a fast and general engine for large-scale data processing, is a plus.
• Knowledge of SQL: Understanding of SQL for managing data held in a relational database management system.
• Experience with Hadoop: Familiarity with the Hadoop software library, a framework that allows for the distributed processing of large data sets.
• Understanding of ETL processes: Knowledge of Extract, Transform, Load (ETL) processes can be beneficial.
• Familiarity with Machine Learning: Experience with machine learning algorithms and concepts.

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Our company fosters a values-driven and people-centric work environment that enables our employees to:

• Accelerate growth, both professionally and personally
• Impact the world in powerful, positive ways, using the latest technologies
• Enjoy collaborative innovation, with diversity and work-life wellbeing at the core
• Unlock global opportunities to work and learn with the industry’s best

Let’s unleash your full potential at Persistent

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”