Lead Data Engineer- Spark

About Apexon:

Apexon is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.Apexon brings together distinct core competencies in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences to help businesses capitalize on the unlimited opportunities digital offers. Our reputation is built on a comprehensive suite of engineering services, a dedication to solving clientstoughest technology problems, and a commitment to continuous improvement. Backed by Goldman Sachs Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents.

We enable #HumanFirstDIGITAL

About the Lead Data Engineer Role

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes.

Responsibilities

• Design, develop & implement ETL processes on Azure Cloud using Databricks and Azure Synapse
• Advanced SQL knowledge, capable to write optimized queries for faster data work flows.
• Must be extremely well versed with handling large volume data and work using different tools to derive the required solution.
• Work with offshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices

Requirements

• Bachelors Degree or masters degree in Computer Science.
• 10+ years of hands-on software engineering experience.
• Proven work experience in Spark , Python ,SQL , Any RDBMS.
• Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS
• Strong database fundamentals including SQL, performance and schema design.
• Understanding of CI/CD framework is needed. Knowledge on DBT , Snowflake and AWS is an added advantage
• Ability to interpret/write custom shell scripts. Python scripting is a plus.
• Experience with Azure platform and Synapse
• Experience with Git / Azure DevOps
• To be able to work in a fast-paced agile development environment.

Our Commitment to Diversity & Inclusion:

Did you know that Apexon has been Certifiedby Great Place To Work, the global authority on workplace culture, in each of the three regions in which it operates: USA (for the fourth time in 2023), India (seven consecutive certifications as of 2023), and the UK.Apexon is committed to being an equal opportunity employer and promoting diversity in the workplace. We take affirmative action to ensure equal employment opportunity for all qualified individuals. Apexon strictly prohibits discrimination and harassment of any kind and provides equal employment opportunities to employees and applicants without regard to gender, race, color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. You can read about our Job Applicant Privacy policy here Job Applicant Privacy Policy (apexon.com)

Our Perks and Benefits:

Our benefits and rewards program has been thoughtfully designed to recognize your skills and contributions, elevate your learning/upskilling experience and provide care and support for you and your loved ones. As an Apexon Associate, you get continuous skill-based development, opportunities for career advancement, and access to comprehensive health and well-being benefits and assistance.

We also offer:

oGroup Health Insurance covering family of 4

o Term Insurance and Accident Insurance

o Paid Holidays & Earned Leaves

o Paid Parental LeaveoLearning & Career Development

o Employee Wellness