Data Engineer (Azure+ Scala)

Job Description

About the Company :

Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 1900+ employees, we provide the intimacy of a boutique consultancy with the capabilities of a large IT services firm.

Role: Azure Data Engineer.

Experience: 7+ Years

Skill Set: Azure, Databricks, Scala, Pyspark and SQL.

Location: Pune

Responsibilities include:

• Develop Big Data applications using Scala-Spark on Azure Databricks.
• Design and build the best of class resilient solutions using universally accepted programming practices.
• Deliver solid production level code with minimal bugs and great code quality.
• Write unit tests to test your code.
• Debug production issues and provide fixes.
• Monitor implemented solutions to ensure system and cost performance.

Desirable Competencies:

• 8+ years of work experience
• Strong knowledge of Scala and functional programming. Must have worked on software projects • using Scala.
• Experience developing applications using Spark/Scala
• Extensive demonstrated software development experience, with a primary focus on writing new code to deliver, new functionality and enhancements.
• Proficient in writing clean, readable, and secure code.
• Feel comfortable participating in 2-week sprint development cycles.
• Familiarity with Microsoft Azure stack (Azure Storage Accounts, Data Factory and Databricks).
• Data Engineering experience with Spark/Scala/Python
• Working knowledge of Python
• Azure DevOps and CI/CD pipelines.