PySpark Engineer - Machine Learning (6-8 yrs)

Job Title : PySpark ML Engineer

Number of years of experience : 6-8 years

Location : Bangalore (Whitefield), Pune( Koregoan park), Bhopal (Habib Ganz)

Mode : Hybrid (3 days a week to office)

Job Description :

- Demonstrate in depth knowledge of IDE, language and toolset in Python

- Implement critical path components in a large or complex project.

- Profile and optimize code

- Understand threads, threading model and concurrent programming

- Identify and apply appropriate design patterns to problems

- Strong hands-on experience in PySpark coding with ML libraries

- Should have experience in ML libraries and their implementation in multiple segment

- Understand importance of domain model and can coherently model a problem domain within a given context

- Comfortably debug/find complex problems

Qualifications :

Mandatory :

- Programming/Frameworks : JDK 1.8 or higher, Kafka, Python, Spark

- Testing : JUnit; Mocking

- WireMock : Karate

- Infrastructure : CI/CD using GitHub Actions

- Operating system : Linux/Unix (knowledge)