Pyspark Developer

Must Key things -Python Data Structure, Pyspark, AWS,SQL

Offshore Years Experience 6+ yrs

Hyderabad- 5 days onsite

Role & responsibilities

• Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.

• Collaborate with product and technology teams to design and validate the capabilities of the data platform
  
• Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability
  
• Provide technical support and usage guidance to the users of our platforms services.
  
• Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.

Preferred candidate profile

• Experience building and optimizing data pipelines in a distributed environment

• Experience supporting and working with cross-functional teams
  
• Proficiency working in Linux environment
  
• 5+ years of advanced working knowledge of SQL, Python, and PySpark
  
• Knowledge on Palantir
  
• Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline
  
• Experience with platform monitoring and alerts tools

Candidates with relevant experience can share Cv on recruitment@yellowstonexps.com or can call on 6283370752