Business Email

PySpark, Spark, Python, Google Cloud Platform (GCP)

About Us

CLOUDSUFI is a Data Science and Product Engineering organization building Products and Solutions for Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting edge infrastructure and cloud services. We partner with our customers to monetize their data and make enterprise data dance.

Job Description

We are seeking a skilled PySpark/Python Developer to join our team. The ideal candidate will be responsible for building scalable and efficient big data processing solutions using PySpark, Python, and related technologies. You will collaborate closely with data engineers, analysts, and business stakeholders to develop data pipelines and optimize performance for real-time data processing.

Job Responsibilities

• Writing the design specifications and user stories for the functionalities assigned.
• Develop assigned components / classes and assist QA team in writing the test cases
• Create and maintain coding best practices and do peer code / solution reviews
• Participate in Daily Scrum calls, Scrum Planning, Retro and Demos meetings
• Bring out technical/design/architectural challenges/risks during execution, develop action plan for mitigation and aversion of identified risks
• Comply with development processes, documentation templates and tools prescribed by CloudSufi or and its clients
• Work with other teams and Architects in the organization and assist them on technical Issues/Demos/POCs and proposal writing for prospective clients
• Contribute towards the creation of knowledge repository, reusable assets/solution accelerators and IPs
• Provide feedback to junior developers and be a coach and mentor for them
• Provide training sessions on the latest technologies and topics to others employees in the organization
• Participate in organization development activities time to time Interviews, CSR/Employee engagement activities, participation in business events/conferences, implementation of new policies, systems and procedures as decided by Management team

Required Experience:

• Proficiency in Python and PySpark and Strong problem-solving skills
• Familiarity with gcp Cloud platform
• Experience on building connectors and framework to bring metadata and data from target application
• Experience in developing solutions around PySpark to run and execute spark jobs
• Develop, maintain, and optimize connectors using Apache Spark and Python.
• Troubleshoot and improve the performance of Connectors Spark jobs
• Must have excellent knowledge in Apache Spark and Python programming experience
• Deep experience in developing data processing tasks using PySpark such as reading data from external sources, merging data, performing data enrichment and loading into target data destinations.
• Should have experience in integrating PySpark with downstream and upstream connectors through a batch/real-time interface.
• Must have in-depth knowledge of integration architecture
• Experience with developing solutions on Google Cloud Platform will be an added advantage.
• Should have good hands-on experience with Software Engineering tools viz. Eclipse, Visual Studio, JIRA, Confluence, BitBucket, SVN etc.
• Should be very well verse with current technology trends in IT Solutions e.g. Cloud Platform Development, DevOps, Low Code solutions, Intelligent Automation

Non Technical / Behavioral Competencies

• Must have worked with US/Europe based clients in onsite/offshore delivery model
• Should have very good verbal and written communication, technical articulation, listening and presentation skills
• Should have proven analytical and problem solving skills
• Should have demonstrated effective task prioritization, time management and internal/external stakeholder management skills
• Should be a quick learner and team player
• Should have experience of working under stringent deadlines in a Matrix organization structure

Apply for this position Allowed Type(s): .pdf, .doc, .docx By using this form you agree with the storage and handling of your data by this website. * Want to Make your Enterprise Data Dance