324 Pyspark Jobs in Hyderabad / Secunderabad

Big Data Engineer JD

With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create meaningful transformation that moves us forward in our pursuit of a world that works better for people. Now, we’re calling upon the thinkers and doers, those with a natural curiosity and a hunger to keep learning, keep growing., People who thrive on fearlessly experimenting, seizing opportunities, and pushing boundaries to turn our vision into reality. And as you help us create a better world, we will help you build your own intellectual firepower.
Welcome to the relentless pursuit of better.
Inviting applications for the role of Principal Consultant – Big Data Engineer!
The candidate would be hands on Hadoop/Spark/Pyspark developer, actively participating in Agile Process, keen on learning new technologies, setting high standards for himself and other in the team. The candidate will have excellent technical writing and communication skills.
Responsibilities
†Work with multiple business teams to fully understand business requirements and translate them into data structures.
†Build and maintain conceptual/logical/physical data models. †Develop technical standards, procedures, and guidelines
• Create and maintain technical documentation, architecture designs and data flow diagrams.
• Constantly improving SDLC process, actively participating in adopting best industry practices
• Interface with business professionals, application developers and technical staff working in an agile process and environment
• Document success criteria and monitor solution effectiveness, including system performance, adoption and other key metrics
• 10+ years of experience developing enterprise-grade data integration solution
• Good understanding of Agile process, continuous delivery and best SDLC practices
• Strong understanding of Big Data stack including Pyspark, Spark, Hive, HBase, Hadoop, Kafka,
• Strong Python knowledge, Good to have Scala programing.
• Must have exp on Panda, ETL , Data warehouseing.
• Experience implementing micro-services
• Experience implementing Cloud-based services
• Good understanding of distributed systems design and implementation
• Ability to operate effectively in ambiguous situations.
• Ability to learn quickly, manage work independently and is a team player
Minimum Qualifications
 Bachelor’s Degree, Master in Computer Science, BTech, BE or equivalent 
 Strong SQL and Relational and no relational data base knowledge

Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values diversity and inclusion, respect and integrity, customer focus, and innovation. For more information, visit www.genpact.com . Follow us on Twitter, Facebook, LinkedIn, and YouTube.
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.