Senior Big Data Engineer

Title

 Senior Data Engineer 

Reporting

Manager Data Engineering

Job location

Jaipur/Gurugram

About the role 

Sr Big Data Engineer plays a critical role in leading Punchhs data innovations. By leveraging prior industrial experience in big data, he/she will help create cutting-edge data and analytics products for Punchh’s business partners. 

This role requires close collaborations with data, engineering, and product organizations. He/she should be not only an outstanding technical expert but also an inspirational leader in establishing Punchh’s best data engineering vision. 

What You’ll Do

• Optimize the infrastructure required for extraction, transformation, and loading of data from a wide variety of data sources using big data technologies. 
• Identify, design, and implement internal process improvements, e.g. automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability. 
• Manage our internal data pipelines that support product, marketing, and our external clients.  
• Represent the company’s expertise in advanced technologies in media outlets such as client interactions, conferences, blogs, and interviews. 
• Help senior leadership define PAR/Punchh’s long-term strategy in advanced technology. Advocate across the company the best practices for data usage. 

What You’ll Need 

• 6+ years of experience as a data engineering professional, developing scalable big data solutions. 
• Advanced degree in computer science, engineering, or other related fields. 
• Strong problem-solving skills with demonstrated rigor in maintaining a complex data pipeline. 
• Extensive knowledge of AWS cloud services and Hadoop technologies. 
• Excellent programming background in Python, and PySpark. Extensive experience in using the above to develop data products. 
• Experience with big data processing, e.g.  Hadoop (EMR), relational (Postgres, MySQL), NoSQL (MongoDB, Redis). 
• Experience in building real-time data pipelines using Kafka, Spark, or similar stacks on the cloud. 
• Experience with Docker and CI-CD tools (Jenkins/Jfrog) 
• Exceptional communication skills and ability to articulate a complex concept with thoughtful, actionable recommendations.