Senior Hadoop Solutions Architect

Senior Hadoop Solutions Architect

Experience: 12-18 years in Analytics and Big Data with at least the last 3-4 years in CDP Senior Hadoop Solutions Architect role

Location: Mumbai, India

Department: Big Data, Analytics and Cloud

Company: Smartavya Analytica Private limited is niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experience in handling large datasets up to 20 PBs in a single implementation, delivering many successful data and AI projects across major industries, including retail, finance, telecom, manufacturing, insurance, and capital markets. We are leaders in Big Data, Cloud and Analytics projects with super specialisation in very very large Data Platforms.

https://smart-analytica.com

Empowering Your Digital Transformation with Data Modernization and AI Key

Responsibilities:

• Lead the end-to-end architecture, design, and implementation of Hadoop-based Cloudera CDP on-prem data solutions.

• Ensure data availability, scalability, and reliability across Hadoop clusters.

• Collaborate with data engineers, data scientists, and business stakeholders to gather requirements and deliver tailored big data solutions.

• Optimize and tune Hadoop systems for performance and scalability.

• Maintain and document Hadoop environments to ensure reproducibility and reliability of data processes.

• Oversee the integration of Hadoop with other data systems and tools.

• Implement and manage data security, privacy, and governance frameworks within Hadoop ecosystems.

• Mentor and guide junior team members, fostering a culture of continuous learning and improvement.

• Drive continuous improvement initiatives to enhance Hadoop capabilities and operational efficiency.

• Communicate complex technical concepts and solutions to non-technical stakeholders effectively.

Requirements:

• Extensive proficiency in Hadoop ecosystems, including HDFS, Ozone, Kudu, Spark Streaming, YARN, Hive, and Spark. Excellent Performance tuning skills is a must

• Strong leadership and project management skills, with a demonstrated ability to manage large-scale data projects. Client Engagement and Presentation skills are mandatory

• Experience with Hadoop administration and optimization on various operating environments.

• Excellent problem-solving skills and the ability to manage failures in a production setting.

• Familiarity with Reporting tools, Data Integration Tools and ETL processes.

• Strong communication and collaboration skills to work effectively with business users and cross-functional teams.

• Ability to work in high-pressure situations and handle multiple priorities.

Academic Qualifications:

• Bachelor’s degree in computer science, Information Technology, or a related field.

• Relevant certifications (e.g., Cloudera Certified Architect, Hortonworks Data Platform Certified) are a plus. Experience:

• 12-18 years of experience in Analytics and Big Data, with at least the last 6 years or more in a senior role specifically focusing on Hadoop architecture and administration.

If you have a passion for big data technologies and a strong background in Hadoop, we encourage you to apply and be a part of our innovative team at Smartavya Analytica Private Limited.