Were on the lookout for the brightest, most committed individuals to join us on our mission Along the journey, we ll provide you with a nurturing environment where you can be part of something truly extraordinary and make a real difference for companies and the planet
About the role
This role involves the management, installation, and configuration of Hadoop/Spark components (Hive, HDFS, Ambari, NiFi), as well as designing the architecture to integrate with the o9 platform You will play a key role in the design, maintenance, and productionization of Hadoop/Spark/Delta Lake clusters, addressing daily production issues, and implementing containerization and automation to facilitate easier maintenance for the DevOps team
Key Responsibilities:
Collaborate with customers and technical consultants to design and recommend big data architecture solutions tailored to customer requirements
Analyze complex distributed production environments and provide actionable recommendations for performance optimization
Develop and present detailed architectural documentation for customers technical teams
Partner with o9 s Development, DevOps, and project teams to ensure the successful execution of projects
Design and implement distributed systems and configurations for Spark, Delta Lake, Hadoop, and related technologies, particularly in cloud-based deployments
Produce and maintain comprehensive technical documentation and user manuals for customers
Stay current with the latest advancements in the distributed big data ecosystem and cloud technologies
Qualifications and Skills:
Experience:
8+ years of experience in DevOps, with a focus on architecting large-scale storage, data processing, and globally distributed solutions
Proven expertise in designing and deploying large-scale, data-intensive solutions using Spark, Delta Lake, and Airflow schedulers
Strong experience designing and optimizing data queries within Spark/Delta Lake environments, using tools such as Apache Hive, HDFS, Apache Spark, and Hadoop
Experience with the installation, administration, and tuning of cloud-agnostic and distributed data systems
Extensive experience implementing solutions across cloud platforms (Azure, AWS, GCP)
Hands-on experience implementing big data use cases and a solid understanding of standard design patterns for Spark/distributed systems, including Airflow, NiFi, Kafka, and others
Significant experience working with network-based APIs, ideally REST/JSON or XML/SOAP
Skills:
Strong understanding of enterprise security solutions such as LDAP, Kerberos, and SSL implementation
Expertise in networking, troubleshooting, and optimizing data transfer across systems
Proficient in Python and Java development, including debugging and profiling
Solid background in database administration and design; experience with data modeling is a plus
Excellent verbal and written communication skills
Familiarity with R and machine learning algorithms is an advantage
Personal Attributes:
Ability to effectively translate customer requirements into technical solutions
A strong team player who values transparency, open communication, and collaboration At o9, we prioritize teamwork across all levels and functions
What we ll do for you:
Flat organization: With a very strong entrepreneurial culture (and no corporate politics)
Great people and unlimited fun at work
Possibility to really make a difference in a scale-up environment
Support network: Work with a team you can learn from every day
Diversity: We pride ourselves on our international working environment
Feel part of A team: https: / / youtube / QbjtgaCyhesfeature=shared
How the process works
Respond with your interest to us
We ll contact you either via video call or phone call - whatever you prefer, with the further schedule status
HackerEarth Online Assessment - Scenario based
During the interview phase, you will meet with the technical panel for 60 minutes We will contact you after the interview to let you know if we d like to progress your application
There will be 2 rounds of technical discussion followed by a Managerial Round
We will let you know if you re the successful candidate Good luck!
More about us
With the latest increase in our valuation from $27B to $37B despite challenging global macroeconomic conditions, o9 Solutions is one of the fastest-growing technology companies in the world today Our mission is to digitally transform planning and decision-making for the enterprise and the planet Our culture is high-energy and drives us to aim 10x in everything we do
Our platform, the o9 Digital Brain, is the premier AI-powered, cloud-native platform driving the digital transformations of major global enterprises including Google, Walmart, ABInBev, Starbucks and many others
Our headquarters are located in Dallas, with offices in Amsterdam, Paris, London, Barcelona, Madrid, Sao Paolo, Bengaluru, Tokyo, Seoul, Milan, Stockholm, Sydney, Shanghai, Singapore Munich, Toronto
o9 is an equal opportunity employer and seeks applicants of diverse backgrounds and hires without regard to race, colour, gender, religion, national origin, citizenship, age, sexual orientation or any other characteristic protected by law