o9 Solutions Inc - Data Engineer - PySpark/Python (4-7 yrs)

Be Part of Something Revolutionary

At o9 Solutions, we are redefining enterprise planning with our AI-driven platform - the o9 Digital Brain.

By integrating siloed planning capabilities, we help global enterprises unlock immense value while driving sustainability.

Our mission is to transform the way businesses plan, creating a positive impact on both profits and the planet.

We're looking for passionate, skilled, and driven individuals to join our team.

At o9, you'll find a nurturing environment where you can make a real difference for businesses and the planet.

About the Role :

We're seeking a talented Data Engineer who thrives in an agile environment, is passionate about problem-solving, and enjoys mentoring others.

If you're hands-on with design and development and have a knack for building high-performing data pipelines, we want to hear from you!

Key Responsibilities :

- Develop and optimize data pipelines for capturing historical snapshots of inputs and outputs.

- Apply industry best practices to performance-tune pipelines.

- Design and implement batch orchestration processes that minimize disruptions to planners' workflows.

- Write PySpark/Python plugins to enhance product functionality.

- Mentor junior team members, fostering a culture of learning and collaboration.

Skills and Qualifications :

- 4+ years of experience coding in PySpark and working with the Spark ecosystem (e.g, Spark SQL, DataFrames, Datasets, Streaming).

- Proven expertise as a data engineer with deep knowledge of PySpark, data lakes, Databricks, and Delta Tables.

- Strong experience with big data tools, data pipelines, ETL design, and implementation.

- Proficiency in Python programming, including libraries like Pandas (Scala is a plus).

- Ability to write production-level code, optimize data processing, and resolve performance bottlenecks.

- Familiarity with software development best practices, including Git, CI/CD, and Unit Testing.

- Collaborative mindset with effective cross-functional communication skills.

What We Offer :

- Flexibility : Work from home with no commute, giving you more time to focus on your goals.

- Culture : Flat organizational structure with an entrepreneurial spirit and no corporate politics.

- Community : Engaging after-work activities like Friday Socials (virtual or in-office).

- Professional Growth : A strong support network and opportunities to learn from talented colleagues.

- Benefits : Medical insurance, health club membership, and more.