Senior Software Engineer

JOB DESCRIPTION:
What Youll Do
As a Backend Software Engineer, you will:

• Design, build, and maintain scalable backend systems and infrastructure for
• high-performance data processing.
• Develop and optimize data processing pipelines using Apache Beam and other
• frameworks.
• Generate clean and well-structured datasets to support machine learning model training.
• Work on standing up and optimizing indexes to support large-scale data retrieval and
• processing needs.
• Contribute to the design and implementation of GenAI infrastructure, including
• Retrieval-Augmented Generation (RAG) setups.
• Train and run inference for ML models at scale, including utilizing multiple accelerators
• (e.g., GPUs).
• Ensure system reliability, scalability, and performance through robust testing, monitoring, and automation.

What We’re Looking For

Technical Skills:

• Strong proficiency in building and scaling data processing pipelines, with
• hands-on experience using Apache Beam.
• In-depth understanding of system design for scalability, including building indexes
• and optimizing search/retrieval systems.
• Experience with cloud platforms (especially GCP) and
• containerization/orchestration tools (Docker, Kubernetes).
• Proven experience in training and running inference for ML models at scale,
• including leveraging multiple accelerators (e.g., GPUs, TPUs).
• Expertise in generating clean and well-structured datasets for machine learning
• model training.
• Familiarity with GenAI workflows and infrastructure, particularly
• Retrieval-Augmented Generation (RAG) setups. Strong Python programming skills.
• Soft Skills:
• A proactive and resourceful problem-solver who thrives in ambiguity and can
• navigate a fast-paced, rapidly evolving environment.
• Comfortable adapting to frequently changing requirements and priorities in a
• start-up setting.
• Strong communication skills to effectively collaborate across small,
• cross-functional teams and articulate technical concepts to non-technical
• stakeholders.
• A builder’s mindset, with a passion for creating systems from the ground up and
• driving impact in a high-growth, high-uncertainty context.