Moveworks - Senior Software Engineer - Data Processing Infrastructure (6-10 yrs)

About Moveworks :

Moveworks is the AI Copilot that takes the friction out of work. It unifies every business system, giving employees one place to go to find information and automate tasks, increasing employee productivity by simplifying work.

Powered by genAI infrastructure that leverages the world's most advanced LLMs and our proprietary MoveLM models, the Moveworks Copilot understands employee requests, devises intelligent plans, then executes actions to get work done across application boundaries.

The world's most recognizable brands like Databricks, Broadcom, Hearst, and Palo Alto Networks trust Moveworks to automate repetitive support issues, to provide a universal search interface, and for common use cases across different applications.

Job Description :

Responsibilities :

- Design, build, and operate highly performant and scalable batch and stream data processing infrastructure and solutions to support day-to-day ML operations including training, serving, evaluation, and experimental systems.

- Design and develop Moveworks' foundational data models, data warehouse, and real-time and offline processing pipelines using AWS EMR Spark, Apache Kafka, AWS Athena, Snowflake, Airflow, Apache HUDI, etc.

- Closely work with machine learning teams and data science teams to understand their data needs, influence the data team's roadmap, and lead as well as execute various projects.

- Build a data governance platform for secure and compliant data management, including services for data cataloging, lineage, audit, deletion, and masking.

- Build and operate an Orchestration platform that includes Temporal and Airflow, enabling other teams to develop features and workflows.

- Build out platform and data services/APIs to make data available to various stakeholders and for customer-facing data products.

Requirements :

- 5+ years of experience as a senior/software engineer.

- Experience with Python Golang Java or C++.

- Experience with cloud infrastructure like AWS/GCP/Azure.

- Experience with relational or non-relational databases such as Postgres, AWS DataLake/S3 DynamoDB, or Snowflake.

- BS or higher in Computer Science or a related field