Staff, Software Engineer

Responsibilities

• Design, develop, test, and maintain robust backend systems and data architectures, including databases and large-scale processing systems.
• Implement solutions to ensure the reliability, integrity, and quality of data across systems, with a focus on data governance and compliance.
• Collaborate with cross-functional teams to define and implement data governance strategies, ensuring data is well-organized, traceable, and accessible in the data catalog.
• Lead a small team of 2-3 junior engineers, providing technical direction and ensuring successful delivery of projects or modules.
• Ensure the availability and reliability of data systems, proactively addressing data quality issues and driving improvements in data accuracy and consistency.
• Troubleshoot and resolve data-related issues across the architecture, ensuring seamless data flow and operational continuity.
• Document data governance processes, backend systems, and cataloging practices to ensure clarity and alignment with organizational standards.
• Stay up to date with emerging trends in data governance, data cataloging, and data reliability, applying these insights to improve overall system integrity.

• 8-12 years of experience in Software Engineering, Infrastructure, and Data Platforms.
• Proven experience in technically leading a team of 2-3 junior engineers and successfully delivering projects or modules in previous roles.
• Proficiency in high-level programming languages such as Python and Java.
• Strong expertise in designing and developing scalable, high-performance backend systems for distributed applications.
• Deep expertise in modern technologies like Kafka, Spark, Hudi-based data lakes, Presto, ETL tools, low-latency data stores, multiple data warehouses, and data catalogs.
• Demonstrated technical depth and breadth, evidenced through papers, code contributions, or technical presentations.
• Comprehensive understanding of the software development lifecycle, from requirement analysis to debugging complex production systems.
• Experience exploring and implementing solutions to enhance data quality and reliability.
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
• In-depth knowledge of object-oriented design principles, data structures, and algorithms.
• Ability to work independently and collaboratively, with a proven track record of driving projects forward, even in ambiguous situations.
• Hands-on experience with Agile methodologies and iterative development practices.
• Excellent written and verbal communication skills.
• Strong customer focus and the ability to align technical solutions with business needs.

• Expertise with observability tools like Prometheus, Grafana, or Datadog for monitoring distributed systems.
• Strong experience with DevOps principles and infrastructure as code (IaC) using Terraform or CloudFormation.
• Proficiency in API gateways and message brokers like Kafka for building scalable, event-driven systems.

What We Offer