Senior Architect - Advanced Java and Data Pipelines

Job Summary:

We are seeking a highly skilled Senior Architect with advanced expertise in Java and Python to design and extend scalable, efficient data pipelines and modernize the C3PO framework to integrate with emerging technologies. The ideal candidate will think holistically and drive architectural excellence across diverse systems while collaborating with cross-functional teams.

Key Responsibilities:

• Architect and implement robust, scalable data pipelines using advanced Java and Python for dynamic workloads.

• Extend and enhance the C3PO framework to support additional technologies and integrate with modern data platforms.

• Leverage Java and Python to design modular, reusable, and performance-optimized components for large-scale systems.

• Collaborate with engineering and data science teams to translate business needs into innovative technical solutions.

• Design and document system architectures with a focus on scalability, reliability, and performance.

• Develop solutions to manage complex data flows, ensuring data accuracy, integrity, and security.

• Conduct performance tuning, code reviews, and mentor junior developers in best practices for Java and Python development.

• Monitor, troubleshoot, and optimize data pipelines and infrastructure for efficiency and resilience.

Qualifications:

• Bachelor s or Master s degree in Computer Science, Software Engineering, or a related field.

• 8+ years of experience in software architecture and development with advanced Java and Python expertise.

• Proven experience in building and optimizing data pipelines and workflows for large-scale data processing.

• Strong knowledge of distributed systems, microservices architecture, and event-driven frameworks.

• Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.

• Proficiency with tools like Apache Kafka, Apache Spark, or Flink for streaming and batch processing.

• Expertise in database systems (SQL and NoSQL), data governance, and data security practices.

• Excellent problem-solving skills with the ability to design holistic solutions for complex technical challenges.

Preferred Skills:

• Experience with modern data platforms like Starburst, Iceberg, and Snowflake.

• Knowledge of containerization and orchestration tools such as Docker and Kubernetes.

• Familiarity with DevOps practices, CI/CD pipelines, and infrastructure as code.

• Ability to communicate effectively with technical and non-technical stakeholders.

• A strong sense of ownership and accountability for delivering high-quality results.