Senior Engineering Manager Data Platform

Job Title: Senior Engineering Manager Data Platform

Position Overview:

We are looking for a highly skilled and experienced Senior Engineering Manager to lead our Data Platform team. The ideal candidate will have a strong background in Java Full Stack Development, Spring Boot, Kafka, AWS, and Data Streaming technologies. This role is integral to the ongoing transformation of our enterprise platform, as we work to process billions of records per day and migrate from legacy systems to modern cloud-based architectures.

As a Senior Engineering Manager, you will be responsible for both leading the development team and ensuring that the platform scales efficiently, handles massive data throughput, and is built with best-in-class technology. You will drive the architectural decisions, collaborate closely with cross-functional teams, and manage the migration to new platforms while overseeing day-to-day operations.

Key Responsibilities:

• Leadership and Team Management:
• Lead and mentor a high-performing team of software engineers, setting clear goals and fostering a culture of collaboration and innovation.
• Oversee the full software development lifecycle (SDLC) for the Enterprise Data Platform, ensuring efficient development, testing, deployment, and maintenance processes.
• Manage resource allocation, timelines, and deliverables across multiple teams working on different aspects of the platform.
• Champion engineering best practices, including coding standards, code reviews, and testing protocols, to ensure high-quality software.
• Work closely with product, operations, and business teams to align engineering efforts with business goals and technical needs.

• Platform Development & Architecture:
• Architect and design scalable, fault-tolerant, and high-performance data platforms that can process billions of records per day, leveraging AWS, Kafka, and Data Streaming technologies.
• Build and maintain a robust Java-based Full Stack solution, leveraging Spring Boot for backend services and modern JavaScript frameworks for the frontend.
• Lead the design and implementation of event-driven architecture using Kafka and streaming technologies to ensure real-time data processing capabilities.
• Ensure high availability, low latency, and seamless integration of data pipelines and microservices within the platform.
• Develop and implement strategies for data governance, security, and compliance, ensuring the platform adheres to industry standards.

• Legacy to Modern Platform Migration:
• Lead the migration from legacy data platforms to modern cloud-based infrastructures, focusing on performance optimization, scalability, and cost efficiency.
• Analyze existing platform architectures and identify bottlenecks, risks, and opportunities for optimization during the migration.
• Collaborate with senior technical and business stakeholders to define a clear roadmap and execution plan for platform modernization.
• Oversee the smooth transition from legacy systems, ensuring minimal disruption to ongoing operations while meeting business objectives.

• Collaboration with Cross-functional Teams:
• Work closely with data scientists, analysts, and business stakeholders to understand the data needs and translate them into technical solutions.
• Provide technical guidance and mentorship to the team on cloud-native development (AWS), microservices, and data streaming technologies.
• Collaborate with security and operations teams to ensure the platform is secure, scalable, and optimized for production environments.

• Continuous Improvement & Innovation:
• Evaluate and recommend new technologies, tools, and methodologies to improve platform performance, scalability, and reliability.
• Stay updated with industry trends, innovations, and best practices in data engineering, cloud computing, and software development.
• Foster a culture of continuous learning, encouraging the team to explore new approaches, tools, and technologies.

Required Skills and Qualifications:

• Bachelors or Masters Degree in Computer Science, Engineering, or a related field, or equivalent workexperience.
• At least 8+ years of hands-on experience in Java Full Stack Development, including substantial expertise with Spring Boot, Kafka, and AWS cloud technologies.
• Proven experience building high-performance data platforms capable of processing billions of records per day in real-time.
• Strong experience with microservices architecture and event-driven systems using Kafka, Apache Flink, Kinesis, or similar data streaming technologies.
• Expertise in building scalable cloud applications and services on AWS, with experience in EC2, S3, Lambda, RDS, DynamoDB, and other relevant AWS services.
• Solid understanding of database systems (SQL and NoSQL), data processing frameworks, and data pipeline orchestration (e.g., Apache Airflow).
• Experience leading large-scale legacy system migrations to cloud-based solutions, particularly in the data and enterprise application space.
• Strong leadership and team management experience, including leading cross-functional teams and mentoring engineers.
• Excellent communication and interpersonal skills, with the ability to present technical concepts to non-technical stakeholders.

Desired Skills:

• AWS Certifications (e.g., AWS Certified Solutions Architect, AWS Certified Developer) are a plus.
• Experience with containerization technologies like Docker and Kubernetes for microservices management.
• Knowledge of CI/CD pipelines, DevOps practices, and automation tools (e.g., Jenkins, Terraform, Ansible).
• Familiarity with Big Data tools and technologies such as Hadoop, Spark, or Presto is a plus.
• Experience with Agile methodologies and Scrum frameworks for software development.

Soft Skills:

• Strong problem-solving abilities and a data-driven approach to decision-making.
• Ability to navigate complex technical challenges and drive high-level strategic decisions.
• Proven track record in managing large, multi-disciplinary teams, with the ability to scale operations effectively.
• Strong analytical, organizational, and project management skills.

Why Join Us?

• Lead the transformation of a critical enterprise platform, working on cutting-edge technologies at scale.
• Opportunity to influence the future of cloud and data engineering within a fast-growing company.
• Collaborative, inclusive, and innovative company culture that encourages continuous learning and development.