Database Developer (kafka)

Key Responsibilities

Database Management:

• Design, optimize, and maintain relational and NoSQL databases.
• Ensure database performance, reliability, and scalability.
• Implement data migration and replication strategies.

Kafka Ecosystem:

• Configure, deploy, and manage Kafka Connect plugins for real-time data streaming.
• Implement CDC (Change Data Capture) solutions using Debezium.
• Monitor and troubleshoot Kafka clusters to ensure optimal performance.

Strimzi Integration:

• Deploy and manage Kafka clusters on Kubernetes using Strimzi.
• Implement security, scalability, and high availability in Strimzi-managed Kafka clusters.
• Create and manage Helm charts and custom Kubernetes operators as needed.

System Integration & Development:

• Develop and maintain APIs and microservices for backend functionality.
• Collaborate with frontend teams to integrate APIs and data streams.
• Write efficient, reusable, and scalable code.

Monitoring & Troubleshooting:

• Set up monitoring tools for Kafka, Debezium, and databases.
• Diagnose and resolve production issues in a timely manner.
• Optimize end-to-end data pipelines for minimal latency and high throughput.

Collaboration:

• Work closely with DevOps, Data Engineering, and Product teams.
• Participate in code reviews, architecture discussions, and sprint planning.

We are looking for candidates with a proven performance track record with the following:

Required Qualifications:

Education: Bachelors or Master’s degree in Computer Science, Engineering, or a related field.

Experience: Minimum of 10+ years of experience in application architecture and software development.

Technical Skills:

• Databases: Proficiency in MySQL, PostgreSQL, MongoDB, or similar databases.
• Kafka Ecosystem: Deep understanding of Kafka, Kafka Connect, and related tools.
• CDC Tools: Hands-on experience with Debezium for change data capture.
• Kubernetes: Familiarity with Kubernetes and experience managing Kafka using Strimzi.
• Programming Languages: Strong coding skills in Java, Python, Go, or similar.
• API Development: Expertise in RESTful and/or GraphQL APIs.
• DevOps Tools: Knowledge of CI/CD pipelines, Docker, Helm, and monitoring tools like Prometheus and Grafana.

Soft Skills:

• Excellent problem-solving and analytical skills.
• Strong communication and interpersonal skills.
• Ability to work effectively in a team-oriented environment.
• Demonstrated ability to lead and mentor junior engineers.