DevOps Engineer - Confluent Kafka (9-13 yrs)

Job Description :

Roles & Responsibilities :

- Your role will focus on leading the development efforts of the Kafka-as-a-Service platform on top of Confluent Cloud.

- You will help drive technical decision-making, particularly regarding operations and the platform's architectural direction.

- You'll help solve problems related to building a global Kafka architecture considering scalability, replication, schema registries and self-service IaC workflows to solve for different use cases such as high traffic telemetry (logs & metrics), business critical events and data processing.

- As an expert in your area, you will help set the tone for how your team operates.

- You'll emphasize modern, rigorous software development practices that emphasize testability, repeatability, and self-service automation.

- You'll conduct code reviews and mentor more junior developers.

- You'll openly collaborate with other teams' leads and help raise the bar of engineering excellence across the entire organization.

What to Bring :

- Bachelor's degree with 9 - 13 years of experience as a software developer.

- You bring passion and enthusiasm to your engineering team.

- You have a track record of shipping quality code to production on a frequent and consistent -basis.

- You thrive under minimal supervision with the ability to self-motivate and self-organize within the organizational structure.

- You have experience running production infrastructure that supports multiple systems in a scalable, stable, and performant manner.

- You measure everything, make decisions based on data, are consumer-obsessed, and take immense pride in your work.

The ideal candidate for this role will have a wide breadth of experience across the entire software stack, as well as deep subject matter expertise in at least one technology from each of the following groups :

- Operating Kafka at scale (we use Confluent Cloud).

- Cloud Infrastructure Automation (AWS strongly preferred with Terraform).

- Database design (e. Postgres, NoSQL, etc).

- Data Processing (e. Hadoop, Big Table, Spark, Redshift).

Software Development :

- Distributed Systems Development (e. asynchronous communication patterns, consensus algorithms, distributed transactions).

- Programming (e. Go-lang, Java, Kotlin, Scala, Python, Ruby).

- Event Driven Architecture & Streaming Frameworks (e. Kafka Streams).

Your Technical Know-How :

In addition, your technical expertise should match well to the following :

- Experience leading the development of large-scale projects, e.breaking down tasks, delegating work, assisting in the creation of roadmaps and work back plans.

- Deep understanding of distributed systems in Kubernetes.

- Hands-on experience with multiple IaC tools.

- Experience with some of the frameworks and tools our development teams use day to day (i.e Spring Boot, Kafka Streams).

- Experience with the development and operation of high throughput, low-latency systems.

- Hands-on experience with automating development workflow pipelines (CI/CD).

- Operational experience (i.on-call rotation, incident response).

- Ability to collaborate effectively with remote peers across disparate geographies and time zones.

- Excellent written and verbal communication skills with particular emphasis on technical documentation (including diagramming).

- Strong CS fundamentals