Senior Devops Engineer

Location- Gurgaon/Hyderabad

Work from Office

Responsibilities:

• Implement and Manage Infrastructure: Design and manage scalable and reliable On-premise as well as cloud infrastructure (likely AWS, Azure) to support the Kafka, Flink, Iceberg, OpenSearch, and Trino.
• CI/CD Pipeline Automation: Develop and maintain robust CI/CD pipelines to automate the building, testing, and deployment of the platform's software components, ensuring rapid and reliable delivery.
• Configuration Management and Infrastructure as Code (IaC): Utilize configuration management tools (e.g., Ansible, Helm Charts) and IaC practices to automate the provisioning and management of infrastructure, ensuring consistency and repeatability.
• Software Packaging and Installers: Creating distributable software packages, installable/upgradable on bare metal servers, private and public cloud environments.
• Monitoring and Logging: Implement comprehensive monitoring and logging solutions to track the platform's performance, identify issues, and ensure high availability. Utilize tools like Prometheus, Grafana, and ELK stack for real-time insights and troubleshooting.
• Performance Optimization and Scalability: Continuously optimize the platform's performance and scalability to handle real-time and historical data workloads efficiently. Address bottlenecks and implement strategies for horizontal and vertical scaling.
• Security and Compliance: Implement security best practices and ensure compliance with industry standards to protect the platform and its data. Manage access controls, encryption, and vulnerability management.
• Collaboration and Knowledge Sharing: Work closely with development and data engineering teams to align infrastructure with platform requirements. Share knowledge and best practices within the team and contribute to the platform's documentation.
• Troubleshooting and Incident Response: Provide timely support for troubleshooting and resolving issues in production and development environments. Participate in on-call rotations and incident response to minimize downtime.

Qualifications:

• Data Streaming and Processing: Hands-on experience of setting up and scaling data streaming platforms (Kafka) and data processing frameworks (Flink, Spark).
• Hands-on Experience of Data Lakehouse Technologies: Hands-on experience with Iceberg, Delta Lake, or Hudi and query engines like Apache Trino.
• Database and Storage: Familiarity with SQL and NoSQL databases, as well as storage technologies like object storage like Ceph and data lakehouses.
• Strong Problem-Solving Skills: Ability to analyze and troubleshoot complex issues in distributed systems.
• Strong On-prem Cloud Experience: Extensive experience with On-Prem and private cloud platforms as well as public cloud (AWS, Azure) and their services for data processing and storage.
• Containerization and Orchestration: Proficiency in containerization technologies (Docker) and container orchestration platforms (Kubernetes).
• CI/CD Expertise: Hands-on experience with CI/CD tools (Jenkins, GitLab CI/CD, CircleCI) and building automated pipelines.
• Configuration Management and IaC: Experience with configuration management tools (Ansible, Chef, Puppet) and IaC and cloud native practices for private and public clouds.
• Monitoring and Logging: Familiarity with monitoring and logging tools (Prometheus, Grafana, ELK stack) and implementing observability practices.
• Scripting and Automation: Strong scripting skills (Bash, Python) and experience with automation tools to streamline operational tasks.
• Excellent Communication and Collaboration: Ability to work effectively in a team environment and communicate technical concepts clearly.

If you think you can be a right fit for the role, please share your resume along with below details at tanvi.bhayana@kellton.com

• Total Experience:
• Current CTC:
• Expected CTC:
• Notice Period:
• Current Location:
• Preferred Location (Gurgaon/Hyderabad)
• Any Offer in Hand: