Paytm - Senior Data DevOps Engineer - Cloud Infrastructure (3-6 yrs)

About the Role :

We are looking for a Senior Data DevOps Engineer to manage and optimize data pipelines, databases, and cloud infrastructure. The ideal candidate will ensure smooth data flow, handle deployments, and improve system reliability.

Key Responsibilities :

- Manage and maintain data pipelines and cloud infrastructure.

- Automate deployment, monitoring, and scaling of data platforms.

- Work with development teams to ensure smooth integration and delivery of data services.

- Troubleshoot database and system issues to minimize downtime.

- Implement best practices for security, backups, and disaster recovery.

- Optimize performance of data storage and retrieval systems.

- Monitor system health and handle incidents proactively.

- Collaborate with DevOps and data engineering teams for continuous improvements.

Required Skills :

- Infrastructure Management: Design, implement, and maintain scalable, reliable, and secure infrastructure on AWS

- Strong practical knowledge of managing AWS Infrastructure, especially EC2, Load Balancers, CloudFront, ElasticCache, EBS, S3, IAM, CloudWatch, Auto Scaling, Lambda, etc.

- Good experience in security compliance, including OS upgrades, patching, and kernel optimization

- Hands-on experience with Kubernetes, Docker, and Terraform.

- Experience with Big Data technologies such as Hive HMS and Apache Ranger.

- Familiarity with network topologies and common network protocols and services (DNS, HTTP(S), SSH, FTP, SMTP)

- Proficiency in managing databases (MySQL).

- Experience with CI/CD pipelines and automation tools (Jenkins/ArgoCD, GitLab,Airflow).

- Scripting knowledge (Python, Shell, etc.).

- Strong understanding of data processing tools (Spark, Kafka,Flink etc.).

- Knowledge of monitoring tools (Prometheus, Grafana).

- Good problem-solving skills and ability to work independently.

Nice to Have :

- Experience with big data tools like Hadoop .

- Familiarity with machine learning model deployment.

- Knowledge of data security and compliance.