Position Overview: We are seeking a highly skilled and experienced Senior DevOps Engineer to join our team. The ideal candidate will have extensive expertise in managing AWS infrastructure using Terraform, designing and managing Azure CI/CD pipelines for Snowflake, DBT, Control M, Matillion and automating workflows across various platforms. You will play a crucial role in streamlining our development processes, optimizing infrastructure, and enabling seamless deployment of applications and data solutions.
Key Responsibilities: 1. AWS Infrastructure Management - Design, deploy, maintain scalable, secure, and highly available AWS infrastructure using Terraform. - Implement best practices for AWS cost optimization, security, and monitoring. - Troubleshoot and resolve infrastructure-related issues efficiently. - Good understanding of AWS key concepts [S3, Lamda, Policies, Role, Access Keys, Agents etc ]
2. Azure CI/CD Pipelines - Build and manage Azure CI/CD pipelines for Snowflake and other data platforms. - Collaborate with data teams to integrate DBT (Data Build Tool) and other tools into pipelines. - Automate testing, deployment, and monitoring of data workflows to ensure reliability.
3. Automation and Optimization - Identify opportunities for automation across infrastructure, CI/CD processes, and data workflows. - Develop scripts and tools to automate repetitive tasks and enhance operational efficiency. - Establish infrastructure-as-code standards and ensure compliance across teams.
4. Collaboration and Support - Work closely with development, data engineering, and operations teams to align DevOps practices with business goals. - Provide technical guidance and mentorship to junior DevOps team members. - Ensure smooth coordination between teams during project planning and execution phases.
5. Monitoring and Security - Implement and manage monitoring tools to ensure system uptime and performance. - Enforce security protocols and compliance requirements across cloud and data infrastructures.
Qualifications: - Education: Bachelor's or Master’s degree in Computer Science, Engineering, or a related field. - Experience: 5+ years in a DevOps role, with demonstrated expertise in: - Managing AWS infrastructure using Terraform. - Designing and implementing Azure CI/CD pipelines, especially for Snowflake and DBT. - Automation of workflows and infrastructure processes.
Technical Skills: - Proficiency in AWS services (EC2, S3, RDS, Lambda, etc.) and Terraform. - Hands-on experience with Azure DevOps and building pipelines for data platforms like Snowflake. - Strong knowledge of DBT, SQL, and data workflows. - Expertise in scripting languages (Python, Bash, or similar) for automation. - Familiarity with monitoring tools (e.g., Prometheus, CloudWatch, or Grafana). - Knowledge of security frameworks and tools for cloud environments.
Soft Skills: - Strong problem-solving and troubleshooting abilities. - Excellent communication and collaboration skills. - Ability to manage multiple tasks and projects in a dynamic environment.
Preferred Qualifications: - Certifications: AWS Certified Solutions Architect or Azure DevOps Engineer. - Experience with Kubernetes, Docker, and container orchestration. - Familiarity with GitOps principles and tools like ArgoCD.