AWS Infra Engineer

Role Purpose :

We are looking for an experienced AWS Infrastructure Engineer to join our data Platform team. In this role, you will be responsible for automating maintenance activities, administering and maintaining Redshift clusters, implementing CI/CD processes, and ensuring secure access management across our AWS data services ensuring efficient data storage, processing, and analysis capabilities within our cloud infrastructure.

Accountabilities :

Redshift Administration:

• Administer and maintain Redshift clusters across multiple environments, including cluster resizing, configuration management, and performance tuning.
• Implement best practices for data ingestion, distribution, and optimization within Redshift.
• Monitor Redshift cluster performance and troubleshoot issues as they arise.
• Proven ability to perform migration activities.

Cloud Infrastructure Architecture:

• Design scalable, reliable, and cost-effective AWS cloud infrastructure solutions based on business requirements.
• Architect solutions that leverage AWS services such as EC2, S3, RDS, VPC, IAM, Lambda, and others.
• Define and implement best practices for cloud architecture, including fault tolerance, high availability, and disaster recovery.

Automation and Maintenance:

• Develop and implement automation scripts and processes to streamline maintenance activities for AWS services, ensuring minimal downtime and efficient operations.
• Automate routine tasks, such as backups, patching, and scaling, to improve operational efficiency.
• Proven ability to write automation scripts in Python.

CI/CD and DevOps:

• Implement and maintain CI/CD pipelines using tools like GitLab and Jenkins for automated deployments and infrastructure provisioning.
• Collaborate with development teams to streamline the deployment process and ensure consistent and reliable releases.
• Utilize Infrastructure as Code (IaC) tools like AWS CloudFormation or Terraform to define and manage AWS resources programmatically.
• Promote DevOps practices and foster a culture of automation and continuous improvement.

Access Management and Security:

• Implement and maintain secure access management practices using AWS Identity and Access Management (IAM) services.
• Develop and enforce policies and procedures to ensure data security and compliance with industry standards and regulations.
• Implement security best practices to protect data and infrastructure assets.

Monitoring and Logging:

• Implement monitoring and logging solutions for AWS data services, ensuring visibility into system performance, resource utilization, and potential issues.
• Analyze logs and metrics to identify bottlenecks, optimize resource usage, and proactively address potential problems.
• Monitor system performance, resource utilization, and cost metrics using AWS CloudWatch and other monitoring tools like Datadog.
• Perform capacity planning and scaling to accommodate changing business needs.

Troubleshooting and Incident Response:

• Troubleshoot infrastructure-related issues and incidents and provide timely resolution.
• Conduct root cause analysis for critical incidents and implement preventive measures.
• Maintain documentation and runbooks for troubleshooting common issues and procedures.

Communication and Collaboration:

• Excellent communication skills to work on projects involving multiple verticals within the organization.
• Collaborate effectively with cross-functional teams, including data engineers, analysts, and developers.
• Provide technical guidance and mentorship to team members as needed.

Knowledge Sharing and Mentoring:

• Stay current with AWS best practices, trends, and emerging technologies.
• Share knowledge and expertise with team members through training sessions, brown bag sessions, and documentation.

Critical Knowledge Experience and Capabilities :

• 5+ years of experience in cloud computing.
• Expertise in AWS multi-account Network design (VPC, Transit Gateway, Route Table, Firewall, Route 53, Interface endpoints etc.)
• Expertise in AWS services like IAM, EC2, EKS, Lambda, RDS, S3, Secrets Manager, API Gateway, etc.
• Proven experience with AWS services, with a strong emphasis on Redshift administration and management.
• Experience in administration of MySQL, MSSQL, Postgres, DynamoDB, MongoDB and/or Elasticsearch.
• Strong understanding of AWS Well-Architected Framework and ability to access/optimize the new/existing workloads on AWS.
• Experience in setting up and managing multi-account large scale AWS environments.
• Strong background in automation, configuration management, and infrastructure-as-code practices (Terraform, AWS CloudFormation.)
• Good understanding of DevOps practices, CI/CD pipelines, version control systems (Git).
• Strong knowledge in Python for automating infrastructure tasks and scripting.
• Strong understanding of AWS Identity and Access Management (IAM) services and best
• Strong knowledge in Python for automating infrastructure tasks and scripting.
• Excellent problem-solving and troubleshooting skills.
• Strong communication and collaboration skills, with the ability to work effectively in a team environment.
• Deliver quality work in agile team environment.

Critical Leadership Capabilities :

• Strategic thinking
• Technical leadership
• Team building and Mentoring.
• Stakeholder management