Proven experience with AWS, particularly in IAM, S3 (data lifecycles, Glacier, resource policies), and EMR.
Strong knowledge and experience in managing and troubleshooting data pipelines in AWS.
In-depth understanding and experience in managing applications running in Linux operating systems.
Knowledge of EC2 (Linux), EKS with Helm charts, and ECS administration.
Knowledge of Python with experience in data handling scripting.
Deep understanding of Big Data technologies and Data Pipelines, including data lakes and data warehouses.
Understanding of management of ETL
Familiarity with Jupiter Notebook and knowledge of how it is going on.
Knowledge of MySQL.
Exposure to network/application-level security in cloud environments.
Good understanding of DNS and load balancer setup and troubleshooting.
Experience with containerization, Amazon ECS, and EKS with Helm charts.
Experience with CI/CD pipelines like GitHub Actions and/or Jenkins.
Experience with source control systems such as Git and operating in complex branching strategies.
Ability to read and understand Terraform.
Understanding of FinOps principles and cost optimization AWS tools.
Excellent written and verbal communication with a passion for solving the problem.
Confidence in your ability to own and deliver projects and issues to resolution on your own the ability to think and act globally.
Willingness to participate in the on-call rotation once a month (from Monday to Friday, from 9 am to 9 pm IST).
Willingness to work from the office at least 2 times per week.
Nice to have:
Experience with Redshift.
Exposure to AWS Bedrock, SageMaker, OpenAI, other LLM models and vector databases.
Familiarity with Apache Spark architecture and troubleshooting Java applications.
Basic understanding of Helm charts.
Familiarity with business intelligence tools (like Looker, etc.).
Responsibilities:
Work with the various components of data pipeline(s) and manage ETL jobs from end to end to meet the SLAs.
Manage AWS core (EC2, IAM, S3), big data services (EMR, Redshift, etc..), and container services ( ECS, EKS).
Deploy and manage container applications (Docker, ECS, EKS) using Helm charts.
Manage AWS infrastructure using code (Terraform, Chef, etc.).
Help application and system monitoring for better observability(logs metrics).
Support the application and infrastructure for ETL jobs and data pipelines, including participating in an on-call rotation for after-hours emergencies.
Collaborate with platform and Dev teams to plan and deploy product releases and patch Linux/ECS clusters.
Participate in design reviews, code reviews, and troubleshooting incidents.
Operate in a high-pressure environment and troubleshoot complex issues quickly while successfully handling multiple priorities.
Record, write, and review RCAs and Triage Documents.
We offer
US and EU projects based on advanced technologies.
Competitive compensation based on skills and experience.
Annual performance appraisals.
Remote-friendly culture and no micromanagement.
Personalized learning program tailored to your interests and skill development.
Bonuses for article writing, public talks, other activities.
15 PTO days, 10 national holidays.
Free webinars, meetups and conferences organized by Svitla.