AWS Engineer

We are currently seeking an experienced Data Support Engineer with a focus on AWS, Snowflake, Hadoop, Spark, and Python to join our Support team. The ideal candidate will have a solid technical background, strong problem-solving skills, and hands-on experience in troubleshooting and supporting data engineering systems.

Responsibilities Include

Hands-on experience with Hadoop, Spark with Python on AWS.
Provide technical support for data engineering systems, addressing user queries, and resolving issues related to data pipelines, AWS services, Snowflake, Hadoop, and Spark.
Investigate and troubleshoot issues in data pipelines, identifying root causes and implementing solutions to prevent recurrence.
Experience with a range of big data architectures like Hadoop,Spark,Kafka,Hive or other big data technologies.
Effectively manage and resolve incidents related to data processing, ensuring minimal downtime and optimal system performance.
Collaborate with cross-functional teams to prioritize and address critical issues promptly.
Experience in Tuning and Optimizing Spark jobs
Knowledge on Terraform templates for Infrastructure provisioning on AWS (or cloud formation templates)
Possess minimum 3+ years of in BI/DW development experience with Data Model Architecture/Design.

Should have a good understanding of functional programming concepts.
Good knowledge of Python with experience of production grade Python projects.
Continuous Integration, branching and merging, pair programming, code reviews, unit testing, agile methodologies (Scrum), Design Patterns.
Knowledge on CI/CD implementation like AWS Code Commit, Code Deploy for CI/CD pipelines (Git knowledge preferable)

Knowledge on Scheduling Tools and techniques on Hadoop/EMR.
Excellent written and verbal communication skills.
Strong analytical and project management skills.
Technical Essentials

Proven experience in providing technical support for data engineering systems.
Strong understanding of AWS services, including S3, Glue, Redshift, EMR, Lambda, Athena, and Step Functions.
Hands-on experience supporting Snowflake, Hadoop, Spark, and Python in a production environment.
Familiarity with data modeling, optimization, and performance tuning.
Excellent problem-solving skills and the ability to analyze and diagnose complex technical issues.
Experience with incident management, including prioritization and resolution procedures.

Strong communication and collaboration skills for working with cross-functional teams.
Knowledge of best practices in cloud-based data engineering and support.
Preferred:

AWS Certified Solutions Architect - Associate

Personal Specifications:
Self-motivated team player with strong analytical, relationship management with effective written and oral communication skills.