Data engineer -Apache Spark, PySpark, Python / Senior Data Engineer

Requirements:

• Must Have Skills: Proficiency in Apache Spark, PySpark, Python.
• Events/stream processing framework development, engineering tooling and user-facing interfaces, Kubernetes administration
• Experience with data visualization tools such as Tableau or Power BI.
• Strong experience with DBT (Data Built Tool)
• At least 2 years implementing solutions using AWS services such as Lambda, AWS Athena and Glue AWS S3, Redshift, Kinesis, Lambda, Apache Spark.
• Experience in other ETL tools & RDBMS / SQL.
• Strong Experience in AWS.
• Experience in deployment using Docker.
• Hands-on experience with RESTAPI Concepts.

Responsibilities:

• As a Data Engineer, you will be responsible for implementing complex data pipelines and analytic solutions to support key decision-making business processes in our client's domain.
• Collaboratively work with Developers & Data Scientists to implement and integrate machine learning algorithms.
• Experience working with data warehousing data lakes or Lakehouse concepts on AWS
• Maintain data quality for supporting real time decision systems and AI needs
• Ability to engage with client stakeholders effectively