Data Engineer - Spark/Hadoop (5-7 yrs)

Job Title : Data Engineer

Experience : 5-7yr

Locations : Bangalore

Skills : Data Engineer, Snowflake, Python, DBT AND Spark or Hadoop AND Machine Learning.

Notice period :1 Monthly - Immediate joiner

Roles and Responsibility :

- Migration of machine learning models from Spark to Snowflake.

- Bachelor's/ master's degree in computer science, information systems, or a related- discipline and 7 years in the Data Engineer role.

- Working experience with Snowflake, Hands-on experience with Snowflake utilities, Streamlit , SnowSQL, Must have worked on Snowflake Cost optimization scenarios

- Overall solid programming skills, able to write modular, maintainable code, preferably Python & SQL

- Have experience with workflow management solutions like Airflow

- Have experience on Data transformations tools like DBT

- Built processes supporting data transformation, data structures, metadata, dependency, data quality, and workload management

- Experience working with Git

- Experience working with big data stack environment, like, Hive, Spark and Presto

- Strong analytical, problem solving and interpersonal skills

- Familiar with Scrum