Data Engineer - ETL/SQL/Python (6-13 yrs)

Job Role : Data Engineer-Snowflake

Must Have Skills : pandas, python, Django, Snowflake, NumPy, AWS, communication skills

Years of experience : 6 - 13 Years

Location : Mumbai

Shift Timings : 1 PM to 10 PM

The Role :

Linedata is looking for experienced Data Engineer for assistance in developing & maintaining existing business workflows using Python, Snowflake and AWS.

Responsibilities :

1. Building, Optimizing & supporting data pipelines utilizing Python, SQL & Java Script utilizing Snowflake & AWS

2. Building & maintaining frameworks using stored procedures & Python to simplify design patterns

3. Working with DevOps team to standardize deploying python application

4. Resolving overnight batch issues escalated by offshore team

5. Perform Code review for other team members

6. Has an eye for details, adhere to software development guidelines and adopt best practices

7. Ability to work as a Individual contributor & collaborating with Global team

Skills Required :

- Good Communication, & problem-solving abilities

- Strong experience with Data Warehousing- OLTP, OLAP, Dimension, Facts, Data Modelling

- Strong experience in using boto3, pandas, NumPy, pyarrow, snowflake python connector & Snowpark

- Experience with Snowflake including SQL, Pipes, Stream, Tasks, Time Travel, Data Sharing, Query Optimization

- Experience with Scripting language in Snowflake including SQL Stored Procs, Java Script Stored Procedures & Python UDFs

- Understanding of Snowflake Internals & experience in integration with Reporting & UI applications

Advantageous Skills :

- Familiarity with building Reports using reporting tools such as Tableau

- High level understanding of ETL tools such as Informatica

- Familiarity with batch schedulers such as Active Batch

- Experience with Real time data streaming using message queues

- Experience in Python building UI interface with libraries such as Matplotlib, plotly, streamlit

- Devops experience specially utilizing Azure Devops for deploying Python applications

- Experience with scripting such as Power Shell, Unix Shell

- Experience working in financial services preferably buy side firms

Academic Requirements

- BS/MS degree in Computer Science or equivalent education

- At least 5+ years of experience