Senior Data Engineer - Data Build Tool/Snowflake DB (4-8 yrs)

Position : Senior Data Engineer - DBT/Snowflake

Experience : 4 Years

Location : Chennai (On-site)

Primary Skills : DBT, Snowflake

Secondary Skills : ADF, Databricks, Python, Airflow, Fivetran, Glue

Role Responsibility :

i. Translate functional specifications and change requests into technical specifications

ii. Translate business requirement document, functional specification, and technical specification to related coding

iii. Develop efficient code with unit testing and code documentation

iv. Ensuring accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem-solving

v. Setting up the development environment and configuration of the development tools

vi. Communicate with all the project stakeholders on the project status

vii. Manage, monitor, and ensure the security and privacy of data to satisfy business needs

viii. Contribute to the automation of modules, wherever required

ix. To be proficient in written, verbal and presentation communication (English)

x. Co-ordinating with the UAT team

Role Requirement :

a) Proficient in basic and advanced SQL programming concepts (Procedures, Analytical functions etc.)

b) Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing dimensions etc.)

c) Knowledgeable in Shell / PowerShell scripting

d) Knowledgeable in relational databases, non-relational databases, data streams, and file stores

e) Knowledgeable in performance tuning and optimization

f) Experience in Data Profiling and Data validation

g) Experience in requirements gathering and documentation processes and performing unit testing

h) Understanding and Implementing QA and various testing process in the project

i) Knowledge in any BI tools will be an added advantage Sound aptitude, outstanding logical reasoning, and analytical skills

j) Willingness to learn and take initiatives

k) Ability to adapt to fast-paced Agile environment

Additional Requirement :

a. Design, develop, and maintain scalable data models and transformations using DBT in conjunction with Snowflake, ensure the effective transformation and load data from diverse sources into data warehouse or data lake.

b. Implement and manage data models in DBT, guarantee accurate data transformation and alignment with business needs.

c. Utilize DBT to convert raw, unstructured data into structured datasets, enabling efficient analysis and reporting.

d. Write and optimize SQL queries within DBT to enhance data transformation processes and improve overall performance.

e. Establish best DBT processes to improve performance, scalability, and reliability.

f. Expertise in SQL and a strong understanding of Data Warehouse concepts and Modern Data Architectures.

g. Familiarity with cloud-based platforms (e.g., AWS, Azure, GCP).

h. Migrate legacy transformation code into modular DBT data models