33 IT Firm Jobs
Data Engineer - Snowflake DB (5-8 yrs)
IT Firm
posted 5d ago
Job Responsibilities :
- Assist in the design and implementation of Snowflake-based analytics solution (data lake and data warehouse) on AWS
- Requirements definition, source data analysis and profiling, the logical and physical design of the data lake and data warehouse as well as the design of data integration and publication pipelines
- Develop Snowflake deployment and usage best practices
- Help educate the rest of the team members on the capabilities and limitations of Snowflake
- Build and maintain data pipelines adhering to suggested enterprise architecture principles and guidelines
- Design, build, test, and maintain data management systems
- Work in sync with internal and external team members like data architects, data scientists, data analysts to handle all sorts of technical issue
Essential Skills, Education and Experience :
- Should have a B.E. / B.Tech. / MCA or equivalent degree along with 4-7 years of experience in Data Engineering
- Strong experience in DBT concepts like Model building and configurations, incremental load strategies, macro, DBT tests.
- Strong experience in SQL
- Strong Experience in AWS
- Creation and maintenance of optimum data pipeline architecture for ingestion, processing of data
- Creation of necessary infrastructure for ETL jobs from a wide range of data sources using Talend, DBT,
S3, Snowflake.
- Experience in Data storage technologies like Amazon S3, SQL, NoSQL
- Data modeling technical awareness
- Experience in working with stakeholders working in different time zones
Good to have :
- AWS data services development experience.
- Working knowledge on using Bigdata technologies.
- Experience in collaborating data quality and data governance team.
- Exposure to reporting tools like Tableau
- Apache Airflow, Apache Kafka (nice to have)
- Payments domain knowledge
- CRM, Accounting, etc. in depth understanding
- Regulatory reporting exposure
- Act as technical leader within the team
- Working in Agile/Lean model
- Deliver quality deliverables on time
- Translating complex functional requirements into technical solutions.
Functional Areas: Software/Testing/Networking
Read full job description1-3 Yrs