Sr. Data Engineer Snowflake & Azure

About tsworks:

tsworks is a leading technology innovator, providing transformative products and services designed for the digital-first world. Our mission is to provide domain expertise, innovative solutions, and thought leadership to drive exceptional user and customer experiences. Demonstrating this commitment , we have a proven track record of championing digital transformation for industries such as Banking, Travel and Hospitality, and Retail (including ecommerce and omnichannel), as well as Distribution and Supply Chain, delivering impactful solutions that drive efficiency and growth. We take pride in fostering a workplace where your skills, ideas, and attitude shape meaningful customer engagements

About This Role

We are seeking an experienced, driven and motivated Sr. Data Engineer to design and deliver robust data environment for our clients and internal applications. The ideal candidate will have strong hands-on experience with Data Engineering patterns on Azure Cloud, Data Lake House Architecture using Azure and Snowflake, dimensional modelling, data governance and providing data to support business intelligence and analytics with large data ecosystems.

We prefer candidates with Snowflake, Azure and Fabric Certifications.

Mandatory Required Qualification

• Strong proficiency in Azure data services such as Azure Data Lake Storage Gen 2, Azure Data Factory, Azure Databricks, Fabric Analytics, Azure EventHub, Azure Function App etc.
• Strong hands-on experience building Data Lake-House solutions on Snowflake, and using features such as streams, tasks, dynamic tables, data masking, data exchange etc.
• Hands-on experience using scheduling and orchestration tools such as Apache Airflow, DBT and data governance products such as Collibra
• Expertise in DevOps and CI/CD implementation
• Excellent Communication Skills

In This Role, You Will

• Design, implement, and manage scalable and efficient data architecture on the Azure cloud platform.
• Develop and maintain data pipelines for efficient data extraction, transformation, and loading (ETL) processes.
• Perform complex data transformations and processing using PySpark (Azure Fabric or Databricks), Snowflake's data processing capabilities, or other relevant tools.
• Hands-on experience working with Data Lake solutions such as Apache Hudi, Delta Lake or Iceberg.
• Develop and maintain data models within Snowflake and related tools to support reporting, analytics, and business intelligence needs.
• Collaborate with cross-functional teams to understand data requirements and design appropriate data integration solutions.
• Integrate data from various sources, both internal and external, ensuring data quality and consistency.
• Ensure data models are designed for scalability, reusability, and flexibility.
• Implement data quality checks, validations, and monitoring processes to ensure data accuracy and integrity across Azure and Snowflake environments.
• Adhere to data governance standards and best practices to maintain data security and compliance.
• Handling performance optimization in Azure and Snowflake platforms
• Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver actionable insights.
• Provide guidance and mentorship to junior team members to enhance their technical skills.
• Maintain comprehensive documentation for data pipelines, processes, and architecture within both Azure and Snowflake environments including best practices, standards, and procedures.

Skills & Knowledge

• Bachelor's degree in computer science, Engineering, or a related field.
• 10 + Years of experience in Information Technology, designing, developing and executing solutions.
• 4+ Years of hands-on experience in designing and executing data solutions on Azure and Snowflake cloud platforms as a Data Engineer.
• In-depth knowledge of Microsoft Azure and Fabric platforms and their data services.
• Strong proficiency in PySpark with Fabric or Databricks, with file formats such as Parquet and Avro.
• Proficient in using different features of Snowflake such as Snowpipe Streaming, Streams and Tasks, managing different virtual warehouses and ensuring cost optimization, Notebooks, Native Applications, Streamlit, Data Exchange etc.
• Proficiency using Relational and NoSQL databases.
• Hands-on experience on with streaming technologies such as Kafka and Flink.
• Strong understanding of data warehousing, data lakes, and data integration paradigms such as the Medallion Architecture.
• Knowledge of data quality, governance, and security best practices.
• Knowledge of data modeling and data governance using Snowflake and external tools such as Collibra or Microsoft Purview.
• Hands-on experience with Snowflake Cortex AI features.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Knowledge of data security and compliance standards.
• Hands-on experience working in an agile setting.
• Self - driven, naturally curious, and able to adapt to a fast-paced work environment.
• Be able to articulate, create, and maintain technical and non-technical documentation.
• Certifications such as Snow Pro Core, Microsoft Certified Azure Data Engineer or Microsoft Certified Fabric Data Engineer is a preferred.

Location: