Snowflake Data Engineer with ADLS

We are seeking a Snowflake Data Engineer with expertise in Azure Data Infrastructure to join our team. Candidate should have Snowflake experience with integration with ADLS experience. The role involves designing and implementing data pipelines, integrating various data sources into Snowflake, and building a scalable and secure data infrastructure. The ideal candidate should have hands-on experience with file-based and API-based integrations, data lake architecture, and a strong understanding of Azure cloud best practices.

Key Responsibilities:

1. Data Integration and Engineering

• Integrate Snowflake with diverse data flows, including file-based integrations using formats like CSV, fixed-length files, JSON, and XML
• Develop and manage API-based integrations to ingest and retrieve data into/from Snowflake
• Collaborate on integrating and managing NoSQL databases for hybrid data solutions 2. Data Lake Development
• Contribute to the design, implementation, and maintenance of the organizations data lake to enable advanced analytics and AI/ML initiatives
• Ensure seamless data ingestion, transformation, and storage workflows within the data lake environment

3. Azure Cloud Expertise

• Leverage Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Blob Storage) to build and optimize data infrastructure
• Implement best practices for data security, scalability, and cost optimization in the Azure environment
• Monitor and manage Azure resources to ensure performance and availability 4. Data Governance and Security
• Ensure data solutions comply with organizational policies and regulatory requirements o Implement robust access controls, encryption, and monitoring mechanisms to secure sensitive data

5. Collaboration and Ownership

• Work closely with cross-functional teams, including analysts, developers, and business stakeholders, to gather requirements and deliver solutions
• Take ownership of project deliverables, driving initiatives to completion with minimal supervision
• Provide regular updates on project progress and address challenges proactively Qualifications:

1. Technical Skills

• Proficiency in Snowflake, including schema design, performance optimization, and data sharing.
• Hands-on experience with file-based data integration formats (CSV, JSON, XML, fixed length)
• Experience with API-based integrations (RESTful APIs, webhooks, etc.)
• Familiarity with NoSQL databases (e.g., MongoDB, Cassandra)

Job Description: Snowflake Data Engineer with integration with ADLS experience

• Strong knowledge of Azure services, particularly Azure Data Factory, Azure Synapse, and Azure Blob Storage
• Proficient in scripting and programming languages such as Python, SQL, or Java 2. Experience:
• 3+ years of experience in Snowflake data engineering
• 2+ years of experience in Azure cloud environments
• Proven track record of designing and deploying data lakes and scalable data architectures