Lead Software Engineer, Data platform

• Design and Develop large scale data intelligence solutions around the Snowflake Data Lake. Build ETL pipelines in and out of data warehouse using combination of Python and Snowflakes Snow SQL, Performance tuning, Compute, Storage and implement CI/CD.
• Mentor and lead team members in implementation of our advanced technology solutions for the data lake warehouse and surrounding functionality.
• Be a thought leader investigating leading edge technology for data lake warehouse software and systems functionality.
• Innovate with new approaches to meeting data management requirements.
• Partner across the company with analytics teams, architects, engineering managers to design and get consensus on solutions that meet business requirements.
• Effectively communicate and liaise with other data management teams embedded across the organization and data consumers in data science and business analytic groups.
• Utilize your experience in the following areas:
  • AWS Cloud Data practices and DevOps tooling
  • Data Warehousing, Modelling and Management
  • Data Management and Data warehousing processing capabilities
  • Metadata Repositories, Information & Data Catalogs
  • Data governance as it applies to security and privacy
  • Master Data platform capabilities
  • Data Security, Privacy, and Compliance

About You:

you're a fit for the role of Senior Snowflake Engineer if you have demonstrated expertise of 8+ years with:

• 4+ years of relevant experience in crafting Database and Data warehouse solutions in cloud (Preferably AWS).
• Solid experience in designing and implementing a fully operational production grade large scale data solution on Snowflake Cloud Data Warehouse/Lake.
• In depth experience in Data integration services which are APIs built using python, to pull data from multiple sources & Data Transformation services where they operate on the data transform and build facts and dims which can be consumed by BI tools.

Also have experience in and comfort with:

• Agile development cadence
• SQL, Data Modelling (Data Vault is a plus) and Data Warehousing fundamentals.
• Data Integration tools: DBT, Informatica, Snowpipe, etc

• AWS services and management, including Serverless, Container, Queueing and Monitoring services
• Programming languages: Python, PySpark, Java, JavaScript
• Data interchange formats: Parquet, JSON, CSV, Avro
• Software development practices such as version control via Git, CI/CD, and Release management
• Cloud security and compliance, privacy, GDPR
• Intermediate understanding of Big Data technologies.
• At least one Business Intelligence tools such as PowerBI (nice to have).
• Test Automation
• Web development: HTML, CSS, React
• Machine learning platforms, eg TensorFlow, PyTorch, Automation and Operations of machine learning (SageMaker)

What s in it For You?