Senior Data Engineer

Role & responsibilities

• Assume ownership of Data Engineering projects from inception to completion.

• Implement fully operational Unified Data Platform solutions in production environments using technologies like Databricks, Snowflake, Azure Synapse etc.
• Showcase proficiency in Data Modelling and Data Architecture
• Utilize modern data transformation tools such as DBT (Data Build Tool) to streamline and automate data pipelines (nice to have).
• Implement DevOps practices for continuous integration and deployment (CI/CD) to ensure robust and scalable data solutions (nice to have).
• Maintain code versioning and collaborate effectively within a version-controlled environment.
• Familiarity with Data Ingestion & Orchestration tools such as Azure Data Factory, Azure Synapse, AWS Glue etc.
• Set up processes for data management, templatized analytical modules/deliverables. Continuously improve processes with focus on automation and partner with different teams to develop system capability.
• Proactively seek opportunities to help and mentor team members by sharing knowledge and expanding skills.
• Ability to communicate effectively with internal and external stakeholders.
• Coordinating with cross-functional team members to make sure high quality in deliverables with no impact on timelines

Preferred candidate profile

• Expertise in computer programming languages such as: Python and Advance SQL

• Should have working knowledge of Data Warehousing, Data Marts and Business Intelligence with hands-on experience implementing fully operational data warehouse solutions in production environments.

• 3+ years of Working Knowledge of Big data tools (Hive, Spark) along with ETL tools and cloud platforms.

• 3+ years of relevant experience in either Snowflake or Databricks. Certification in Snowflake or Databricks would be highly recommended.

• Proficient in Data Modelling and ELT techniques.

• Experienced with any of the ETL/Data Pipeline Orchestration tools such as Azure Data Factory, AWS Glue, Azure Synapse, Airflow etc.

• Experience working with ingesting data from different data sources such as RDBMS, ERP Systems, APIs etc.

• Knowledge of modern data transformation tools, particularly DBT (Data Build Tool), for streamlined and automated data pipelines (nice to have).

• Experience in implementing DevOps practices for CI/CD to ensure robust and scalable data solutions (nice to have).

• Proficient in maintaining code versioning and effective collaboration within a version controlled environment.

• Ability to work effectively as an individual contributor and in small teams. Should have experience mentoring junior team members.

• Excellent problem-solving and troubleshooting ability with experience of supporting and working with cross functional teams in a dynamic environment.

• Strong verbal and written communication skills with ability to communicate effectively, articulate results and issues to internal and client team.