ETL Developer - SQL/Python/BigQuery (3-12 yrs)

Roles/Responsibilities (Candidate's responsibilities) :

- Experience in Google BigQuery (Including BQ query standards, partitioning/clustering, data-model)

- Python Programming Expert

- SQL knowledge

- Preferred: Experience in Ascend tool

- Create Data flow, Data service, Read and Write connections for various sources

- Set up failure notifications (Ascend Webhook notification, Scheduling in Ascend)

- Perform BigQuery merge operations

- Create custom Read and Write connectors using Python framework

- Good understanding of error logging

- Experience in Airflow (Create DAGs, configure variables, scheduling)

- Worked in DevSecOps (CI/CD) environment

- Data testing strategy

- Data Quality - Technical and business quality checks

- Interact with platform leads and third-party application leads to understand and analyze various interfaces and data integration needs to create technical user stories

- Contribute to the creation of technical design and estimation for user stories, and review with the EAC team and Product Owner

- Conduct and participate in code review sessions for team deliverables

- Guide team members and involve in development and unit testing

- Work with business users for UAT and assist QA team with defect fixing

- Help troubleshoot critical issues in development, staging, or production environments

Required Skill Set :

- Data Integration and Data Warehouse experience, Ascend or any ETL tool, Google BigQuery, Python, SQL, Cloud Composer (Airflow DAG), and any Data Quality check tool or custom knowledge

Optional Skillset : DBT, Collibra