Senior Data Engineer - ETL/Python (5-7 yrs)

Job Description :

We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a critical role in designing, developing, and maintaining robust data pipelines and data warehouses.

You will be responsible for extracting, transforming, and loading (ETL) large datasets, analyzing data to uncover insights, and building data products that drive business decisions.

Key Responsibilities :

1. Data Engineering :

- Design, develop, and maintain efficient and scalable data pipelines using SQL, Python, and other relevant tools.

- Extract, transform, and load large datasets from various sources, including databases, APIs, and cloud storage.

- Implement data quality checks and validation processes to ensure data accuracy and integrity.

- Optimize data pipelines for performance and cost-effectiveness.

2. Data Analysis and Visualization :

- Analyze complex datasets to identify trends, patterns, and anomalies.

- Use SQL to query and manipulate data to answer specific business questions.

- Create insightful visualizations using tools like Data Studio to communicate data-driven insights to stakeholders.

3. Data Product Development : Build and maintain data products, such as dashboards, reports, and APIs, to empower data-driven decision-making.

4. Collaboration and Communication :

- Collaborate with data analysts, data scientists, and business stakeholders to understand their data needs.

- Effectively communicate technical concepts to both technical and non-technical audiences.

- Work in a collaborative team environment to achieve project goals.

Qualifications and Experience :

- Bachelor's degree in computer science, Engineering, or a related field.

- 5+ years of experience in data engineering and data warehousing.

- Strong proficiency in SQL and Python.

- Experience with ETL processes, data quality checks, and data validation.

- Experience with BI analytics and dashboarding tools like Data Studio.

- Strong analytical and problem-solving skills.

- Excellent communication and teamwork skills.

- Ability to work independently and as part of a team.

Preferred Qualifications :

- Experience with PL/SQL, F1, and Dremel.

- Familiarity with GCP BigQuery.

- Proficiency with Jupyter Notebooks and Python.

- Experience with machine learning and AI.

- Knowledge of cloud computing concepts and best practices.

- Certification in data engineering or related certifications