Data Engineer - Python/SQL (3-7 yrs)

Overview :

The GCP Data Engineer plays a critical role in our data-driven decision-making process by designing, implementing, and maintaining robust data architectures on Google Cloud Platform (GCP).

The primary focus of this position is to develop efficient and scalable data workflows that support advanced analytics and machine learning initiatives. By leveraging skills in Python and SQL, the Data Engineer will collaborate with various cross-functional teams to derive actionable insights from diverse data sources.

This role is essential for ensuring the reliability, accessibility, and integrity of our data, enabling our organization to harness the full potential of its data assets.

As a GCP Data Engineer, you will have the opportunity to work with cutting-edge technologies while driving innovation and enhancing our data capabilities.

Key Responsibilities :

- Design and implement data pipelines to ingest and process large volumes of structured and unstructured data.

- Develop ETL processes to transform raw data into actionable insights.

- Create and maintain scalable data models that meet analytical and business requirements.

- Utilize BigQuery for performing data analysis and optimizing query performance.

- Collaborate with data scientists to prepare data for advanced analytics and machine learning.

- Monitor and troubleshoot data ingestion processes to ensure data accuracy and reliability.

- Work with cloud solutions and services on Google Cloud Platform (GCP).

- Actively participate in code reviews and maintain best practices for data engineering.

- Implement data governance and data quality frameworks.

- Optimize data storage and compute costs on GCP.

- Document data workflows and architectures for future reference.

- Implement data security measures to protect sensitive information.

- Collaborate with stakeholders to understand data needs and develop solutions.

- Stay up-to-date with industry trends and emerging technologies in data engineering.

- Provide technical support and mentoring to junior data engineers.

Required Qualifications :

- Bachelor's degree in Computer Science, Data Science, or a related field.

- 3+ years of experience in data engineering or a similar role.

- Proficiency in Python and SQL for data manipulation and analysis.

- Hands-on experience with GCP and its data services (BigQuery, Dataflow, etc.

- Strong understanding of data warehousing concepts and architectures.

- Experience with ETL tools and data integration techniques.

- Familiarity with version control systems (e.g. , Git).

- Knowledge of data visualization tools (e.g. , Tableau, Looker) is a plus.

- Previous experience with data modeling and database design.

- Excellent problem-solving skills and attention to detail.

- Ability to work in a fast-paced and dynamic environment.

- Strong communication skills to present complex information clearly.

- Experience with Agile methodologies is an advantage.

- Ability to work collaboratively in cross-functional teams.

- Knowledge of machine learning concepts is beneficial.