Gcp Data Engineer

Dear Candidate,

As discussed, we have an opening for a GCP Data Engineer role. Please find below job description for your reference.

Please take a moment to review the job description, which outlines the responsibility, and key skills. If you have any questions / require further clarification, please feel free to contact us.

About Company:

• LatentView Analytics is a leading global analytics and decision sciences provider, delivering solutions that help companies drive digital transformation and use data to gain a competitive advantage. With analytics solutions that provide a 360-degree view of the digital consumer, fuel machine learning capabilities, and support artificial intelligence.
• We specialize in Predictive Modelling, Marketing Analytics, Big Data Analytics, Advanced Analytics, Web Analytics, Data Science, Data Engineering, Artificial Intelligence and Machine Learning Applications.
• LatentView Analytics is a trusted partner to enterprises worldwide, including more than two dozen Fortune 500 companies in the retail, CPG, financial, technology and healthcare sectors.

Job Summary:

We are seeking a Lead GCP Data Engineer with experience in data modeling and building data pipelines. The ideal candidate should have hands-on experience with GCP services such as Composer, GCS, GBQ, Dataflow, Dataproc, and Pub/Sub. Additionally, the candidate should have a proven track record in designing data solutions, covering everything from data integration to end-to-end storage in bigquery.

Responsibilities:

• Collaborate with Client's Data Architect: Work closely with client data architects and technical teams to design and develop customized data solutions that meet business requirements.
• Design Data Flows: Architect and implement data flows that ensure seamless data movement from source systems to target systems, facilitating real-time or batch data ingestion, processing, and transformation.
• Data Integration & ETL Processes: Design and manage ETL processes, ensuring the efficient integration of diverse data sources and high-quality data pipelines.
• Build Data Products in GBQ: Work on building data products using Google BigQuery (GBQ), designing data models and ensuring data is structured and optimized for analysis.
• Stakeholder Interaction: Regularly engage with business stakeholders to gather data requirements and translate them into technical specifications, building solutions that align with business needs.
• Ensure Data Quality & Security: Implement best practices in data governance, security, and compliance for both storage and processing of sensitive data.
• Continuous Improvement: Evaluate and recommend new technologies and tools to improve data architecture, performance, and scalability.

Skills:

• 6+ years of development experience
• 4+ years of experience with SQL, Python
• 2+ GCP BigQuery, DataFlow, GCS, Postgres
• 3+ years of experience building out data pipelines from scratch in a highly distributed and fault-tolerant manner.
• Experience with Cloud SQL, Cloud Functions and Pub/Sub, Cloud Composer etc.,
• Familiarity with big data and machine learning tools and platforms. Comfortable with open-source technologies including Apache Spark, Hadoop, Kafka.
• Comfortable with a broad array of relational and non-relational databases.
• Proven track record of building applications in a data-focused role (Cloud and Traditional Data Warehouse)
• Current or previous experience leading a team.

We are an equal opportunity employer and value diversity at our company. We do not discriminate based on race, religion, colour, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status.