Lead Software Engineer

As a Google Cloud Platform (GCP) Data Engineer who will bedesigning and building systems to collect, transform, and publish data using the Google Cloud Platform.An engineer who can use their knowledge of data storage technologies and frameworks to create data pipelines and meet business needs.

Roles and Responsibilities GCP Data Engineer

Some of the most important roles and responsibilities of a Google Data Engineer include:

• Working with large datasets and solving difficult analytical problems is a primary task of a Google data engineer.
• Designing, building, operationalizing, securing, and monitoring data processing systems on Google Cloud Platform.
• Developing comprehensive abilities for Google data structures and matrix for upcoming product development and sales activities is also a crucial task for Google data engineers.
• Conducting end-to-end analyses, including data collection, processing, and analysis.
• Building prototype analysis & reliable pipelines to generate insights after combining data sources.
• Deploying, leveraging, and continually training and improving existing machine learning models.
• Meeting business objectives in collaboration with Data Scientist teams and key stakeholders.
• Finding trends in data sets and developing an algorithm to make raw data more useful across teams.
• Designing data stores and distributed systems.
• Automating manual processes to enhance delivery.
• Identifying, designing, and implementing internal process movements.
• Knowledge in fundamentals of Docker & GKE.

Technical skills:

• A solid grip overthe programming languages like Python, Java/Scala, C++, etc.
• Knowledge of how to maintain ETLs operating on a variety of structured and unstructured sources.
• In-depth knowledge about SQL databases and ability to execute queries quickly.
• Knowledge of Data Warehousing, Data Modelling, Data Structures & Algorithms.
• Understanding of UNIX and GNU/Linux systems.
• Fundamentals of Kafka to handle real-time data feeds.
• Understanding of how to use Kafka with Hadoop.

Soft skills:

You also need to possess exceptional communication and comprehensive abilities. Furthermore, your analytical skills are also paramount for this job. Some of the key soft skills required are:

• Adaptability
• Critical thinking
• Proactiveness & Decision-making
• Observational skills