80 Gcp Data Engineer Jobs

Role Description

• GCP Data Engineer Developer, being able to work independently on medium to large sized projects with strict dead-lines. Should be able to work in a cross-application, mixed-technical environment. Must demonstrate solid hands-on development track record working on an agile methodology. The role demands working along side a geographically dispersed team consisting of development and QA vendor teams, FAs and BAs.
• As a Senior Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. Key responsibilities of this role include ensuring that solutions are well architected, with maintainability and ease of testing built in from the outset, and that they can be integrated successfully into the end-to-end business process flow. They will have gained significant experience through multiple implementations and have begun to develop both depth and breadth in a number of engineering competencies. They have extensive knowledge of design and architectural patterns. They will provide engineering thought leadership within their teams, and will play a role in mentoring and coaching of less experienced engineers.

Your key responsibilities

• Hands-on software development
• Solution Design and Architecture ownership
• Work in Agile and Scrum delivery model
• Should be able to contribute towards good software design
• Strong communication with stakeholders
• Articulate issues and risks to management in timely manner
• Train other team members to bring them up to speed
• Design/Build/Enhance software components (legacy and the new version).
• Build tests (junit or automation tests).
• Take End to End responsibility from design to deployment through the environments all the way to production.
• Production Support and Troubleshooting.

Your skills and experience

• Hands on development experience on large ETL/Big Data system on public Cloud
• Hands on experience on DataFlow, CloudComposer, Cloud Storage, Data Proc etc
• Passionate about test driven development
• Proficient in Java or Python programming languages
• Basic understanding of data security on public cloud
• Basic understanding of Data Quality dimensions like Consistency, Completeness, Accuracy, Lineage etc.
• Has more than 8 years of coding experience in reputed organization
• Hands on development experience on Cloud based data intensive application
• Hands on experience on GKE, CloudRun, CloudFunctions
• Basic understanding of data security like authentication, authorization etc.
• Core java concepts such as lambdas and functional programming, streams, Generics, Concurrency
• Memory Management
• Tuning and Troubleshooting, experience with profiling and monitoring tools
• Knowledge of solution design and architecture including
• UML
• Design Patterns
• Refactoring
• Architecture decisions, quality attributes, documentation
• Experience working in Agile teams
• Experience with Messaging and integration, Patterns, REST, SOA
• Experience with build and deployment
• Maven/Artifactory/TeamCity or Jenkins
• Unix scripting and hands on experience
• Performance engineering , different types of tests, measurement, monitoring, tools
• Performance tuning and troubleshooting
• Knowledge of emerging trends and technologies
• Experience with end to end design and delivery of solutions
• RDBMS /Oracle design, development, tuning

As a GCP Data Engineer, your skills should include:

Must have:

• Operate as a team member of a Scrum Agile/Kanban team
• Design, development and peer review new functionality in various code languages
• Work as a senior developer for the various data sourcing in GCP/Hadoop
• Work as a senior developer for developing analytics algorithm on top of ingested data
• Ensuring new code is tested, both at unit level and at system levelHands on development experience on large ETL/Big Data system on public Cloud
• Hands on experience on DataFlow, CloudComposer, Cloud Storage, Data Proc etc
• Passionate about test driven development
• Proficient in Java or Python programming languages
• Basic understanding of data security on public cloud
• Basic understanding of Data Quality dimensions like Consistency, Completeness, Accuracy, Lineage etc.

Good to have:

• Knowledge gained in Financial Services environments, for example compliance, trade lifecycles, regulation, risk, financial reporting will be a plus.
• Package manager for GKE, Kubernetes/Openshift - Helm or Kubernetes native yaml.
• Able to guide junior developers in coding, designing and other development activities
• Experience with cloud technologies