Data Engineer ( ETL, Big Data, Hadoop, Spark, GCP )

Role Description
Senior Engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals.

Awareness is expected of the important engineering principles of the Bank. Root cause analysis skills, developed through addressing enhancements and fixes to products. Build reliability and resiliency into solutions through early testing, peer reviews and automating the delivery lifecycle.

Successful candidate should be able to work independently on medium to large sized projects with strict deadlines.

Should be able to work in a cross-application, mixed-technical environment and must demonstrate solid hands-on development track record while working on an agile methodology. The role demands working along-side a geographically dispersed team.

The position is required as part of the build out of AFC Tech internal development team in India.

The overall team will primarily deliver improvements in anti-financial crime capabilities that are major components of the regulatory portfolio, addressing various regulatory commitments to mandated monitors.

Your key responsibilities

• Analysing data sets and designing and coding stable and scalable data ingestion workflows, also integrating into existing workflows.
• Working with team members and stakeholders to clarify requirements and provide the appropriate ETL solution.
• Work as a senior developer for developing analytics algorithm on top of ingested data.
• Work as a senior developer for various data sourcing in Hadoop, also GCP.
• Own unit-testing, UAT deployment, End-User sign-off & Prod Go-Live.
• Ensuring new code is tested, both at unit level and at system level.
• Design, develop and peer review new code/functionality.
• Operate as a team member of an Agile Scrum team.

Your Skills & Experience

• More than 8 years of coding experience in reputed organizations.
• Hands on experience on BitBucket & Jenkins actions.
• Proficient in Hadoop, Python, Spark, SQL, Unix, Pentaho, Hive.
• Basic understanding of On-Prem, Edge & GCP data security.
• Hands on development experience on large ETL/Big Data systems, GCP being a big plus.
• Hands on experience on CloudBuild, ArtifactRegistry, CloudDNS, CloudLoadBalancing etc.
• Hands on experience on DataFlow, CloudComposer, Cloud Storage, Data Proc etc.
• Basic understanding of Data Quality dimensions like Consistency, Completeness, Accuracy, Lineage etc.
• Hands on business and systems knowledge gained in a regulatory delivery environment.
• Banking experience, regulatory and cross-product knowledge.
• Passionate about test driven development.
• Data visualisation experience in Tableau.