Software Engineer - Data

Impact & contribution

Collaborate with Business Banking stakeholders to develop & store payments data on cloud and help the squads in building the targeted applications-based cloud based microservices.

Bringing the best design and development solutions to some of the complex problems in the data services crew and doing POC with latest tech stack and helping the squads to build the solutions with latest tech stack.

Ingest, store and publish payments data* (incl. new data/maintenance/fixes/changes)

Work with Channels and internal customers to make value-add payments data* available.

Handle NPP/High Value RTGS along with International Payments.

Roles & Responsibilities

Risk Mindset -All CommBank employees are expected to proactively identify and understand, openly discuss and act on current and future risks.

Software Data Engineer:

• To succeed in this role, you need a strong background in software engineering and a good understanding of ETL, Big data, Automation, Linux system, Snowflake and AWS.
• Data Engineer - 4-6 years.

Responsibilities:

• Have sound knowledge building data pipelines using big data tech stacks.
• Deploy, support and monitor new and existing services, platforms, and Oracle application, DB ELT data load, Big Data, Data Analysis
• Build and manage systems, infrastructure and applications through automation
• Provide performance tuning/recommendations for mission-critical platforms and infrastructure Identify, troubleshoot, and resolve issues in live production environments
• Creation and keeping up to date of efficient production run-books and SOPs
• Big data application development in Unix, Linux platform
• Hands-on experience in Spark, Scala, Hive, HDFS, Sqoop, Kafka, DevOps.
• Shell scripting and SQL database queries

Requirements: -

• Experience in building data solution in Hadoop platform, using Spark, MapReduce, Kafka and various ETL frameworks for distributed data storage and processing. Preferably hands-on experience
• Strong Unix/Linux Shell scripting and programming skills in Java, Scala or Python.
• Experience in working in Agile teams, including working closely with internal business stakeholders.
• Familiarity with data warehousing and data mart build experience in Teradata, Oracle or RDBMS system is a plus

Mandatory Skills: -

• ETL Development
• Knowledge on Data Analysis
• SQL Queries
• Any ETL tool (Informatica, BigData, Abnition etc)
• Any programming Language (Python/Scala/Java/Shell)

Good To Have: -

• Any programming Skills (Python, Java etc)
• Cloud technology: Snowflake, AWS Services
• Knowledge on Oracle
• SQL Developer
• Banking Domain

Essential Skills

• 4-7 years of experience
• ETL Development
• Knowledge on Data Analysis
• SQL Queries
• Any ETL tool (Informatica, BigData, Abinitio etc)
• Cloud technology: Snowflake, AWS Services
• Knowledge on Oracle
• SQL Developer
• Banking Domain
• Any programming Language (Python/Scala/Java/Shell)

Education Qualifications

Bachelor s degree/master s degree in engineering in Computer Science/Information Technology