Data Engineer

Organization: At CommBank, we never lose sight of the role we play in other people s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.

Job Title: Data Engineer

Location: Bangalore

Impact & Contribution:

You will play a pivotal role in driving business outcomes through effective data management and analysis.

• Enhancing Decision Making with Data
• Ensuring Data Security and Compliance
• Future Trends in Data Engineering

Roles & Responsibilities:

• Develop highly reliable data pipelines and data platforms with comprehensive test coverage with limited supervision.
• Contribute to the technical design for system enhancements.
• Apply deployment mechanisms for CI/CD pipelines and Release Management on data platforms.
• Provide technical assistance to other members of the team.
• Participate actively in peer reviews.
• Identify and drive opportunities for continuous improvement within the team and in delivery of products.
• Produce high quality, sustainable solutions to meet business requirements, leveraging approved delivery frameworks and by applying industry best practice.
• Collaborate with stakeholders to ensure that solutions are robust, secure and highly available.
• Complete data engineering duties aligned to core concepts of data design, preparation, transformation, and load.
• Build data pipelines in distributed data platforms including warehouses, databases, data lakes and cloud lakehouses to enable data predictions and models, and reporting and visualisation analysis via data integration tools and frameworks.

Essential Skills:

• 4-5 years of relevant experience
• Experience in Abinitio, Bigdata, Hadoop, Spark SQL, Hive, ETL, Data warehouse and Database knowledge.
• Strong exposure to Pyspark

Education Qualifications:

• Bachelor s degree in Engineering in Computer Science/Information Technology