Data Engineer

• Support Data warehouse Engineering in the architecture, development, and employment of MS SQL Database on LUW in high SLA environments.
• Solid understanding on data model for facts and dimensions. Ability to provide logical and physical design for the given business requirements.
• Design scalable data warehouse solution using SQL Server and Hadoop.
• Engage in proof of concepts on new SQL Server features and advocate the business benefits to the leadership team.
• Provide data warehouse engineering for off the shelf and external merchant facing applications.
• Implementation of databases, storage structures, high-availability solutions, replication, encryption, and disaster recovery solutions.
• Follow the industry best practice in writing TSQL code and unit test cases.
• Proactive performance analysis, troubleshooting and resolution of database issues.
• Work very closely with the application team and DBA team to ensure delivery of database services within the SLAs and performance target set.
• Integrate the DWH code with the Redgate for the automated deployment.
• Support P1/P2 database issues which impacts the customer applications.
• Manage, support, and maintain database technology and infrastructure, adhering to the architectural guidelines and policies.
• Address vulnerabilities and TSR findings reported by the DBA team.
• Ability to work well as a team and as an individual with minimal supervision.

Basic Qualifications
Bachelors degree, OR 3+ years of relevant work experience

Preferred Qualifications
2+ years of work experience with a Bachelor s Degree or Masters Degree in computer / information science with relevant work experience in IT industry
Enthusiastic, energetic and self-learning candidates with loads of curiosity and flexibility.
Proven hands-on capability on development of data pipelines / Data engineering.
Basic level Experience in creating data driven business solutions and solving data problems using a wide variety of technologies such as Hadoop, Hive, Spark, MongoDB, NoSQL, as well as traditional data technologies (RDBMS).
Experience / knowledge developing large scale, enterprise class distributed pipelines that require high availability, low latency & strong data consistency computing is desirable
Ability to program in one or more scripting languages such as Python and one or more programming languages such as Java or Scala
Design and development skills with Big Data technologies like Hadoop, Spark, Hive.
Experience with Continuous Integration and Automated Test tools such as Jenkins, Artifactory, Git desirable
Demonstrated knowledge in POCs and prototypes using Gen AI / ML is an advantage.
Extensive experience in implementing SQL Server 2017, SQL 2019, and MySQL 8.0 features.
Experience in writing complex SQL queries is required.
Hands on experience in Wherescape RED or equivalent ETL tool.
Experience in providing data analysis and data validation is required
Experience in scripting, scheduling and version control technologies is required
Good understanding of the high availability and disaster recovery options. Expert in SQL Server native replication.
Experience with tools development, automation (CI/CD, Auto Deployment with Redgate, System Availability, etc).
Extended experience in Agile Release Management practices, governance, and planning.
Ability to quickly identify and manage/mitigate risks.
Ability to influence Senior Leadership on direction of engineering efficiencies and integration management through data, roadmaps, short/long term plans, etc
Strong ability to build and sustain working and strategic relationships across technology.
Strong leadership skills with demonstrated ability to lead global, cross-functional teams.
Strong analytical and problem-solving skills.
Ability to maintain composure under pressure and tight deadlines.