Senior Consultant

Skills from Primary Skill Cluster Big Data PysparkHadoopSkills outside Primary Skill Cluster Job Description ResponsibilitiesWe would be looking at Big Data + Spark professional

S/he should have excellent knowledge of SQL

Citi data lake is on Cloudera Hadoop with Hive

Other scripting knowledge like Python etc

are added advantage

Designs data integrations, Data Security and data quality framework

Write code to develop, maintain, and optimize data pipelines, as well as to implement data storage solutions and data processing systemsDevelops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity

Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization

Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it

Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues

Works closely with a team of frontend and backend engineers, product managers, and analysts

Defines data assets (data models) jobs to populate data models

Designs and evaluates open source and vendor tools for data lineage

Works closely with all business units and engineering teams to develop strategy for long term data platform architecture

Design efficient, scalable processes to acquire, manipulate and project dataParticipate actively in all facets of the Agile processContribute to the SDC codebase directly by taking on development tasks Required SkillsExperience with Agile process methodology, CI/CD automation, Test Driven Development

Hands on experience in programming languages Python and Java, Data Modeling, Data visualization, relational and non-relational databases as well as strong SQL knowledge

Knowledge of best practices and IT operations in an always-up, always-available serviceExperience with or knowledge of Agile Software Development methodologiesExcellent problem solving and troubleshooting skillsProcess oriented with great documentation skillsExcellent oral and written communication skills with a keen sense of customer service