Principal Lead- Data Engineering

In this role you will be a key member of Columbia Threadneedle Investments Data Engineering team. The candidate should be motivated self-starter with an aptitude for learning new skills and environments quickly while being able to manage multiple high-priority deliverables in parallel.
You will be responsible for:
Designing, coding, testing, implementing, maintaining, and supporting data pipelines that are central pillar to success of data engineering team.
You will be working closely with stakeholders to understand the requirements, perform in-depth analysis and design and build quality solutions mapping to requirements that are aligned with business and technology strategies, and comply with the organizations architectural standards.
You will be expected to provide technical guidance to the development team, additionally, should be able lead a team of engineers.

• Create high and low level design documents (including code samples/outlines) and detailed data engineering specifications based on complex business, user, and non-functional (e.g., performance, reliability, balance, and controls) requirements.
• Should be able to write code that adheres to coding standards, procedures, and techniques. Unit test all code and programs prior to releasing them to quality assurance. Maintain the integrity of existing program logic according to specifications.
• Actively participate in the code review process to ensure development work adheres to standards and specifications (including peer review and code review external to team). System design documentation and operations documentation should be updated to include providing required input into operation support manuals.
• Provide mentoring and direction to more junior members of the application development team. Provide governance oversight to ensure project adherence to development strategy, standards, policies, tools, and procedures.
  Work in partnership with the stakeholders to fully understand project goals and requirements and use this knowledge to effectively plan and execute the development process. Participate in project design walkthroughs.
  Improve the health of system assets by identifying enhancements to improve performance, reliability, and resource consumption. Track exceptions to standards (e.g., security gaps) to ensure they are addressed in a planful and timely fashion. Evaluate and troubleshoot root-cause analysis for production issues and system failures; determine corrective action(s) and propose improvements to prevent their recurrence.
• Maintain up-to-date business domain knowledge and technical skills in software development technologies and methodologies. Provide input in the selection, implementation and use of development tools and best practices. Work effectively in a team environment to ensure that solution delivery is on time, within cost estimates and meets business needs.

• Bachelors degree or equivalent in Computer Science, Engineering, or related field; or equivalent work experience.
• 10+ years of experience developing data engineering pipelines based on Informatica, AWS or equivalent cloud provider. 5+ years of experience in developing data capabilities in cloud [AWS or Azure]
• Deep knowledge of databases SQL and No-SQL (Athena, NoSQL databases (Redis, DynamoDB). Demonstrable experience in SQL development which includes creating views, stored procedures, functions etc.
• Proven knowledge of development tools such as Git, CICD/automation tools such as Jenkins, Ansible etc.
• 5+ year experience in Python application development, expert understanding of design patters to be used for implementing oop paradigm.
• 3+ year Experience in Snowflake.
• 5+ year Experience leading small teams, exposure of working on a team that is geographically dispersed will be a plus
• Proven ability to write quality code and associated unit/ integration tests.
• Strong problem-solving, multi-tasking and organizational skills.
• Good written and verbal communication skills.
• Knowledge of Asset Management Industry.
• Hands-on data engineering experience. (Exp on AWS Glue, EMR, EMR serverless, Big data or any similar)

• Data Driven application development experience using AWS Services
  Cloud Certifications (AWS)
• Experience of working in AI/MLOps applications
• Proven analytical and business skills to reconcile conflicting objectives and find/design acceptable compromises within existing limitations.
• Understand and apply both current technical solution elements (specific tools, components, and frameworks) and abstract elements (algorithms and architectures).
• Effectively apply technology/engineering knowledgebase to multiple and evolving programs and languages.

Full time (2:00p-10:30p) AWMPO AWMP&S Presidents Office Technology