Data Engineer

Magna IT is looking for a strong and ambitious Data Engineer for our Analytics practice. The Data Engineer role will build and orchestrate synchronous and asynchronous data pipelines integrating heterogeneous business systems for both EAI and BI use cases.

Builds ETL data pipelines using Talend tool portfolio and SQL code.
Models Database objects to fulfil data pipeline requirements
Designs following integrations:
o ETL jobs using incremental load patterns, using technologies like Change Data Capture (CDC) or Change Tracking
o Services for APIs using technologies such as REST to be consumed synchronously by client application
o Subscription based workflows triggering ETL actions based on events at source system
o Embedded mapping and casting of data from heterogenous source and target systems and formats
Responsible for development, testing, documentation and performance of data pipelines, understanding and optimizing impact on source and target systems.

Works closely with:
o Business analysts, system owners to gain understanding of business processes and corporate data
o Business intelligence developers to ensure that integrations are correct and performing optimally.
Contribute to architectural decisions to support business processes
Provide production support for data solutions
o Complete root cause analysis and contribute to remediation planning and implementation
o Perform data quality analysis, report data quality issues and propose solutions for data quality management

Familiarity with various relational and non-relational database management systems, in particular Microsoft classic and cloud ecosystem
Architectural understanding of data hub oriented integrations as single point of orchestration.
Hands on knowledge in the design of data flows that facilitate data harvesting for automated genealogy documentation in a data catalog
Able to work in various delivery methodologies (Agile Scrum/SAFe, Waterfall, Kanban, etc).
Ability to read, interpret, analyze, and communicate effectively verbally and in written form.
Familiarity with UML Sequence diagrams.
Knowledge of data integration patterns across various functions of the enterprise.
Experience with cloud-based solutions preferably on Microsoft stack.
o Azure Synapse
o Data Factory
o Data Lake
Experience implementing and supporting scalable solutions, with a solid understanding of database locking escalation and other concurrency related mechanisms.
Understanding of when and how to use table partitioning and other data insertion, storage and distribution approaches.

bachelors in Information Technology or a related field (experience will be considered in lieu of education requirement)

3+ years of
o ETL development experience with T-SQL, Talend or other graphical ETL tools (Datastage, SSIS, Informatica, Ab Initio, PowerCenter, IBM InfoSphere, Pentaho,)
o SQL development, preferably in multiple database management platforms, and working with normalized relational databases and dimensional data warehouse implementation
Ability to manage multiple projects simultaneously and deliver results in a timely manner. Ability to work independently, under pressure, and adaptable to change.
Manufacturing experience and SAP knowledge are a plus