Software Engineer II

At Allstate, great things happen when our people work together to protect families and their belongings from lifes uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.

Job Description

As a Software Engineer Senior Consultant I (Abinitio - Product Engineer), you will lead the design, development, and implementation of complex ETL processes using Abinitio, ensuring robust data integration and warehousing solutions. You will collaborate with stakeholders to define data requirements and optimize ETL workflows for performance and scalability. You will be responsible for monitoring, troubleshooting, and maintaining ETL processes while ensuring data integrity and quality through comprehensive testing. This role requires deep expertise in Abinitio, Oracle SQL/PLSQL, and Unix, as well as familiarity with Agile methodologies to drive effective data solutions and deliver business value.

Technical Skills Required:

1. ETL Process Development:

• Design and develop ETL processes using Abinitio to enable seamless data integration and warehousing solutions.
• Ensure scalability and performance optimization of ETL workflows, utilizing Abinitio's advanced features (Metadata programming, Plans, EME-TR).

2. Data Management:

• Collaborate with stakeholders to gather data processing requirements and translate them into effective ETL solutions.
• Implement data mappings, transformations, and flows while adhering to business rules and data quality standards.

3. Optimization and Troubleshooting:

• Monitor and troubleshoot ETL jobs to ensure the timely processing and loading of data.
• Analyze and resolve technical issues, ensuring minimal disruption to data workflows.
• Continuously optimize ETL processes for performance improvements.

4. Documentation and Quality Assurance:

• Develop and maintain detailed documentation for ETL processes, data mappings, and job schedules.
• Ensure data quality and integrity by executing rigorous testing and validation procedures across ETL pipelines.

5. Agile Collaboration and Code Reviews:

• Participate in Agile ceremonies, such as sprint planning, stand-ups, and retrospectives, to align on progress and priorities.
• Perform code reviews for team members, providing constructive feedback to maintain high-quality standards.

6. Cross-functional Collaboration:

• Collaborate closely with other teams (data architects, business analysts, and database administrators) to define and implement the optimal ETL architecture.
• Work with database technologies such as Oracle SQL/PLSQL and Unix systems for seamless integration of data workflows.

7. Continuous Improvement:

• Stay updated with new features of Abinitio and related tools, leveraging them to improve the overall ETL architecture.
• Contribute to process improvement initiatives, driving efficiency and innovation in ETL methodologies.

Technical Skills Required:

Abinitio Expertise:

• Strong understanding of Abinitio development, including metadata programming, plans, and EME-TR.

Oracle SQL/PLSQL:

• Proficient in Oracle SQL and PL/SQL for effective data extraction and manipulation.

Unix Systems:

• Strong knowledge of Unix for scripting and process automation.

API/Web Services:

• Understanding of API usage for integrating external data sources.

Agile Development:

• Experience with Agile methodologies, including sprints, stand-ups, and iterative development cycles.

Qualifications:

• 7-8 years of hands-on experience with Abinitio in ETL development.
• Strong problem-solving skills with the ability to troubleshoot complex ETL jobs.
• Experience in optimizing ETL processes for performance and scalability.
• Solid understanding of data warehousing concepts and data quality best practices.
• Ability to work independently and mentor junior developers.

Education

4 year Bachelors Degree (Preferred)

Experience

7-8 or more years of experience (Preferred)