DigiHelic Solutions - Senior ETL/Datastage Developer (6-10 yrs)

About the Role :

We are seeking a highly skilled and experienced Senior ETL DataStage Developer to join our growing team in either Bangalore or Noida. In this role, you will be responsible for the design, development, support, and basic administration of ETL solutions using IBM DataStage. You will leverage your extensive experience to build robust and scalable data integration processes, ensuring data quality and efficiency.

Responsibilities :

1. ETL Design and Development :

- Design, develop, and implement complex ETL processes using IBM DataStage, including parallel jobs, server jobs, and sequences.

- Analyze business requirements and translate them into efficient and maintainable ETL solutions.

- Develop and maintain ETL standards, best practices, and documentation.

- Design and implement data transformations, cleansing, and validation routines.

- Optimize ETL jobs for performance and scalability.

- Develop and implement error handling and data quality checks.

- Create and maintain technical specifications and design documents.

- Utilize DataStage components effectively, including transformers, lookups, aggregators, and other stages.

- Implement change data capture (CDC) strategies when required.

2. ETL Support and Maintenance :

- Provide production support for DataStage ETL processes, including troubleshooting and resolving issues.

- Monitor ETL job performance and identify areas for improvement.

- Perform root cause analysis of ETL failures and implement corrective actions.

- Respond to and resolve data-related incidents and service requests.

- Perform data validation and reconciliation to ensure data accuracy.

- Implement and maintain data lineage and metadata management.

- Perform code reviews and ensure adherence to coding standards.

3. Basic DataStage Administration :

- Perform basic DataStage administration tasks, including user management, project setup, and environment configuration.

- Monitor DataStage server performance and resource utilization.

- Perform DataStage environment upgrades and patches in collaboration with infrastructure teams.

- Manage DataStage repositories and version control.

- Troubleshoot DataStage server and client issues.

- Implement and maintain DataStage security policies.

4. Collaboration and Communication :

- Collaborate with business analysts, data architects, and other stakeholders to understand data requirements.

- Communicate effectively with technical and non-technical audiences.

- Participate in project meetings and provide regular status updates.

- Mentor junior developers and share knowledge of DataStage best practices.

- Work closely with database administrators to ensure seamless data integration.

Required Skills and Experience :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- 6-10 years of experience in ETL design, development, support, and basic administration using IBM DataStage.

- Strong understanding of ETL concepts and methodologies.

- Extensive experience with IBM DataStage Designer, Director, and Administrator clients.

- Proficient in developing parallel jobs, server jobs, and sequences.

- Strong SQL skills and experience with relational databases (e.g., Oracle, SQL Server, DB2).

- Experience with data warehousing concepts and dimensional modeling.

- Knowledge of data quality and data governance principles.

- Experience with Unix/Linux operating systems and shell scripting.

- Excellent problem-solving and analytical skills.

- Strong communication and interpersonal skills.

- Ability to work independently and as part of a team.

- Experience with cloud-based data integration platforms.

- Experience with other ETL tools (e.g., Informatica, Talend).

- Knowledge of data modeling tools (e.g., Erwin, PowerDesigner).

- Experience with data integration in a cloud environment (AWS, Azure, GCP).

- Experience with Agile/Scrum methodologies.

- Experience with data lakes and big data technologies (e.g., Hadoop, Spark).