Senior Data Engineer - Informatica Power Center (3-7 yrs)

Overview :

We are seeking a highly skilled Senior Data Engineer who possesses extensive experience in data engineering, with a strong emphasis on building, maintaining, and optimizing data pipelines. The ideal candidate will have a deep understanding of data engineering tools and practices, along with the ability to collaborate effectively with cross-functional teams to deliver high-quality data solutions that meet business needs.

Skills :

Data Engineering Tools :

- Strong experience with data engineering tools such as Informatica PowerCenter and Informatica Intelligent Cloud Services (IICS). This includes designing and implementing data integration solutions that ensure data is accessible, accurate, and usable for analytics and reporting.

Programming Proficiency :

- Proficient in programming languages like Python, utilizing its supporting libraries (e.g., Pandas, NumPy) for efficient data processing. Additionally, a strong command of SQL for data manipulation, retrieval, and transformation is essential to manage relational databases effectively.

Cloud Services and Architectures :

- Solid understanding of cloud services and architectures, primarily focusing on AWS. Familiarity with other cloud environments such as Azure and Google Cloud Platform (GCP) is highly desirable. This includes the ability to leverage cloud-native services for data storage, processing, and analytics.

ETL Processes and Data Modeling :

- Expertise in ETL (Extract, Transform, Load) processes, enabling the smooth flow of data from various sources into target systems. Strong skills in data modeling are essential for structuring data effectively to support business intelligence and analytics initiatives.

Workflow Orchestration :

- Familiarity with workflow orchestration tools such as Apache Airflow and AWS Glue. Experience in automating data workflows, scheduling jobs, and ensuring reliable data pipeline operations will be critical for this role.

Experience :

Building and Maintaining Data Pipelines :

- A minimum of 3+ years of experience in building and maintaining data pipelines for diverse data sources and formats using tools like Informatica PowerCenter and IICS. This includes ensuring data integrity and availability across various systems.

Data Quality and Validation :

- Conducted comprehensive data quality checks and implemented robust data validation processes to ensure the accuracy, consistency, and reliability of data across both cloud and on-premise environments. This involves identifying and resolving data discrepancies proactively.

Collaboration with Data Teams :

- Worked collaboratively with data scientists and analysts to provide reliable and timely data for analysis and reporting. This includes understanding their data needs and providing the necessary data infrastructure to support their initiatives.

Setting Up Data Engineering Practices :

- Participated in establishing data engineering practices and standards for various projects and clients, including developing cloud migration strategies to enhance data accessibility and performance. Contributed to best practices in data governance and management.

SQL Query Optimization :

- Designed and optimized complex SQL queries for efficient data retrieval, transformation, and integration with cloud data warehouses like AWS Redshift and Snowflake. This includes tuning queries for performance and ensuring efficient data processing.

Data Monitoring and Alerting :

- Implemented data monitoring and alerting systems to proactively address data pipeline issues and ensure continuous data availability. This involves setting up alerts for data anomalies and performance bottlenecks.

Building Cloud-Native Data Solutions :

- Assisted in building cloud-native data solutions on AWS, focusing on services like S3, Lambda, Redshift, and Athena. Ensured solutions are scalable, high-performing, and cost-effective, adapting to the needs of the organization.

Why Join Us ?

As a Senior Data Engineer, you will have the opportunity to work on cutting-edge data technologies and contribute to transformative projects that enhance our data capabilities. You will play a key role in shaping our data infrastructure, collaborating with talented professionals, and driving data-driven decision-making across the organization. If you are passionate about data engineering and looking for a challenging and rewarding environment, we encourage you to apply.