Senior Data Engineer - Abinitio

Job Title: Senior Data Engineer - Abinitio

Location: Hyderabad / Bangalore/ Chennai
Experience: 6-8 years
Employment Type: Full-Time

About Us

Onix is a trusted cloud consulting company and leading Google Cloud partner that helps companies get the most out of their technology with cloud-powered solutions, best-in-class services, and the Datametica Birds, data migration products that unleash AI potential.

We are able to deliver exceptional results for our customers because of our 20+ year partnership with Google Cloud, depth of technology expertise, and IP-driven data and AI solutions.

We offer solutions across a wide range of use cases and industries that are tailored to the unique needs of each customer. From advanced cloud security solutions to innovative AI capabilities and data migration products, we have you covered. Our global team of experts are the most reliable, talented and knowledgeable in the industry.

Key Responsibilities:

• ETL Development: Design, develop, and optimize ETL workflows using Ab Initio to process large-scale datasets efficiently.
• Big Data Processing: Implement and manage big data solutions using Hadoop, Data Lake architectures, and Spark (Scala & Python) for scalable data processing.
• Database Management: Write optimized SQL queries for data extraction, transformation, and analysis. Ensure performance tuning and data integrity across structured and unstructured datasets.
• Containerization & Orchestration: Deploy and manage containerized applications using Kubernetes to enhance scalability and reliability.
• Identity & Access Management (IAM): Implement and maintain IAM policies to ensure secure access control across data environments.
• Collaboration & Best Practices: Work closely with cross-functional teams, including data scientists, business analysts, and cloud engineers, to define and execute data solutions.
• Performance Optimization: Monitor, troubleshoot, and optimize data pipelines for efficiency, scalability, and fault tolerance.
• Documentation & Compliance: Maintain technical documentation, ensure adherence to security policies, and comply with data governance frameworks.

Required Skills & Qualifications:

• 6-8 years of experience in data engineering and big data technologies.
• Strong expertise in Ab Initio for ETL development and workflow management.
• Proficiency in SQL for complex queries, performance tuning, and database design.
• Hands-on experience with Hadoop/Data Lakes for large-scale data processing.
• Expertise in Spark (Scala & Python) for distributed data processing.
• Experience with Kubernetes for container orchestration and deployment.
• Understanding of IAM (Identity & Access Management) to ensure data security and compliance.
• Familiarity with cloud platforms such as AWS, Azure, or GCP is a plus.
• Strong problem-solving, analytical, and communication skills.