Artificial Intelligence Engineer - LLM Models (5-7 yrs)

We are seeking a highly skilled AI Engineer - Data to join our team.

Location : Chennai, immediate to 15 days joiner, Experience level required: 5-7 years

The primary focus of this role is to research, design, and implement solutions that enable seamless data ingestion from various sources and make it communicable with Large Language Models. You will build connectors to databases, text files, spreadsheets, emails, ERPs, and other systems, ensuring seamless data flow into our Cognition Engine. The ideal candidate will have a strong background in data engineering and AI, with experience in integrating and processing data from multiple formats and platforms.

Key Responsibilities :

1. Design and implement data collection solutions from diverse sources such as Excel, SQL, CSV, PDF, Word, NoSQL databases, emails, WhatsApp, Slack, and other common data formats.

2. Create efficient data pipelines that handle both historical and real-time data from these sources, ensuring seamless integration into LLMs.

3. Ensure data is appropriately tagged, categorized, and cleaned before being processed.

4. Collaborate with the knowledge base team to structure and process incoming data.

5. Maintain data integrity and implement error-handling mechanisms.

Required Skills and Experience :

1. Proven experience in designing and implementing data pipelines and solutions, preferably for AI or LLM applications.

2. Proficiency in building ETL (Extract, Transform, Load) pipelines.

3. Experience with API integration for third-party systems.

4. Experience with SQL, NoSQL databases, data lakes, and cloud storage solutions.

5. Strong proficiency in Python.

6. Experience with cloud platforms and containerization

We offer a competitive salary and the opportunity to work on cutting-edge AI technology. If you're passionate about pushing the boundaries of what's possible with LLMs, we want to hear from you!