Artificial Intelligence Engineer - ETL (5-7 yrs)

Job Description :

We are seeking a highly skilled Data Engineering and GenAI Engineer to join our team.

This role will be instrumental in designing and developing robust AI architectures on Azure, deploying LLMs for specific applications, and ensuring responsible AI practices.

Responsibilities :

Data Engineering and Pipeline Development :

- Design and develop scalable and efficient data pipelines using Azure Data Factory, Azure Databricks, or other relevant tools.

- Extract, transform, and load data from various sources into data lakes and data warehouses.

- Implement data quality checks and monitoring mechanisms to ensure data integrity.

- Collaborate with data scientists and analysts to understand their data needs and translate them into technical requirements.

AI Architecture and LLM Deployment :

- Design and architect AI solutions leveraging Azure AI services, including Azure Machine Learning, Azure Cognitive Services, and Azure Synapse Analytics.

- Deploy and fine-tune LLMs for specific applications, such as natural language processing, text generation, and machine translation.

- Optimize model performance and resource utilization to achieve cost-effective and efficient AI solutions.

Responsible AI :

- Adhere to AI ethics principles and ensure that AI models are fair, unbiased, and transparent.

- Implement bias mitigation techniques and responsible AI practices throughout the development lifecycle.

- Stay up-to-date with the latest advancements in AI and machine learning.

GenAI Engineering :

- Develop GenAI applications using frameworks like FastAPI or equivalent.

- Implement RAG (Retrieval Augmented Generation) techniques to enhance the quality and relevance of AI-generated content.

- Explore and leverage Single and Multi-Agent Frameworks for complex AI systems.

- Utilize Azure AI Search and Azure Document Intelligence for efficient information retrieval and understanding.

Stakeholder Communication :

- Effectively communicate technical concepts to both technical and non-technical stakeholders.

- Gather and refine requirements from stakeholders to ensure alignment with business objectives.

- Collaborate with cross-functional teams to deliver high-quality AI solutions.

Qualifications :

- 5+ years of experience in data engineering, machine learning, or AI.

- Strong proficiency in Python programming language.

- In-depth knowledge of Azure cloud platform and AI services.

- Experience with data pipelines, data warehousing, and data lakes.

- Hands-on experience with LLMs, such as GPT-3 or similar models.

- Familiarity with AI ethics, bias mitigation, and responsible AI practices.

- Excellent problem-solving and analytical skills.

- Strong communication and collaboration skills.

Preferred Qualifications :

- Experience with GenAI frameworks like FastAPI.

- Knowledge of Single and Multi-Agent Frameworks.

- Experience with Azure AI Search and Azure Document Intelligence.

- Certifications in Azure AI or machine learning