Senior LLM Engineer (5-10 yrs)

Job Summary :

We are seeking a highly experienced and innovative Senior LLM Engineer to join our cutting-edge AI team. The ideal candidate will possess a deep understanding of large language models, natural language processing, and machine learning, with a proven track record of developing and deploying advanced LLM powered applications. You will play a pivotal role in researching, developing, and optimizing LLMs for various applications, driving innovation and delivering impactful solutions.

Responsibilities :

LLM Development & Optimization :

- Design, develop, and fine-tune large language models for specific tasks and domains.

- Optimize LLM performance, including inference speed, accuracy, and resource utilization.

- Implement techniques for model compression, quantization, and distillation.

- Explore and implement novel architectures and training methodologies.

Research & Experimentation :

- Conduct research on state-of-the-art LLM techniques and architectures.

- Design and execute experiments to evaluate model performance and explore new applications.

- Stay abreast of the latest advancements in natural language processing and deep learning.

- Publish research findings in conferences and journals.

Application Development & Deployment :

- Develop and deploy LLM-powered applications, such as chatbots, virtual assistants, and text generation tools.

- Integrate LLMs with other systems and APIs.

- Ensure scalability, reliability, and security of deployed applications.

- Build robust pipelines for model deployment and monitoring.

Data Management & Preprocessing :

- Source, clean, and preprocess large datasets for LLM training.

- Develop and implement data augmentation techniques.

- Manage and maintain data pipelines and databases.

- Ensure data quality and integrity.

Prompt Engineering & Fine-tuning :

- Develop and refine prompts to elicit desired responses from LLMs.

- Implement fine-tuning strategies to adapt LLMs to specific tasks and domains.

- Evaluate and improve prompt effectiveness and model behavior.

Collaboration & Communication :

- Collaborate with cross-functional teams, including researchers, engineers, and product managers.

- Communicate complex technical concepts and results in a clear and concise manner.

- Present findings and recommendations to stakeholders.

Ethical Considerations & Responsible AI :

- Address ethical considerations related to LLMs, such as bias, fairness, and safety.

- Implement techniques for mitigating bias and ensuring responsible AI development.

- Stay informed about regulations and best practices related to AI ethics.

Technical Skills :

- Expert proficiency in Python.

- Strong understanding of C++ or other compiled languages (for performance-critical applications).

- Deep Learning Frameworks : TensorFlow, PyTorch, Hugging Face Transformers.

- GPT series, BERT, T5, Llama, and other state-of-the-art models.

- Experience with model training, fine-tuning, and deployment.

- Knowledge of NLP libraries (e.g., NLTK, spaCy).

- Knowledge of ML algorithms and techniques.

- Experience with database management systems (e.g., SQL, NoSQL).

- Proficiency in data manipulation and analysis libraries (e.g., Pandas, NumPy).

Qualifications :

- Master's or Ph.D. in Computer Science, Artificial Intelligence, Natural Language Processing, or a related field.

- 8-10 years of experience in developing and deploying AI/ML solutions, with a strong focus on LLMs.

- Proven track record of publishing research in top-tier AI conferences and journals (desirable).

- Strong understanding of deep learning architectures and training methodologies.

- Excellent problem-solving and analytical skills.

- Strong communication and collaboration skills.

Personal Attributes :

- Passion for AI and natural language processing.

- Intellectual curiosity and a drive to innovate.

- Ability to work independently and as part of a team.

- Strong attention to detail and a commitment to quality.

- Ethical awareness and a commitment to responsible AI development.