Premium Employer
i
This company page is being actively managed by
BCG Team. If you also belong to the team, you
can get access from
here
BCG
Compare
All Filters
46 BCG Jobs
Global IT Software Engineer Senior Manager - Gen AI/ LLM
4-8 years
Gurgaon / Gurugram
1 vacancy
Global IT Software Engineer Senior Manager - Gen AI/ LLM
BCG
posted 1mon ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
What Youll Do
We are seeking a highly skilled and experienced full-stack Software Engineer Expert Senior Manager with Gen AI /LLM expertise to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a strong background in reusable software components, frameworks, microservices and APIs, cloud infrastructure, and DevOps/MLOps/LLMOps, with a passion for creating scalable, reliable, and efficient systems.
- Being a great hands-on engineer passionate of building platform capabilities.
- Performing successfully in a fast-paced, multi-cultural and service-oriented environment
- Verbal and written communication at a business and technical level
- High level of initiative, self-motivation, resourcefulness, and collaboration
- Are passionate, intellectually curious, and enjoy learning new skills and capabilities.
- Building relationships and reliable team player, displaying consideration and respect for others
- Interpreting rules and guidelines flexibly to enhance the business and aligning with BCG s values and culture
- Exhibiting ownership and accountability for the squad deliverables
- Servicing customer teams / platform users with a strong customer centricity
- Attention to detail, well organized, able to set priorities and take decisions
- Being flexible to be available outside of normal business hours for international calls as needed
Who Youll Work With
Your Gen AI Platform Engineering chapter in Cloud and Platform Engineering Portfolio Product Owners, Chapter Leads and other squad members. Agile Coaches and Scrum Leads, that will ensure that you adopt agile principles, mindset and ways of working into your daily routine and who will coach you during the transformation. Additional info
YOU BRING (EXPERIENCE & QUALIFICATIONS) :
OUR BRING (EXPERIENCE & QUALIFICATIONS) :
Bachelor s degree in computer science engineering (or equivalent degree or experience)
Proven Experience in Gen AI, Artificial Intelligence, Machine Learning, or Natural Language Processing
12+ years of relevant experience in delivering platform or complex technology solutions with strong technical background, preferably in global organization/ enterprise.
2+ years experience in experimenting and developing with LLM.
1+ years of experience developing with LLMs for production use case.
8+years of experience in leading Enterprise scale software engineering/ platform engineering teams.
Passionate expert in Modern Engineering, DevOps practices - Strong understanding of CI/CD, AI/ ML pipelines and automation tools.
Experience & Skills (Mandatory)
- Strong knowledge and experience in Generative AI/ LLM based development.
- Strong knowledge and experience in building conversational agent-based UX.
- Strong experience working with key LLM models APIs (e.g. AWS Bedrock, Azure Open AI/ OpenAI) and LLM Frameworks (e.g. LangChain, LlamaIndex)
- Experience with multi-agent frameworks and an understanding of multi-agent systems and their applications in complex, multi-step problem-solving scenarios.
- Expertise in building enterprise grade, secure data ingestion pipelines for unstructured data - including indexing, search, and advance retrieval patterns.
- Proficiency in generating and working with text embeddings with understanding of embedding spaces and their applications in semantic search and information retrieval.
- Knowledge and Experience in building knowledge graphs in production.
- Experience with RAG concepts and fundamentals (VectorDBs, AWS OpenSearch, semantic search, etc.), Expertise in implementing RAG systems that combine knowledge bases with Generative AI models.
- Proficiency in Python, TypeScript, NodeJS, ReactJS (and equivalent) and all associated GenAI libraries and frameworks.
- Experience with containerization and orchestration technologies (Kubernetes, Docker).
- Experience & Skills (Nice to have)
Experience with LLM guardrails
Experience with security related to LLM integration
Experience in LLM Testing and Evaluation
LLM Security
Employment Type: Full Time, Permanent
Read full job descriptionPrepare for Senior Software Engineer roles with real interview advice
What people at BCG are saying
Rating based on 6 Senior Software Engineer
reviews
Anonymous · Engineering - Software & QA
in Gurgaon / Gurugram
Likes
You will work with latest tools and technologies. You will get to work on amazing products that will challenge you and will help you grow. You will enjoy their parties and offsite and it is a culture you won't find anywhere.
- Salary - Good
Dislikes
Career progression is very difficult and there is no transparency. HR department is the worst and almost everyone is not helpful in any scenarios.
- Skill development - Poor+5 more
Senior Software Engineer salary at BCG
reported by
41
employees
with 4-12
years exp.
₹11.3
L/yr - ₹40
L/yr
73%
more
than the average Senior Software Engineer Salary in India
View more details
What BCG employees are saying about work life
based on 369 employees
Flexible timing
Monday to Friday
No travel
Day Shift
BCG Benefits
View more benefits
Compare BCG with
McKinsey & Company
Compare
PwC
Compare
Bain & Company
Compare
Deloitte
Compare
KPMG India
Compare
Accenture
Compare
Ernst & Young
Compare
IBM
Compare
Capgemini
Compare
Infosys
Compare
ZS
Compare
Mercer
Compare
Citco
Compare
Willis Towers Watson
Compare
Guidehouse
Compare
WSP
Compare
Mott MacDonald
Compare
Nexdigm
Compare
Gartner
Compare
Blackrock
Compare
Similar Jobs for you
BCG Gurgaon / Gurugram Office Location
Gurgaon Office
The Boston Consulting Group, 19th Floor, Tower C, Building No 10, DLF Cyber City, Phase-II
Gurgaon
Haryana 122002
Haryana 122002
Global IT Software Engineer Senior Manager - Gen AI/ LLM
4-8 Yrs
Gurgaon / Gurugram
Global Product Manager \u2013 ES Executive Support\u200B
8-10 Yrs
Gurgaon / Gurugram
Share an Interview