AmbitionBox
Search
Jobs
- Reviews
- Salaries
- Interview Questions
- About Company
- Benefits
- Jobs
- Office Photos
- Community
Add office photos
All Filters
1 Highpoints Technologies India Software Engineer Job
Architecture/Design/Development - Software Engineer
3-7 years
Kolkata, Mumbai, New Delhi + 4 more
1 vacancy
Architecture/Design/Development - Software Engineer
Highpoints Technologies India
posted 4mon ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
Expertise in Prompt Engineering: Develop and craft diverse and complex prompts aimed at testing various aspects of LLM behaviour, including but not limited to bias, accuracy, coherence, and ethical considerations. Refine and iterate using advanced prompts based on models initial responses to identify how slight changes affect the output, with the goal of bypassing the models filters.
Vulnerability Assessment: Identify and analyse potential vulnerabilities and flaws in LLM responses by executing a variety of prompt scenarios. Document findings and provide detailed reports on discovered issues.
Adversarial Prompting Techniques: Manipulating language, phrasing, and context to bypass built-in protections. This could include rephrasing sensitive requests in ways that avoid triggering content filters (e.g., asking for sensitive information in a polite or indirect manner) and prompt injection attacks, where a carefully crafted prompt is designed to override the model s instructions or system prompts (e.g., attempting to break internal instructions set by developers). Design multi-turn interactions where previous responses are used to gradually lead the model to unsafe outputs. This involves testing for context-aware vulnerabilities and confusing the model.
Probing Guardrails and Protection Layers: crafting prompts that probe the effectiveness of safety mechanisms like content moderation, censorship, or response limitations. Candidates need to have skill in crafting prompts in multiple languages to test whether guardrails are equally effective across different linguistic contexts. The successful candidate also needs to design prompts that test the LLM s compliance with ethical and legal standards (e.g., testing for responses related to illegal activities, child protection, or privacy breaches).
Probing Guardrails and Protection Layers and Multi-Stage prompting: Crafting prompts and creating testing templates that probe the effectiveness of safety mechanisms like content moderation, censorship, or response limitations. Nice to have would be skills in multi-lingual testing of guardrails.
Policy Non-Compliance checks: Checking the model responses against a corporate policy for compliance and probing for ways the model can be made to evade the guardrails.
Reporting and collaboration: Evaluate the model and report vulnerabilities, test outcomes using standardised benchmarks like responsible AI, and collaborate with the protection/guardrails/ML team.
Qualifications:
Bachelor s degree in computer science, Artificial Intelligence, Machine Learning, or a related field with more than 2 years of experience. Advanced degrees are a plus.
Prior experience in similar work, either in a contractual or full-time setting, with a leading model provider is a plus.
Proven experience in AI/ML, with a focus on prompt engineering, model evaluation, or red teaming. Familiarity with LLMs and their potential vulnerabilities is highly desirable.
Strong understanding of natural language processing (NLP) and LLMs.
Expertise in prompt crafting and the ability to generate diverse and effective test cases.
Proficiency in programming languages such as Python or R, with experience in AI/ML frameworks and tools. Ability to use scripting for automation.
Excellent problem-solving skills and a creative approach to challenge AI systems.
Strong analytical and communication skills, with the ability to present complex findings clearly.
Understanding the MITRE ATT&CK framework is nice to have but not required.
Prior experience with validating and probing models for policy compliance, including adversarial assessment, is nice to have but not required.
Experience exploiting vulnerabilities in at least two of the following areas: web applications and cloud environments.
Additional Sills:
Vulnerability Assessment: Identify and analyse potential vulnerabilities and flaws in LLM responses by executing a variety of prompt scenarios. Document findings and provide detailed reports on discovered issues.
Adversarial Prompting Techniques: Manipulating language, phrasing, and context to bypass built-in protections. This could include rephrasing sensitive requests in ways that avoid triggering content filters (e.g., asking for sensitive information in a polite or indirect manner) and prompt injection attacks, where a carefully crafted prompt is designed to override the model s instructions or system prompts (e.g., attempting to break internal instructions set by developers). Design multi-turn interactions where previous responses are used to gradually lead the model to unsafe outputs. This involves testing for context-aware vulnerabilities and confusing the model.
Probing Guardrails and Protection Layers: crafting prompts that probe the effectiveness of safety mechanisms like content moderation, censorship, or response limitations. Candidates need to have skill in crafting prompts in multiple languages to test whether guardrails are equally effective across different linguistic contexts. The successful candidate also needs to design prompts that test the LLM s compliance with ethical and legal standards (e.g., testing for responses related to illegal activities, child protection, or privacy breaches).
Probing Guardrails and Protection Layers and Multi-Stage prompting: Crafting prompts and creating testing templates that probe the effectiveness of safety mechanisms like content moderation, censorship, or response limitations. Nice to have would be skills in multi-lingual testing of guardrails.
Policy Non-Compliance checks: Checking the model responses against a corporate policy for compliance and probing for ways the model can be made to evade the guardrails.
Reporting and collaboration: Evaluate the model and report vulnerabilities, test outcomes using standardised benchmarks like responsible AI, and collaborate with the protection/guardrails/ML team.
Qualifications:
Bachelor s degree in computer science, Artificial Intelligence, Machine Learning, or a related field with more than 2 years of experience. Advanced degrees are a plus.
Prior experience in similar work, either in a contractual or full-time setting, with a leading model provider is a plus.
Proven experience in AI/ML, with a focus on prompt engineering, model evaluation, or red teaming. Familiarity with LLMs and their potential vulnerabilities is highly desirable.
Strong understanding of natural language processing (NLP) and LLMs.
Expertise in prompt crafting and the ability to generate diverse and effective test cases.
Proficiency in programming languages such as Python or R, with experience in AI/ML frameworks and tools. Ability to use scripting for automation.
Excellent problem-solving skills and a creative approach to challenge AI systems.
Strong analytical and communication skills, with the ability to present complex findings clearly.
Understanding the MITRE ATT&CK framework is nice to have but not required.
Prior experience with validating and probing models for policy compliance, including adversarial assessment, is nice to have but not required.
Experience exploiting vulnerabilities in at least two of the following areas: web applications and cloud environments.
Additional Sills:
Employment Type: Full Time, Permanent
Read full job descriptionPrepare for Software Engineer roles with real interview advice
What Software Engineer at Highpoints Technologies India are saying
Software Engineer salary at Highpoints Technologies India
reported by
3
employees
with 2-4
years exp.
₹2.8
L/yr - ₹7
L/yr
48%
less
than the average Software Engineer Salary in India
View more details
What Highpoints Technologies India employees are saying about work life
based on 7 employees
Flexible timing
Monday to Friday
Night Shift
Highpoints Technologies India Benefits
View more benefits
Compare Highpoints Technologies India with
Infosys
Compare
TCS
Compare
Wipro
Compare
HCLTech
Compare
Tech Mahindra
Compare
LTIMindtree
Compare
Mphasis
Compare
Hexaware Technologies
Compare
Persistent Systems
Compare
Marpu Foundation
Compare
Huawei Technologies
Compare
HCL Infosystems
Compare
Z X Learning
Compare
Evision Technoserve
Compare
Karma Ayurveda
Compare
InternEzy
Compare
Cogoport
Compare
Lea Associates South Asia
Compare
Creambell
Compare
Caparo Engineering India
Compare
Similar Jobs for you
Architecture/Design/Development - Software Engineer
3-7 Yrs
Kolkata, Mumbai, New Delhi +4 more
Share an Interview