Add office photos
All Filters
122 Highpoints Technologies India Jobs
Architecture/Design/Development - Software Engineer
3-7 years
Kolkata, Mumbai, New Delhi + 4 more
1 vacancy
Architecture/Design/Development - Software Engineer
Highpoints Technologies India
posted 3mon ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
Vulnerability Assessment: Identify and analyse potential vulnerabilities and flaws in LLM responses by executing a variety of prompt scenarios. Document findings and provide detailed reports on discovered issues.
Adversarial Prompting Techniques: Manipulating language, phrasing, and context to bypass built-in protections. This could include rephrasing sensitive requests in ways that avoid triggering content filters (e.g., asking for sensitive information in a polite or indirect manner) and prompt injection attacks, where a carefully crafted prompt is designed to override the model s instructions or system prompts (e.g., attempting to break internal instructions set by developers). Design multi-turn interactions where previous responses are used to gradually lead the model to unsafe outputs. This involves testing for context-aware vulnerabilities and confusing the model.
Probing Guardrails and Protection Layers: crafting prompts that probe the effectiveness of safety mechanisms like content moderation, censorship, or response limitations. Candidates need to have skill in crafting prompts in multiple languages to test whether guardrails are equally effective across different linguistic contexts. The successful candidate also needs to design prompts that test the LLM s compliance with ethical and legal standards (e.g., testing for responses related to illegal activities, child protection, or privacy breaches).
Probing Guardrails and Protection Layers and Multi-Stage prompting: Crafting prompts and creating testing templates that probe the effectiveness of safety mechanisms like content moderation, censorship, or response limitations. Nice to have would be skills in multi-lingual testing of guardrails.
Policy Non-Compliance checks: Checking the model responses against a corporate policy for compliance and probing for ways the model can be made to evade the guardrails.
Reporting and collaboration: Evaluate the model and report vulnerabilities, test outcomes using standardised benchmarks like responsible AI, and collaborate with the protection/guardrails/ML team.
Qualifications:
Bachelor s degree in computer science, Artificial Intelligence, Machine Learning, or a related field with more than 2 years of experience. Advanced degrees are a plus.
Prior experience in similar work, either in a contractual or full-time setting, with a leading model provider is a plus.
Proven experience in AI/ML, with a focus on prompt engineering, model evaluation, or red teaming. Familiarity with LLMs and their potential vulnerabilities is highly desirable.
Strong understanding of natural language processing (NLP) and LLMs.
Expertise in prompt crafting and the ability to generate diverse and effective test cases.
Proficiency in programming languages such as Python or R, with experience in AI/ML frameworks and tools. Ability to use scripting for automation.
Excellent problem-solving skills and a creative approach to challenge AI systems.
Strong analytical and communication skills, with the ability to present complex findings clearly.
Understanding the MITRE ATT&CK framework is nice to have but not required.
Prior experience with validating and probing models for policy compliance, including adversarial assessment, is nice to have but not required.
Experience exploiting vulnerabilities in at least two of the following areas: web applications and cloud environments.
Additional Sills:
Employment Type: Full Time, Permanent
Read full job descriptionPrepare for Software Engineer roles with real interview advice
What people at Highpoints Technologies India are saying
Software Engineer salary at Highpoints Technologies India
What Highpoints Technologies India employees are saying about work life
Highpoints Technologies India Benefits
View more benefits
Compare Highpoints Technologies India with
Infosys
TCS
Wipro
HCLTech
Tech Mahindra
LTIMindtree
Mphasis
Hexaware Technologies
Persistent Systems
Huawei Technologies
HCL Infosystems
ABCI Infrastructures
JioMart
Caparo Engineering India
Marelli
Creambell
Indorama
Data Entry
HRH Next Services
Grab A Grub Services
Similar Jobs for you
Architecture/Design/Development - Software Engineer
3-7 Yrs
Kolkata, Mumbai, New Delhi +4 more
Accounting/Operations - Accountant.
3-5 Yrs
Kolkata, Mumbai, New Delhi +4 more
Operations/Project Management - Business Analyst I
3-6 Yrs
Kolkata, Mumbai, New Delhi +4 more
Architecture / Design / Development - Technical Writer II
2-4 Yrs
Kolkata, Mumbai, New Delhi +4 more
Architecture / Design / Development - Technical Writer I
3-5 Yrs
Bangalore / Bengaluru
Architecture/Design/Development - Application Developer I.
3-8 Yrs
Kolkata, Mumbai, New Delhi +4 more
