Ai Benchmarking jobs in New Delhi
Explore 51 current openings. Compare roles, companies, locations, and work options, then open any job to view the full details.
Current openings
Showing 20 jobsAI Benchmark Engineer | Native Language Specialist - Hindi
lilt-productionAI Benchmark Engineering at LILT builds a rigorous evaluation suite of Terminal‑Bench tasks to test large language models on multilingual software challenges. The role designs, creates, and validates high‑signal …
New Delhi,New Delhi,IndiaRemoteContractActiveManaging Consultant
AvasantManaging Consultant – Benchmarking at Avasant, a leading management consulting firm, focuses on delivering data‑driven market insights to technology buyers. The role builds and manages benchmarking reports for ADM, …
New Delhi,IndiaOn-siteFull-timeActiveSubject Matter Expert – Quantative/Scientific/Corporate Domains
LILT (Production)LILT Production – AI benchmarking SME team builds realistic evaluation scenarios for cutting‑edge multilingual AI systems. The SME designs domain‑specific test cases, adapts rubrics, and reviews AI and human responses …
New Delhi,New Delhi,IndiaRemoteContractActiveAI Architect / Tech Lead – MCP & AI Integration
NexthireProgramming.com seeks an experienced AI Architect / Tech Lead to design and lead enterprise‑grade AI and Gen‑AI integrations. The role focuses on MCP (Model–Context–Prompt) architecture, scalable AI solution design, and …
Pan India, IndiaOn-siteFull-timeActiveSubject Matter Expert – Wholesale Trade & Commercial Sales
LILT (Production)LILT Production’s AI benchmarking team builds realistic commercial scenarios for multilingual AI systems. The SME designs and reviews wholesale trade and B2B sales scenarios in Malayalam and English, adapts evaluation …
New Delhi,IndiaRemoteContractActiveAI Engineer
BayRockLabs Open RequisitionsBayRock Labs seeks an AI Engineer to design, build, and deploy LLM‑powered solutions that drive business transformation. The role requires deep Python expertise, production‑grade backend development, and hands‑on …
New Delihi, IndiaOn-siteFull-timeActiveSubject Matter Expert – Healthcare & Social Assistance
LILT (Production)LILT Production – AI benchmarking project for Gujarati healthcare. Designs realistic healthcare and social assistance scenarios, develops evaluation rubrics, reviews AI and human responses, and creates gold‑standard …
New Delhi,New Delhi,IndiaRemoteContractActiveLead AI Developer
DentsuLead AI Developer role to lead collaboration with ML Engineers and DevOps Engineers to formulate AI designs that can be built, tested and deployed through the Route to Live and into Production using continuous …
New Delhi, IndiaOn-siteFull-timeActiveSubject Matter Expert – Healthcare & Social Assistance
LILT (Production)LILT Production’s AI benchmarking team builds realistic multilingual datasets to improve AI understanding of healthcare contexts. As a Subject Matter Expert you will design Malayalam healthcare scenarios, create …
New Delhi,New Delhi,IndiaRemoteContractActiveAI Fellow
Bill & Melinda Gates FoundationThe Gates Foundation seeks AI Fellows to drive end-to-end AI innovation in India, focusing on health, agriculture, education, and development. Fellows will identify real-world problems, prototype LLM-powered solutions, …
New Delhi, IndiaOn-siteFull-timeActiveSubject Matter Expert – Government
LILT (Production)LILT Production’s Government AI Benchmarking team builds realistic scenario datasets to evaluate AI systems in Indian public sector contexts. The SME designs and reviews Urdu and English government scenarios, adapts …
New Delhi,New Delhi,IndiaRemoteContractActiveAI Expert - Assamese
lilt-productionLILT's AI Expert team supports multilingual AI training and evaluation. The role reviews and annotates prompts, AI-generated text, audio, and video, ensuring cultural relevance and quality, while providing structured …
New Delhi,New Delhi,IndiaRemoteContractActiveSubject Matter Expert – Government
LILT (Production)LILT Production’s Government AI Benchmarking team builds realistic scenario datasets to evaluate multilingual AI systems in Indian public sector contexts. The SME creates and reviews high‑quality government scenarios in …
New Delhi,New Delhi,IndiaRemoteContractActiveAI Expert - Odia
lilt-productionLILT Production team seeks an AI Expert fluent in Odia to support AI training and evaluation projects. The role involves reviewing and annotating text, audio, and video content, evaluating AI-generated outputs, and …
New Delhi,New Delhi,IndiaRemoteContractActiveSubject Matter Expert – Government
LILT (Production)LILT Production’s Government AI Benchmarking team builds realistic scenario datasets to evaluate multilingual AI systems in Indian public sector contexts. The SME designs and reviews high‑quality government scenarios in …
New Delhi,New Delhi,IndiaRemoteContractActiveProgram Associate, MedTech & AI
PATHDigital Health, AI and MedTech vertical at PATH develops and scales health technology innovations, including AI-enabled medical devices and diagnostics. The Program Associate supports the portfolio by scouting and …
New Delhi,IndiaOn-siteFull-timeActiveSubject Matter Expert – Wholesale Trade & Commercial Sales
LILT (Production)LILT Production’s AI benchmarking team builds realistic commercial scenarios to train multilingual AI systems. As a Subject Matter Expert you design and review wholesale trade and B2B sales scenarios in Punjabi and …
New Delhi,New Delhi,IndiaRemoteContractActiveSenior Software Engineer, AI
SitetrackerScout Engineering team builds Scout, an AI product line delivering production LLM systems and agentic workflows for enterprise infrastructure. The Senior Software Engineer designs, develops, tests, deploys, and monitors …
New Delhi,IndiaHybridFull-timeActiveSubject Matter Expert – Healthcare & Social Assistance
LILT (Production)LILT Production – AI benchmarking team builds multilingual AI systems. As a Subject Matter Expert you design realistic Hindi healthcare scenarios, create evaluation rubrics, review AI and human responses for clinical …
New Delhi,IndiaRemoteContractActiveAI and Cloud Security Engineer
TD SynnexAI & Cloud Security team at Tech Data, a TD SYNNEX Company, secures AI and cloud environments by building an inline enforcement pipeline and runtime control plane for multi‑cloud AI workloads. The role engineers, …
New Delhi, IndiaRemoteFull-timeActive