LLM evaluation Jobs

Python Machine learning LLM Data analysis Large language models Prompt engineering LLM evaluation AI safety Red teaming Synthetic data+1

Red teaming, adversarial testing, or jailbreak research on AI systems Building or contributing to LLM evaluation frameworks or benchmarks Trust and safety,…

Lead AI Engineer

Upwork

Lisbon, Portugal15d ago

Python SQL Snowflake Machine learning LLM Large language models Prompt engineering AI agents LLM evaluation

Since its founding, Upwork Inc. has facilitated more than $30 billion in total transactions and services as it fulfills its purpose to create opportunity in…

Lead AI Engineer

Upwork

Palo Alto, California, United States15d ago

Python SQL Snowflake Machine learning LLM Large language models Prompt engineering AI agents LLM evaluation

Design and implement scalable agentic frameworks that coordinate multiple AI agents to deliver accurate and reliable outcomes. Build and optimize natural…

Staff AI Scientist

HackerRank Careers

Hybrid in Bangalore, India15d ago

Staff

Linear Machine learning LLM A/B testing Mentoring RAG Large language models Embeddings Retrieval-augmented generation LLM evaluation+1

HackerRank helps companies like NVIDIA, Amazon, and Microsoft hire and upskill the next generation of developers based on skills, not pedigree. Our platform…

Lead AI Test Automation Specialist

DevRev

Cebu, Philippines15d ago

United States - Remote15d ago

Python JavaScript REST CI/CD Jira Selenium Pytest Machine learning LLM Security+6

Design and implement comprehensive testing strategies for GenAI features, including conversational AI, agentic systems, and LLM-powered workflows Develop…

Machine Learning Engineer, PhD Intern

Instacart

Intern

Python Go Machine learning TensorFlow PyTorch LLM Large language models LLM evaluation

Ph.D. student in computer science, mathematics, statistics, economics, or related areas. Strong programming (Python, Golang) and algorithmic skills. Solid…

Lead QA AI Engineer

Anaplan

Manchester, United Kingdom15d ago

Python JavaScript REST CI/CD Jira Selenium Pytest Machine learning LLM Security+6

QA or test engineering experience, preferably with AI/ML systems. Strong understanding of GenAI technologies including LLMs, prompt engineering, and AI…

Head of Solution Architects, India

Anthropic

Bangalore, India15d ago

Machine learning LLM Ownership Large language models Prompt engineering Fine-tuning LLM evaluation AI safety

Build and manage the foundational team of Applied AI professionals in Bengaluru (Solutions Architects and Product Engineers) providing both technical guidance…

Manager of Solutions Architecture, Applied AI (Industries)

Anthropic

Machine learning LLM Security Mentoring Ownership Segment Large language models Prompt engineering LLM evaluation AI safety

10+ years technical experience 5+ years managing AI technical teams in hypergrowth (ideally from 10 to 50+) Previous experience leading solutions architect or…

Manager of Solutions Architecture, Applied AI (Industries)

Anthropic

Machine learning LLM Security Mentoring Ownership Segment Large language models Prompt engineering LLM evaluation AI safety

10+ years technical experience 5+ years managing AI technical teams in hypergrowth (ideally from 10 to 50+) Previous experience leading solutions architect or…

Manager of Solutions Architecture, Applied AI (Industries)

Anthropic

Munich, Germany15d ago

Manager

Machine learning LLM Security Mentoring Ownership Segment Large language models Prompt engineering LLM evaluation AI safety

10+ years technical experience 5+ years managing AI technical teams in hypergrowth (ideally from 0 to 30+) Previous experience leading solutions architect or…

Manager, Solutions Architect

Anthropic

Seoul, South Korea15d ago

Manager

Machine learning LLM Ownership Large language models Prompt engineering Fine-tuning LLM evaluation AI safety

Build and manage the foundational team of Applied AI professionals in Seoul (Solutions Architects and Product Engineers) providing both technical guidance and…

AI Automation Engineer / Developer

ShyftLabs

Toronto, Ontario9d ago

Python JavaScript Node.js FastAPI AWS GCP Kubernetes Docker Lambda LLM+10

Design and implement AI automation pipelines using Python (FastAPI, LangChain, spaCy) or Node.js (LLM API wrappers, task automation frameworks). Build and…

SDET - I

Mindtickle

Pune, Maharashtra9d ago

Python Java AWS GCP Azure Docker CI/CD Jenkins GitHub Actions Git+12

Design, build, and maintain scalable automation frameworks to qualify projects pre- and post-release, ensuring consistent product quality. Develop…

Sr. Software Engineer - Applied AI Engineering

Clari

Bengaluru, India9d ago

Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA / Philadelphia, PA / San Francisco, CA / Washington, D.C6d ago

Python Elasticsearch AWS Kubernetes Docker Machine learning PyTorch LLM Mentoring Code review+16

On a day-to-day basis, you will be responsible to - Architect and lead the design of complex AI systems involving multi-agent orchestration, large-scale RAG…

AI Solutions Engineer, Pre-Sales- W&B

CoreWeave

San Francisco Bay Area3d ago

Python JavaScript TypeScript Spring Snowflake AWS GCP Azure Kubernetes Machine learning+20

2+ years of experience in Solutions Engineering, ML Engineering, AI Engineering, or a similar customer-facing technical role. Strong proficiency in Python…

Machine Learning Engineer - LLM Evals + Observability

Glean