Staff Machine Learning Engineer, Generative AI (Auth0)
Toronto, Ontario, CanadaFull-TimeStaffAI / Data Science
The Team
- Have you ever considered what powers the intelligent features behind seamless product experiences? The AI Frameworks and Services team is at the forefront of enabling AI-driven innovation across our organization. We build the foundational frameworks and essential services that empower engineering teams to integrate cutting-edge AI capabilities into our products, transforming how our users interact with them. From crafting intuitive generative AI-powered chat experiences that provide instant product support, to developing the best developer experience around authentication for generative AI and AI agents, as well as implementing intelligent security features, our team is instrumental in bringing the transformative power of AI to life. We collaborate closely with the Machine Learning team and various product teams to ensure the seamless and secure delivery of AI-enhanced features that provide real value to our users.
The Opportunity:
- As a Staff Machine Learning Engineer on the Generative AI team, you will help shape and accelerate our Generative AI strategy by contributing across the stack of model development, infrastructure, and platform services. You’ll drive design and implementation of production-ready AI/ML systems at scale—ranging from LLM-powered features to reusable platform components that other teams across Okta can build on.
You will have the opportunity to
- Design and implement scalable infrastructure and platform services for large-scale Generative AI use cases.
- Drive technical decision making while striving to hit the right balance between factors such as simplicity, flexibility, reliability, and performance.
- Architect, design, and deploy robust Machine Learning & GenAI systems, ensuring seamless integration with diverse platform services and establishing scalable LLMOps pipelines in production.
- Lead initiatives to tune, optimize, and deploy agentic applications in production with a focus on performance, reliability, and security.
- Partner with Product, Security, and Platform Engineering teams to design AI-powered experiences that are both innovative and trustworthy.
- Collaborate cross-functionally with product managers, researchers, and engineers to deliver secure, high-quality, and scalable AI/ML systems.
What you will do
- Design and implement components across different layers of the stack using technologies such as Python, LangGraph, DSPy, and MCP.
- Contribute to the design of scalable, observable ML and Generative AI systems that integrate retrieval, inference, and evaluation pipelines.
- Develop and iterate on structured prompting, context retrieval, and RAG workflows that improve accuracy, safety, and cost efficiency in Claude-based systems.
- Build and refine automated evaluation pipelines to measure model quality, correctness, groundedness, and safety in production.
- Implement schema validation, structured output enforcement, and other guardrails that keep AI outputs reliable, auditable, and compliant with enterprise standards.
- Mentor and coach engineers, contributing to the growth of the team and the larger engineering community.
What you bring
- Strong programming expertise in Python (and familiarity with Go or Typescript a plus).
- Hands-on experience with modern Generative AI platforms (AWS Bedrock, OpenAI, Anthropic, etc.).
- Deep understanding of retrieval-augmented generation (RAG), embeddings, and knowledge-base workflows.
- Familiarity with ML frameworks (FastAPI, PyTorch, TensorFlow, Spark ML) and workflow orchestration tools (Airflow, etc.).
- Experience with LiteLLM, LangGraph, LangChain, DSPy, LlamaIndex, MCP, or other related AI agent frameworks.
- Experience defining evaluation metrics, pipelines, and feedback loops for ML/GenAI systems.
- Proven ability to collaborate with product and engineering teams to drive greenfield initiatives forward, navigate unknowns, and iterate quickly and frequently.
- Experience building tools or infrastructure for AI/ML applications, with a deep understanding of the developer lifecycle in an AI-native world.
Nice to haves
- Experience with identity and auth products.
- Experience creating tools that integrate with AI-based coding platforms.
- Exposure to ethical AI, model risk, or compliance frameworks.
- Familiarity with evaluation datasets, synthetic data generation, or LLM-as-a-judge methods.
- Please note that we encourage candidates to apply even if you do not have experience with all of the criteria or technologies listed above; these are provided to give insight into the tech stack and general responsibilities for the role.
- #LI-REMOTE#LI-SH1P-2586_3172421
- Below is the annual salary range for candidates located in Canada. Your actual salary will depend on factors such as your skills, qualifications, and experience. In addition, Okta offers equity (where applicable), bonus, and benefits, including health, dental, and vision insurance, RRSP with a match, healthcare spending, telemedicine, and paid leave (including PTO and parental leave) in accordance with our applicable plans and policies. To learn more about our Total Rewards program, please visit: https://rewards.okta.com/can.
What you can look forward to as a Full-Time Okta employee!
- Amazing Benefits
- Making Social Impact
- Developing Talent and Fostering Connection + Community at Okta
- Okta cultivates a dynamic work environment, providing the best tools, technology and benefits to empower our employees to work productively in a setting that best and uniquely suits their needs. Each organization is unique in the degree of flexibility and mobility in which they work so that all employees are enabled to be their most creative and successful versions of themselves, regardless of where they live. Find your place at Okta today! https://www.okta.com/company/careers/.Some roles may require travel to one of our office locations for in-person onboarding.
