Shraddha Yeolekar
Forward Deployed Product Manager

I take LLM systems from idea to production — and I can prove it.

Product vision, evaluation frameworks, and the guardrails that keep AI systems reliable once they're live — plus the real, working code behind it. Ask an AI grounded in my actual resume and GitHub projects, not a summary written to impress you.

Shraddha Yeolekar
What I do

I've spent recent years taking LLM and RAG systems from initial vision to production — setting product direction, debating architecture, and building the evaluation frameworks and guardrails that keep them reliable once real users depend on them.

My background spans product, content, and customer-experience leadership, most recently as Global Manager of Digital Client Experience at OANDA, owning the AI/automation portfolio end to end — chatbots, autonomous agents, and the human-in-the-loop review systems that keep them accountable.

I apply the same rigor in my own time: open-source experiments comparing chunking strategies, evaluation frameworks, and multi-agent orchestration — real, runnable code, not slideware.

Currently
  • RoleGlobal Manager, Digital Client Experience — OANDA
  • FocusLLM/RAG deployment, evaluation frameworks, production guardrails
  • CertificationsDeploying AI · Data Science & Machine Learning — University of Toronto

Selected work

Real repos — click through and read the code
Document AI

AI Document Pipeline

Multi-tenant document classification, extraction, and routing via Gemini Flash, with RAG for long documents and an eval gate before any config change ships.

View project →
Evaluation

RAG Evaluation Framework

Five versioned pipelines comparing chunking and retrieval strategies for a RAG audit system — measured trade-offs, not guesses.

View project →
Guardrails

Guardrail & Judge Evaluation

Scores a "loose" prompt strategy against a guardrailed one using LLM-as-a-judge metrics — quantifying hallucination risk instead of eyeballing it.

View project →
Agentic AI

Multi-Agent Support Orchestrator

A router agent classifies and dispatches to a knowledge-base agent (hand-built vector search) or an escalation agent — with live latency/token tracing.

View project →
Live tool

Ask Me Anything

The tool linked above — grounded document Q&A on Cloudflare Workers, with a deterministic pre-filter, citation validation, and a kill switch.

Try it →
Team project

Customer Personality Analysis

K-Means/DBSCAN clustering and predictive modeling for marketing segmentation — a 5-person team project; my role was preprocessing, pipeline automation, and K-means clustering.

View project →

Impact, in numbers

+25%
Monthly case deflection, first client-facing AI chatbot
20 FTE/mo
Saved via a human-in-the-loop quality program
<1%
Hallucination rate held since that launch
7
Experiments run to validate the document pipeline design
0
PII or unauthorized-advice incidents to date