Skip to content
Ananya Rangaraju

Hi, I'm Ananya Rangaraju,

AI Systems & Product Engineer
who ships AI at scale
with Evals + LLMOps + HITL

BuilderAI Systems & Product Engineer

At Oracle Health I owned observability for clinical AI agents used across 100+ client deployments: instrumenting failure patterns across 100M+ rows, building validation frameworks that cut downstream errors by 25%, and translating agent behavior into decisions non-technical stakeholders could act on.

This still feels like day one.

Bigger systems. Harder reliability problems.

Ready for what's next.

Work Experience

End-to-end ownership across observability → evaluation → delivery → adoption, collaborating closely with engineering, product, and non-technical stakeholders.

Stakeholder & Delivery
LLMs & Agentic Systems
RAG & Model Evaluation
Full-Stack Development
Data & Cloud Infrastructure
Reporting & Analytics

Oracle Health (formerly Cerner)

Bangalore, India

Software Developer

2022 - 2024

Owned observability and reliability for clinical AI agents deployed across enterprise client sites.

  • Instrumented and monitored production AI agent behavior at scale, surfacing patterns that informed model improvements.
  • Built data validation frameworks that caught quality issues before they reached the model layer.
  • Designed reporting that brought AI performance, coverage, and compliance into one view for stakeholders.
  • Acted as the technical bridge between AI product teams and the people using the tools day to day.

Keany Produce and Gourmet

Landover, MD

Operations Intern

2025

Applied predictive modeling and dashboarding to improve fulfillment and warehouse operations.

  • Built predictive models to inform inventory and fulfillment decisions.
  • Replaced manual weekly reporting with a live operational dashboard.

Clearance

Autonomy Readiness Console

AI agent evaluation platform that certifies whether LLM agents are reliable enough for unsupervised operation, benchmarking GPT-4o, GPT-4o mini, Claude Sonnet 4.5, and Gemini 2.5 Flash across simulated business workflows.

  • Live evaluation pipeline making real per-trial LLM API calls with randomized edge-case injection, tracking per-trial latency and cost for cost-vs-reliability tradeoff analysis.
  • Scoring system separating benchmark accuracy from real-world reliability, surfacing gaps as large as 61 points between the two.
  • Automatic Cleared / Supervised / Not-Ready classification with configurable thresholds, tracking unsafe or irreversible actions as a distinct failure category.
  • Full reporting layer with dashboards, leaderboards, and expected-vs-actual failure breakdowns to make results auditable.
Next.jsFastAPITypeScriptPython
View live app

Everpure Trust Passport

Technical Architecture Proposal

Self-directed architecture proposal extending Everpure's Data Intelligence platform with a portable data-governance layer, gating AI and RAG access by sensitivity, legal basis, and consent. Modeled across two real regulatory regimes using Everpure's own public customer case studies.

  • Identified a real gap in Everpure's published healthcare and banking case studies: no automated way to separate regulated data from data safe for AI use.
  • Designed the Trust Passport, a portable metadata record (sensitivity score, legal basis, retention, AI-eligibility, protection tier, carbon budget) that five existing Everpure systems can act on automatically.
  • Proved the same architecture holds under both a US sectoral law (HIPAA) and an EU rights-based law (GDPR/DORA), evidence the pattern generalizes to any regulated industry.
  • Benchmarked against named DSPM competitors (BigID, Varonis, Cyera, Securiti) to show none pair classification with the physical storage layer the way this design does.
HIPAAGDPRDORAData Governance
View the deck

More projects coming soon

More projects coming soon

Education

2024 - 2026 · Dartmouth College

Master of Engineering Management

Machine learning, business analytics, operations, strategy, finance.

2018 - 2022 · Manipal University Jaipur

B.Tech, Computer Science & Engineering

CGPA 3.9 / 4.0. Data structures & algorithms, database management, statistical analysis, computer networks.

Skills

Soft Skills

Customer-Facing CommunicationCross-Functional OwnershipStakeholder ManagementUAT & SLA MonitoringRapid PrototypingSystems Thinking

Tech Stack

AI / LLM
Agentic WorkflowsPrompt EngineeringRAG PipelinesTool-Calling IntegrationsMulti-Model Benchmarking
Full-Stack
Next.jsFastAPITypeScriptPythonREST APIsPostgreSQL
Data & ML
SQLPandasNumPyscikit-learn
Cloud & Infra
AWSSnowflakeGitKubernetes
Delivery
Power BITableauJIRAUATSLA Monitoring
LLMOps
ObservabilityEvalsLangfuse

Let's talk

I build reliable, production-grade AI systems. If you have an interesting problem where AI is the right tool, let's talk.

© 2026 Ananya Rangaraju|Privacy