Voice AI
Onyx
Voice AI that autonomously manages pharmacy calls for patients with visual impairments or language barriers.
100%
critical conflicts caught
01 — Problem
Patients with visual impairments or language barriers struggle to independently manage prescription refills and verify medication safety over the phone — a process that normally requires reading labels and communicating clearly with pharmacy staff.
02 — Approach
- 01
Safety loop: uploaded PDF → Gemini extracts allergies and meds → webcam scans pill bottle → GPT-4o-mini Vision identifies drug → cross-checked against allergies → CRITICAL alert on conflict.
- 02
Pharmacy call loop: patient requests refill by voice → Twilio places outbound call → ElevenLabs synthesizes speech → TwiML <Gather> captures pharmacist response → adaptive two-stage dialogue flow with persuasion follow-up on decline.
- 03
Refill scheduler: APScheduler checks daily if last_fill_date + days_supply falls in a reminder window.
- 04
All LLM calls routed through a single OpenRouter API layer covering both Gemini and GPT-4o-mini.
03 — Architecture
04 — Results
100%
critical allergy conflicts caught
3
autonomous loops (safety, call, scheduler)
Stack
Next
Stratus→
Live operations dashboard for airport ground vehicle decarbonization — replays 1,422 real ATL flights and optimizes Delta's $65M electrification budget.