At an OpenAI hackathon hosted at PearVC, me and my friends Saarth & Rohan were tinkering with the Realtime Voice API and then saw this tweet from Gary Tan:
and realized what we were hacking together pretty much fit this description perfectly. We named our assistant Donna after the Suits character. Our post went viral and has over 640k views.
Donna screens your calls, rejecting the spam and preserving your sanity by sending callers your scheduling / Calendly link when you're busy. Using the latest Realtime API from OpenAI in conjunction with function calling to Google Calendar and Twilio, Donna knows when you're busy in real time and can handle multiple callers at once in 85 different languages!
Monorepo Stack:
- FastAPI backend written in Python
- processes phone calls and audio streaming between both Twilio and OpenAI usings websockets
- powers both inbound and outbound calls to and from Donna
- reads from Google Calendar
- sends scheduling text messages
- reports live call status
- Next.js frontend written in Typescript
/statuspage that visualizes calls in real-time- integration with EdgeDB to handle user preferences and (in the future) semantic searching over previous conversations
