ollidev.com
← All projects

Prototype

AI Phone Buddy for Elderly

AI service that elderly people can call with normal phone to discuss news, do light exercises, or give feedback. Evolved from proof of concept to working prototype with real user testing.

  • Twilio API
  • OpenAI Realtime API
  • ElevenLabs Agents
  • WebSockets
  • Node.js
  • Render

Problem

Client's challenge

Client wanted to test an AI service that elderly people could call with normal phone and discuss with AI.

Business goal

Initial goal was that elderly people could in the future discuss with AI about news, do light exercises or give feedback about human service through calling an AI.

Solution

Technical approach

I developed a service that end users can call with normal phone from Finnish phone number. There was also a light registration website that was developed so that non-authorized callers would not be able to use the service without authorization.

First there was a proof of concept developed with OpenAI realtime API. The first version was done in video format that convinced client to continue the project. Then in later phases the project evolved to actual prototype that enabled end user to first register and get a Finnish phone number to call and discuss with AI. The testing was done with multiple AI providers, first with OpenAI realtime API and then ElevenLabs API for Agents.

Stack

  • Twilio API
  • OpenAI Realtime API
  • ElevenLabs Agents
  • WebSockets
  • Node.js
  • Render

Results

Challenges overcome

Client was able to test prototype themselves but also with real users. This revealed information about usability and costs.

Outcomes

The first iteration of the project (proof of concept) was done in days but then the project evolved to prototyping with real users. I was the solo developer for the project handling the communications.

Key learnings

The main challenge noticed was that none of the AI service providers at the time were not good at handling pauses in longer discussions. There were also limitations on concurrency of simultaneous calls and length of the call. Also the costs were quite high at the time of the test.