← Back to projects

KOKO

A voice-first platform for older adults, powered by an AI agent that bridges multiple messaging apps — currently piloted in nursing homes across Ontario.

ReactNode.jsAI AgentVoice TechWebRTC
KOKO

Overview

KOKO is a voice-first communication platform designed for older adults. At its core is an AI agent that works across messaging apps — WeChat, WhatsApp, iMessage — so seniors can reach anyone without learning a new tool. I led the full-stack development as part of our startup course at UofT.

Currently being piloted and tested at multiple nursing homes across Ontario.

Voice-First Interaction

Seniors don't type — they speak. KOKO's interface is fully tap-less: users hold a single button and say what they want. The AI agent interprets intent, routes messages to the right contact on the right platform, and reads replies back aloud.

Cross-Platform AI Agent

The hardest problem KOKO solves is fragmentation. A senior's family might use WeChat, their neighbor uses WhatsApp, their doctor's office uses SMS. KOKO's agent sits in the middle — a unified conversational layer that sends and receives messages across all these channels on behalf of the user.

Architecture

  • Voice pipeline — WebRTC capture → speech-to-text → intent classification → action execution → text-to-speech response
  • Agent orchestration — central message broker that maintains per-user conversation state across platforms
  • Platform adapters — modular connectors for each messaging service (WeChat, WhatsApp, iMessage, SMS)
  • React frontend — minimal, high-contrast UI optimized for accessibility and low vision