Cosie

Cosis, a Dutch healthcare organization, had put together KOERS 2030: their strategy and roadmap for the next several years. They wanted to present it to their employees in a fun way, and at the same time gather everyone's feedback and ideas on it, instead of sending out a standard questionnaire nobody reads. Studio VRij brought the project to Enversed Studios to build; Cosis and Studio VRij worked out the interview questions together.

Cosie is a small animated robot who conducts the interview by talking to you. An employee opens the app in their browser, and Cosie walks them through a short, spoken conversation about KOERS 2030: a handful of main questions with follow-up probes depending on the answer, capped at around ten minutes. At the end, the AI pulls out structured answers from the whole conversation and saves them for Cosis to use.

The loop is voice-based: hold a button to record, release it, and Cosie replies out loud. Under the hood that is Whisper for transcription, GPT-4 for the conversation itself, and ElevenLabs for the spoken reply, all routed through PHP proxies on the server so the API keys never sit in the browser. This pipeline builds on the one I first built a year earlier for Murder Mystery, and it later became the base I extended again for Joico's soft-skill training app: matching the text on screen to the pace of the spoken audio, discarding any AI response that arrives after the user has already moved on, and a correction table that fixes common Dutch speech-recognition mistakes on domain-specific words before they reach GPT.

Cosie's character design was done by a colleague. I took that art apart and rigged and animated it myself in PlayCanvas: idle motion on the head, body, eyes, antenna and arms that all move independently and speed up when Cosie is talking, random blinking, and a simple lipsync built by cycling the mouth through a handful of shapes in time with the audio.

Everything Cosie says, the questions, the follow-ups, the transcription fixes, is pulled live from a Google Sheet rather than hardcoded, so Cosis and Studio VRij could tweak the interview script without needing a new build. I built and shipped it solo.

A browser-based app, live at cosie.nu, where employees have a spoken conversation with an animated mascot about Cosis' 2030 strategy and get their feedback captured automatically, no forms, no typing required if they don't want to.

Cosie is live and has been used for 1,800+ conversations, and Cosis got real, usable feedback out of it. For me, this was another step in refining the voice AI pipeline (record, transcribe, generate a reply, speak it back, with an animated character reacting live) I first built for Murder Mystery a year earlier, and it in turn became the base I built on for later projects, including Joico's soft-skill training app.