Generic LLM interface

Chat with audio response. Push to talk or type. The transcripts and contexts are preserved.

• DB: Redis

• LLM: Gemini 2.0, can be swapped. Currently it also manages STT

• TTS: Cartesia, can be swapped

• Features

  • Chat flow

  • Voice-in voice-out flow

  • Store and display transcripts

  • Rename chat

  • Text only toggle

  • Error handling