Chatterbox TTS pipeline · 2026
From 48 GB accelerators to an 8 GB GPU
Automated voiceovers for 2,655+ real-estate listings. Listing text is cleaned into speakable text, then voiced by Chatterbox, whose memory grew with input length until it needed 48 GB accelerators.
- 16–80 → 5 GBVRAM, any input length
- −87%infra cost
- 2,655+listings, zero OOM
- Constraint
- VRAM use was 16 GB at baseline and grew to 48–80 GB on long inputs, causing OOM crashes. Position overflows at token boundaries caused voice hallucinations.
- Decision
- Transformed S3Gen into bounded-memory chunked execution and patched the position overflows and token boundaries, so VRAM stays at ~5 GB at any length. Upstream, a Node.js sanitizer turns each listing into speakable text (house numbers, dimensions, currency, acronyms) capped at ~150 words.