Chatterbox TTS pipeline · 2026
From a 48 GB server GPU to an 8 GB gaming card
Automated voiceovers for 2,655+ real-estate listings. Listing text is cleaned into speakable text, then voiced by Chatterbox, whose memory grew with input length until it needed a 48 GB RTX A6000.
- VRAM, any input length
- 16–80 → 5 GB
- infra cost
- −87%
- listings, zero OOM
- 2,655+
Problem
VRAM use was 16 GB at baseline and grew to 48–80 GB on long inputs, causing OOM crashes. Position overflows at token boundaries caused voice hallucinations.
What I did
Transformed S3Gen into bounded-memory chunked execution and patched the position overflows and token boundaries, so VRAM stays at ~5 GB at any length. Upstream, a Node.js sanitizer turns each listing into speakable text (house numbers, dimensions, currency, acronyms) capped at ~150 words.