Realtime Translation Pipeline
Active
September 5, 2024 - Present
Duration: 1 year 3 monthsEdge-first pipeline that detects, translates, and captions live video streams using Whisper, Gemini, and server actions.
Edge
Next.jsWebRTCCloudflare WorkersWhisperGeminiRedis Streams
Key Features
Latency-aware worker placement
Automatic profanity filtering
Support for 34 languages
Subtitle injection for HLS + WebRTC
Case Study
Broadcast partners use this service to provide inclusive streams. Audio shards hit Workers, are transcribed with Whisper, and forwarded to Gemini for contextual translation before returning to overlays.
Project Details
Description
Edge-first pipeline that detects, translates, and captions live video streams using Whisper, Gemini, and server actions.
Technologies
Next.jsWebRTCCloudflare WorkersWhisperGeminiRedis Streams