RealtimeVAD Aims to Reduce Latency in Voice Assistants
A new tool called RealtimeVAD improves voice assistant responsiveness by detecting when a user stops speaking up to 110ms faster than standard models.
Photo: Hacker News Front Page
Key points
- RealtimeVAD identifies end-of-speech 65-110ms faster than standard Silero VAD.
- The tool uses a dual-check system to trigger events as soon as audio levels drop.
- It includes dynamic noise floor tracking to improve performance for quiet speakers.
- The project is available as a LiveKit plugin for easier integration into voice assistant pipelines.
A new open-source tool, RealtimeVAD, has been introduced to address a persistent bottleneck in voice assistant technology: the delay between a user finishing a sentence and the system recognizing that silence. By augmenting the existing Silero Voice Activity Detector (VAD) with a secondary, high-frequency check, the tool identifies the end of speech significantly faster than traditional methods.
The system operates by performing a check every 10 milliseconds, comparing ambient room noise against the speaker's audio levels. While a standard VAD typically waits for a model to confirm the absence of speech, RealtimeVAD triggers an event the moment audio levels drop. Testing across thousands of voice assistant turns indicates a median latency improvement of approximately 92 to 110 milliseconds compared to using Silero alone.
Designed for developers, the tool is configurable and includes specific features to handle echo cancellation when the assistant is speaking. It also features dynamic noise floor adjustments, allowing it to maintain accuracy even when dealing with quiet speakers or poor-quality audio inputs, such as those found on simulated phone lines.
Source Hacker News Front Page — github.com/KoljaB/RealtimeVAD ↗
Read next
🧠AI AnalysisPedestal AI Secures Seed Funding to Automate Logistics With Intelligent Agents
Pedestal AI has launched publicly with $4.7 million in seed backing to deploy agentic artificial intelligence aimed at streamlining logistics and supply chain operations.
🏢Big TechUnited Launch Alliance Investigates Vulcan Rocket Failure
United Launch Alliance is investigating a mission failure of its Vulcan rocket, which suffered from low booster performance shortly after liftoff. The incident raises que…
🌐Work & SocietyUS Southwest Hydropower Output Hits Record Lows Amid Persistent Drought
Hydropower generation in the US Southwest dropped 28% below the 10-year average this summer as record-low water levels in the Colorado River Basin threaten regional energ…
🏢Big TechYouTube Updates View Metrics to Include TV Co-Viewing Estimates
YouTube is incorporating estimated co-viewing data into its public view counts to better reflect group consumption on television sets.
Apple Services Experience Widespread Outage
Apple users are reporting significant disruptions across iCloud, the App Store, and other core services, despite initial discrepancies in the company's status reporting.
⚖️Regulation & PolicyOpenAI Partners with Chilean Ministry to Advance Public Sector AI
OpenAI has signed a non-binding agreement with Chile's science ministry to integrate artificial intelligence into public administration and support local startups.