repoGitHubTrust 82 · PrimaryPublished 1mo agoLive · yesterday
huggingface/speech-to-speech
Build local voice agents with open-source models
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- FuzzySimilar title/name (fuzzy) · 87%Comparing Human and Automatic Recognition of Dutch Dysarthric Continuous Speech: A Case Study →
“Fuzzy title match (0.94): “Comparing Human and Automatic Recognition of Dutch Dysarthri” ≈ “huggingface/speech-to-speech””
- FuzzySimilar title/name (fuzzy) · 87%RABBiT: Rapidly adaptive BOLD foundation model via brain-tuning for accurate zero-shot and few-shot prediction of speech-elicited responses in the brain →
“Fuzzy title match (0.94): “RABBiT: Rapidly adaptive BOLD foundation model via brain-tun” ≈ “huggingface/speech-to-speech””
- FuzzySimilar title/name (fuzzy) · 87%Benchmarking Human and Automatic Speech Recognition of Diverse Speech: Initial Results →
“Fuzzy title match (0.94): “Benchmarking Human and Automatic Speech Recognition of Diver” ≈ “huggingface/speech-to-speech””
- FuzzySimilar title/name (fuzzy) · 87%Content is What Remains: Invariant Speech Tokenization from Parallel Utterances →
“Fuzzy title match (0.94): “Content is What Remains: Invariant Speech Tokenization from ” ≈ “huggingface/speech-to-speech””
- FuzzySimilar title/name (fuzzy) · 87%Improving multichannel speech enhancement through accurate room-acoustic simulations →
“Fuzzy title match (0.94): “Improving multichannel speech enhancement through accurate r” ≈ “huggingface/speech-to-speech””
- FuzzySimilar title/name (fuzzy) · 87%DONDO: Open w2v-BERT Speech-Recognition Base Models for African Languages →
“Fuzzy title match (0.94): “DONDO: Open w2v-BERT Speech-Recognition Base Models for Afri” ≈ “huggingface/speech-to-speech””
- FuzzySimilar title/name (fuzzy) · 87%Motor, Cognitive, or Corpus? What Survives Cross-Lingual Transfer in Speech-Based Parkinsons Disease Detection →
“Fuzzy title match (0.94): “Motor, Cognitive, or Corpus? What Survives Cross-Lingual Tra” ≈ “huggingface/speech-to-speech””
- PossiblePossibly related (embedding) · 61%Looking for open-source AI meeting note-takers (like Fathom, Fireflies, Notion AI) →
Implements
paperComparing Human and Automatic Recognition of Dutch Dysarthric Continuous Speech: A Case StudypaperRABBiT: Rapidly adaptive BOLD foundation model via brain-tuning for accurate zero-shot and few-shot prediction of speech-elicited responses in the brainpaperBenchmarking Human and Automatic Speech Recognition of Diverse Speech: Initial ResultspaperContent is What Remains: Invariant Speech Tokenization from Parallel UtterancespaperImproving multichannel speech enhancement through accurate room-acoustic simulationspaperDONDO: Open w2v-BERT Speech-Recognition Base Models for African LanguagespaperMotor, Cognitive, or Corpus? What Survives Cross-Lingual Transfer in Speech-Based Parkinsons Disease DetectionpaperAuditing Protocol-Level Shortcuts in Large Audio Language Model Judges for Speech EvaluationpaperSelf-supervised Speech Comparison for L2 Phone, Rhythm, and Intonation ScoringpaperBlueMagpie-TTS: A Token-Efficient Tokenizer, Language Model, and TTS for Taiwanese-Accent Code-Switching SpeechpaperSPEARBench: A Benchmark for Naturalness Evaluation in Streaming Speech-to-Speech Language ModelspaperFrom Black-Box to Clinical Insight: A Multi-Stage Explainable Framework for Speech-Based Cognitive Impairment DetectionpaperLuxEmo: Expressive Text-to-Speech Corpus for LuxembourgishpaperUnlocking Speech-Text Compositional Powers: Instruction-Following Speech Language Models without Instruction TuningpaperVoxENES 2026: Benchmarking Generalization of Speech Spoofing Detectors Against LLM-Era TTS and Voice ConversionpaperFrom Sinhala to Dhivehi: Cross-Lingual Transfer Learning for Low-Resource Speech RecognitionpaperStreaming Neural Speech Codecs through Time-Invariant RepresentationspaperAudio-Native Speech Recognition with a Frozen Discrete-Diffusion Language ModelpaperContextual Semantic Relevance Tracks fMRI BOLD Responses During Naturalistic Speech ComprehensionpaperToward Generalizable Cognitive Impairment Detection with Speech-Based Multimodal Large Language Models
Covers
Covers (incoming)
newsVoice agents, demystified: STT+TTS and 4 demo agents you can talk to in the browser + build yours with RAG and ToolsnewsAs promised, here is the GitHub link for my 100% local voice-to-voice assistantnewsIntroducing Real World VoiceEQ: Measuring the human quality of voice AInewsOpenTune is a FREE open-source AI pitch correction tool for vocals - Bedroom Producers BlognewsLaunch HN: Speko (YC S26) – OpenRouter for Voice AInewsAnthropic updates Claude voice mode with more capable models
Related to (incoming)
Implements (incoming)
Related across the graph
paperSPEARBench: A Benchmark for Naturalness Evaluation in Streaming Speech-to-Speech Language ModelspaperFrom Black-Box to Clinical Insight: A Multi-Stage Explainable Framework for Speech-Based Cognitive Impairment DetectionmodelWhisper-LitepaperBenchmarking Human and Automatic Speech Recognition of Diverse Speech: Initial ResultspaperContextual Semantic Relevance Tracks fMRI BOLD Responses During Naturalistic Speech ComprehensionpaperBlueMagpie-TTS: A Token-Efficient Tokenizer, Language Model, and TTS for Taiwanese-Accent Code-Switching SpeechpaperHierarchical Acoustic-Semantic Modeling: Modality Separation and Semantic Coherence for Full-Duplex SLMsnewsLooking for open-source AI meeting note-takers (like Fathom, Fireflies, Notion AI)paperComparing Human and Automatic Recognition of Dutch Dysarthric Continuous Speech: A Case StudypaperFreyaTTS Technical ReportpaperLuxEmo: Expressive Text-to-Speech Corpus for LuxembourgishpaperWordVoice: Explicit and Decoupled Multi-Dimensional Word-Level Control for LLM-Based TTSpaperImproving multichannel speech enhancement through accurate room-acoustic simulationspaperRABBiT: Rapidly adaptive BOLD foundation model via brain-tuning for accurate zero-shot and few-shot prediction of speech-elicited responses in the brainnewsHow Loka Built a Natural, Low-Latency Voice Agent with Amazon Nova 2 SonicpaperSelf-supervised Speech Comparison for L2 Phone, Rhythm, and Intonation ScoringpaperUnlocking Speech-Text Compositional Powers: Instruction-Following Speech Language Models without Instruction TuningpaperMotor, Cognitive, or Corpus? What Survives Cross-Lingual Transfer in Speech-Based Parkinsons Disease DetectionnewsOpenTune is a FREE open-source AI pitch correction tool for vocals - Bedroom Producers BlogpaperFrom Sinhala to Dhivehi: Cross-Lingual Transfer Learning for Low-Resource Speech RecognitionpaperAudio-Native Speech Recognition with a Frozen Discrete-Diffusion Language ModelpaperStreaming Neural Speech Codecs through Time-Invariant RepresentationsnewsLaunch HN: Speko (YC S26) – OpenRouter for Voice AInewsVoice agents, demystified: STT+TTS and 4 demo agents you can talk to in the browser + build yours with RAG and ToolspaperVoxENES 2026: Benchmarking Generalization of Speech Spoofing Detectors Against LLM-Era TTS and Voice ConversionnewsAnthropic updates Claude voice mode with more capable modelsnewsIntroducing Real World VoiceEQ: Measuring the human quality of voice AIpaperToward Generalizable Cognitive Impairment Detection with Speech-Based Multimodal Large Language ModelspaperFacePlex: Full-Duplex Joint Speech-Facial Motion Generation for Conversational AvatarspaperContent is What Remains: Invariant Speech Tokenization from Parallel UtterancespaperAuditing Protocol-Level Shortcuts in Large Audio Language Model Judges for Speech EvaluationnewsAs promised, here is the GitHub link for my 100% local voice-to-voice assistantpaperDONDO: Open w2v-BERT Speech-Recognition Base Models for African Languages