7 papers this week in Speech & audio12 active threadsbusiest: Alignment Training Dynamics

Speech & audio research

Speech & audio

Vehicle-mounted microphones can localize nearby cars using sound alone

Liu et al. propose AcousticBEV, a learning-based method that uses a vehicle-mounted microphone array to estimate the center locations of moving vehicles in bird's-eye-view (BEV) space. On a new real-world dataset called AcousticScenes, the method achieves F1 scores of 47.7% on easy scenarios and 45.1% on difficult scenarios, outperforming both classical signal-processing and other learning-based baselines.

5 days ago
Speech & audio

Audio-language models understand spatial sound from any number of input channels

The authors present SpheraAudio, a framework that enables large audio-language models to process recordings with any channel count (mono, stereo, or Ambisonics) by converting multichannel spectra into a single token stream. They introduce a spatial encoder that produces tokens interleaved with audio tokens, using a new positional encoding to maintain temporal and modality information. SpheraAudio achieves state-of-the-art performance on spatial audio benchmarks while retaining strong general-audio capabilities.

6 days ago
Speech & audio

Text-to-audio evaluator that explains scores achieves top correlation with human raters

The authors propose CoTTAGE, an evaluator for text-to-audio generation that first generates an audio-grounded rationale before predicting scores for text relevance and overall quality. They collect over 10K human quality annotations to enable quality evaluation training. The system achieves state-of-the-art correlation with human judgments and its explanations are preferred by humans over those from base models.

6 days ago
Speech & audio

229K-hour dataset lets speech models generate minutes-long audio with control

The authors introduce Emilia2, a 229,000-hour multilingual dataset for long-form speech generation, built from in-the-wild recordings. It includes short utterances, single-speaker long-form clips, and multi-speaker dialogues with natural language instructions and nonverbal-vocalization tags, plus a 23-hour test set with up to four speakers. A 0.6B-parameter non-autoregressive model trained on Emilia2 achieves the lowest Chinese character error rate (5.27%) and English word error rate (9.93%) on a standard evaluation, surpassing an 8B-parameter system.

10 days ago