Publications

Improving Large Audio-Language Model Embedding Baselines for Instruction-Aware Speech Retrieval

Chen-An Li, Cheng-Han Chiang, Hung-yi Lee

arXiv:2611.09122

IRIS-Embed combines contrastive training and instruction-aware audio layer weighting to improve speech retrieval and performance on general audio tasks.

INSPIRE: A Benchmark for Instruction-Aware Speech Retrieval

Chen-An Li, Hung-yi Lee

Interspeech 2026 · Long Paper

INSPIRE evaluates speech retrieval guided by instructions about content, speaker identity, speaking style, background sounds, or combinations of these attributes.

Hearing the Order: Investigating Position Bias in Large Audio-Language Models

Yu-Xiang Lin*, Chen-An Li*, Sheng-Lun Wei, Po-Chun Chen, Hsin-Hsi Chen, Hung-yi Lee

Interspeech 2026

This study examines how answer order affects large audio-language models and explores permutation-based strategies for more reliable evaluation.

All That Glitters Is Not Audio: Rethinking Text Priors and Audio Reliance in Audio-Language Evaluation

Leonardo Haw-Yang Foo*, Chih-Kai Yang*, Chen-An Li, Ke-Han Lu, Hung-yi Lee

Interspeech 2026

AdaSearch: Balancing Parametric Knowledge and Search in Large Language Models via Reinforcement Learning

Tzu-Han Lin, Wei-Lin Chen, Chen-An Li, Hung-yi Lee, Yun-Nung Chen, Yu Meng

EMNLP 2026

BreezyVoice: Adapting TTS for Taiwanese Mandarin with Enhanced Polyphone Disambiguation—Challenges and Insights

Chan-Jan Hsu, Yi-Cheng Lin, Chia-Chun Lin, Wei-Chih Chen, Ho Lam Chung, Chen-An Li, Yi-Chang Chen et al.

ISCSLP 2026

When Silence Matters: The Impact of Irrelevant Audio on Text Reasoning in Large Audio-Language Models

Chen-An Li, Tzu-Han Lin, Hung-yi Lee

ICASSP 2026

This study shows that irrelevant audio, including silence and noise, can disrupt text reasoning in large audio-language models.

Transferring Textual Preferences to Vision-Language Understanding through Model Merging

Chen-An Li, Tzu-Han Lin, Yun-Nung Chen, Hung-yi Lee

ACL 2025

This method merges text reward models with vision-language models to transfer textual preferences and improve multimodal evaluation without additional training.

Dynamic-SUPERB Phase-2: A Collaboratively Expanding Benchmark for Measuring the Capabilities of Spoken Language Models with 180 Tasks

Chien-yu Huang, Wei-Chih Chen, Shu-wen Yang, Andy T Liu, Chen-An Li, Yu-Xiang Lin et al.

ICLR 2025

A Preliminary Exploration with GPT-4o Voice Mode

Yu-Xiang Lin, Chih-Kai Yang, Wei-Chih Chen, Chen-An Li, Chien-yu Huang, Xuanjun Chen, Hung-yi Lee

arXiv:2502.09940

DogeRM: Equipping Reward Models with Domain Knowledge through Model Merging

Tzu-Han Lin, Chen-An Li, Hung-yi Lee, Yun-Nung Chen

EMNLP 2024

DogeRM merges domain-specific language models with general reward models to improve reward modeling without additional domain-specific preference data.

Unsupervised Multilingual Dense Retrieval via Generative Pseudo Labeling

Chao-Wei Huang, Chen-An Li, Tsu-Yuan Hsu, Chen-Yu Hsu, Yun-Nung Chen

Findings of EACL 2024

Building a Taiwanese Mandarin Spoken Language Model: A First Attempt

Chih-Kai Yang, Yu-Kuan Fu, Chen-An Li, Yi-Cheng Lin, Yu-Xiang Lin, Wei-Chih Chen, Ho Lam Chung et al.

arXiv:2411.07111

Examining Forgetting in Continual Pre-training of Aligned Large Language Models

Chen-An Li, Hung-yi Lee

arXiv:2401.03129

Visually-Enhanced Phrase Understanding

Tsu-Yuan Hsu*, Chen-An Li*, Chao-Wei Huang, Yun-Nung Chen

Findings of ACL 2023

This method combines generated visual cues with text and image encoders to improve phrase understanding and entity clustering.

CONVERSER: Few-Shot Conversational Dense Retrieval with Synthetic Data Generation

Chao-Wei Huang, Chen-Yu Hsu, Tsu-Yuan Hsu, Chen-An Li, Yun-Nung Chen

SIGDIAL 2023

Towards General-Purpose Text-Instruction-Guided Voice Conversion

Chun-Yi Kuan, Chen-An Li, Tsu-Yuan Hsu, Tse-Yang Lin, Ho-Lam Chung, Kai-Wei Chang, Shuo-Yiin Chang, Hung-yi Lee

ASRU 2023

Improving Cascaded Unsupervised Speech Translation with Denoising Back-Translation

Yu-Kuan Fu*, Liang-Hsuan Tseng*, Jiatong Shi, Chen-An Li, Tsu-Yuan Hsu, Shinji Watanabe, Hung-yi Lee

arXiv:2305.07455

On the Utility of Self-Supervised Models for Prosody-Related Tasks

Guan-Ting Lin*, Chi-Luen Feng*, Wei-Ping Huang**, Yuan Tseng**, Tzu-Han Lin**, Chen-An Li**, Hung-yi Lee, Nigel G Ward

SLT 2022 Best Paper Award

The Efficacy of Self-Supervised Speech Models for Audio Representations

Tung-Yu Wu*, Tsu-Yuan Hsu*, Chen-An Li*, Tzu-Han Lin*, Hung-yi Lee

PMLR 2022

Model Extraction Attack against Self-Supervised Speech Models

Tsu-Yuan Hsu*, Chen-An Li*, Tung-Yu Wu, Hung-yi Lee

arXiv:2211.16044