Academia Sinica Logo

We present our recent progress on developing an end-to-end multimodal assistive listening device with advanced AI technologies that integrates audio, visual, and contextual cues for personalized speech enhancement. The system combines wearable technology, large language models, and foundation models, with real-time optimization and clinical validation, aiming to improve communication for hearing-impaired users and advance both academic and industrial innovation.