Skip to main content
We gratefully acknowledge support from the Simons Foundation, member institutions, and all contributors. Donate
arXiv logo
Cornell University Logo

Sound

Authors and titles for recent submissions

See today's new changes

Total of 43 entries
Showing up to 50 entries per page: fewer | more | all

Tue, 10 Dec 2024 (showing 17 of 17 entries )

[6] arXiv:2412.06703 [pdf, html, other]
Title: Source Separation & Automatic Transcription for Music
Bradford Derby, Lucas Dunker, Samarth Galchar, Shashank Jarmale, Akash Setti
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[7] arXiv:2412.06660 [pdf, html, other]
Title: MuMu-LLaMA: Multi-modal Music Understanding and Generation via Large Language Models
Shansong Liu, Atin Sakkeer Hussain, Qilong Wu, Chenshuo Sun, Ying Shan
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[8] arXiv:2412.06617 [pdf, html, other]
Title: AI TrackMate: Finally, Someone Who Will Give Your Music More Than Just "Sounds Great!"
Yi-Lin Jiang, Chia-Ho Hsiung, Yen-Tung Yeh, Lu-Rong Chen, Bo-Yu Chen
Comments: Accepted for the NeurIPS 2024 Creative AI Track
Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[9] arXiv:2412.06581 [pdf, html, other]
Title: EmoSpeech: A Corpus of Emotionally Rich and Contextually Detailed Speech Annotations
Weizhen Bian, Yubo Zhou, Kaitai Zhang, Xiaohan Gu
Comments: 4 pages, 1 figure. To appear in the Proceedings of the International Symposium on Chinese Spoken Language Processing, 7-10 November 2024, Beijing, China
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[10] arXiv:2412.06296 [pdf, html, other]
Title: VidMusician: Video-to-Music Generation with Semantic-Rhythmic Alignment via Hierarchical Visual Features
Sifei Li, Binxin Yang, Chunji Yin, Chong Sun, Yuxin Zhang, Weiming Dong, Chen Li
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[11] arXiv:2412.06208 [pdf, html, other]
Title: Pilot-guided Multimodal Semantic Communication for Audio-Visual Event Localization
Fei Yu, Zhe Xiang, Nan Che, Zhuoran Zhang, Yuandi Li, Junxiao Xue, Zhiguo Wan
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[12] arXiv:2412.06001 [pdf, html, other]
Title: M6: Multi-generator, Multi-domain, Multi-lingual and cultural, Multi-genres, Multi-instrument Machine-Generated Music Detection Databases
Yupei Li, Hanqian Li, Lucia Specia, Björn W. Schuller
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[13] arXiv:2412.05951 [pdf, html, other]
Title: When Vision Models Meet Parameter Efficient Look-Aside Adapters Without Large-Scale Audio Pretraining
Juan Yeo, Jinkwan Jang, Kyubyung Chae, Seongkyu Mun, Taesup Kim
Comments: 5 pages, 3 figures
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[14] arXiv:2412.05558 [pdf, html, other]
Title: WavFusion: Towards wav2vec 2.0 Multimodal Speech Emotion Recognition
Feng Li, Jiusong Luo, Wanjun Xia
Comments: Accepted by 31st International Conference on MultiMedia Modeling (MMM2025)
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[15] arXiv:2412.05436 [pdf, html, other]
Title: pyAMPACT: A Score-Audio Alignment Toolkit for Performance Data Estimation and Multi-modal Processing
Johanna Devaney, Daniel McKemie, Alex Morgan
Comments: International Society for Music Information Retrieval, Late Breaking Demo
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[16] arXiv:2412.06602 (cross-list from cs.CL) [pdf, html, other]
Title: Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey
Tianxin Xie, Yan Rong, Pengfei Zhang, Li Liu
Comments: A comprehensive survey on controllable TTS, 23 pages, 6 tables, 4 figures, 280 references
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[17] arXiv:2412.06259 (cross-list from eess.AS) [pdf, html, other]
Title: Leveraging Prompt Learning and Pause Encoding for Alzheimer's Disease Detection
Yin-Long Liu, Rui Feng, Jia-Hong Yuan, Zhen-Hua Ling
Comments: Accepted by ISCSLP 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[18] arXiv:2412.06209 (cross-list from cs.CV) [pdf, html, other]
Title: Sound2Vision: Generating Diverse Visuals from Audio through Cross-Modal Latent Alignment
Kim Sung-Bin, Arda Senocak, Hyunwoo Ha, Tae-Hyun Oh
Comments: Under-review
Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[19] arXiv:2412.05831 (cross-list from cs.MM) [pdf, html, other]
Title: Semi-Supervised Contrastive Learning for Controllable Video-to-Music Retrieval
Shanti Stewart, Gouthaman KV, Lie Lu, Andrea Fanelli
Comments: 4 pages + 1 reference page, 2 figures, 2 tables. Under review
Subjects: Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[20] arXiv:2412.05694 (cross-list from cs.MM) [pdf, html, other]
Title: Combining Genre Classification and Harmonic-Percussive Features with Diffusion Models for Music-Video Generation
Leonardo Pina, Yongmin Li
Subjects: Multimedia (cs.MM); Graphics (cs.GR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[21] arXiv:2412.05589 (cross-list from eess.AS) [pdf, html, other]
Title: SQ-Whisper: Speaker-Querying based Whisper Model for Target-Speaker ASR
Pengcheng Guo, Xuankai Chang, Hang Lv, Shinji Watanabe, Lei Xie
Comments: Accepted by IEEE/ACM TASLP
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[22] arXiv:2412.05296 (cross-list from cs.AI) [pdf, html, other]
Title: Revisiting Your Memory: Reconstruction of Affect-Contextualized Memory via EEG-guided Audiovisual Generation
Joonwoo Kwon, Heehwan Wang, Jinwoo Lee, Sooyoung Kim, Shinjae Yoo, Yuewei Lin, Jiook Cha
Comments: Codes and the dataset will be released upon acceptance
Subjects: Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

Mon, 9 Dec 2024 (showing 8 of 8 entries )

[23] arXiv:2412.05123 [pdf, html, other]
Title: Applying Automatic Differentiation to Optimize Differential Microphone Array Designs
Siminfar Samakoush Galougah, Ramani Duraiswami
Comments: 6 pages, 9 figures
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[24] arXiv:2412.04917 [pdf, html, other]
Title: Continuous Speech Tokens Makes LLMs Robust Multi-Modality Learners
Ze Yuan, Yanqing Liu, Shujie Liu, Sheng Zhao
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[25] arXiv:2412.04746 [pdf, html, other]
Title: Diff4Steer: Steerable Diffusion Prior for Generative Music Retrieval with Semantic Guidance
Xuchan Bao, Judith Yue Li, Zhong Yi Wan, Kun Su, Timo Denk, Joonseok Lee, Dima Kuzmin, Fei Sha
Comments: NeurIPS 2024 Creative AI Track
Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[26] arXiv:2412.04610 [pdf, html, other]
Title: Exploring Transformer-Based Music Overpainting for Jazz Piano Variations
Eleanor Row, Ivan Shanin, György Fazekas
Comments: Accepted and presented as a Late-Breaking Demo at the 25th International Society for Music Information Retrieval (ISMIR) in San Francisco, US, 2024
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[27] arXiv:2412.04534 [pdf, html, other]
Title: MoD-ART: Modal Decomposition of Acoustic Radiance Transfer
Matteo Scerbo, Sebastian J. Schlecht, Randall Ali, Lauri Savioja, Enzo De Sena
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Systems and Control (eess.SY)
[28] arXiv:2412.05167 (cross-list from cs.AI) [pdf, html, other]
Title: Benchmarking Open-ended Audio Dialogue Understanding for Large Audio-Language Models
Kuofeng Gao, Shu-Tao Xia, Ke Xu, Philip Torr, Jindong Gu
Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[29] arXiv:2412.05015 (cross-list from eess.AS) [pdf, html, other]
Title: Perceptually Transparent Binaural Auralization of Simulated Sound Fields
Jens Ahrens
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[30] arXiv:2412.04724 (cross-list from eess.AS) [pdf, html, other]
Title: StableVC: Style Controllable Zero-Shot Voice Conversion with Conditional Flow Matching
Jixun Yao, Yuguang Yang, Yu Pan, Ziqian Ning, Jiaohao Ye, Hongbin Zhou, Lei Xie
Comments: Accepted by AAAI 2025
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

Fri, 6 Dec 2024 (showing 7 of 7 entries )

[31] arXiv:2412.04202 [pdf, html, other]
Title: Relationships between Keywords and Strong Beats in Lyrical Music
Callie C. Liao, Duoduo Liao, Ellie L. Zhang
Comments: Accepted by IEEE BigData 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[32] arXiv:2412.04100 [pdf, html, other]
Title: Missing Melodies: AI Music Generation and its "Nearly" Complete Omission of the Global South
Atharva Mehta, Shivam Chauhan, Monojit Choudhury
Comments: Submitted to CACM, 12 pages, 2 figures
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[33] arXiv:2412.03784 [pdf, html, other]
Title: Speech Recognition-based Feature Extraction for Enhanced Automatic Severity Classification in Dysarthric Speech
Yerin Choi, Jeehyun Lee, Myoung-Wan Koo
Comments: Accepted to SLT 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[34] arXiv:2412.03771 [pdf, html, other]
Title: Diffusion in Zero-Shot Learning for Environmental Audio
Ysobel Sims, Stephan Chalup, Alexandre Mendes
Comments: This work has been submitted to the IEEE for possible publication
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[35] arXiv:2412.03633 [pdf, html, other]
Title: NBM: an Open Dataset for the Acoustic Monitoring of Nocturnal Migratory Birds in Europe
Louis Airale, Adrien Pajot, Juliette Linossier
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
[36] arXiv:2412.04425 (cross-list from eess.AS) [pdf, html, other]
Title: CA-SSLR: Condition-Aware Self-Supervised Learning Representation for Generalized Speech Processing
Yen-Ju Lu, Jing Liu, Thomas Thebaud, Laureano Moro-Velazquez, Ariya Rastrow, Najim Dehak, Jesus Villalba
Comments: 38th Conference on Neural Information Processing Systems (NeurIPS 2024)
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[37] arXiv:2412.04266 (cross-list from cs.CL) [pdf, html, other]
Title: Representation Purification for End-to-End Speech Translation
Chengwei Zhang, Yue Zhou, Rui Zhao, Yidong Chen, Xiaodong Shi
Comments: Accepted by COLING 2025
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

Thu, 5 Dec 2024 (showing 6 of 6 entries )

[38] arXiv:2412.03388 [pdf, html, other]
Title: DiffStyleTTS: Diffusion-based Hierarchical Prosody Modeling for Text-to-Speech with Diverse and Controllable Styles
Jiaxuan Liu, Zhaoci Liu, Yajun Hu, Yingying Gao, Shilei Zhang, Zhenhua Ling
Comments: COLING 2025
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[39] arXiv:2412.03373 [pdf, other]
Title: Exploring trends in audio mixes and masters: Insights from a dataset analysis
Angeliki Mourgela, Elio Quinton, Spyridon Bissas, Joshua D. Reiss, David Ronan
Comments: 11 pages, 6 figures, Presented at the AES 157th Convention October 2024, New York, USA
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[40] arXiv:2412.03267 [pdf, html, other]
Title: Detecting abnormal heart sound using mobile phones and on-device IConNet
Linh Vu, Thu Tran
Comments: N2Women'24 Workshop, MobiSys 2024, Tokyo, Japan
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[41] arXiv:2412.03430 (cross-list from cs.CV) [pdf, html, other]
Title: SINGER: Vivid Audio-driven Singing Video Generation with Multi-scale Spectral Diffusion Model
Yan Li, Ziya Zhou, Zhiqiang Wang, Wei Xue, Wenhan Luo, Yike Guo
Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD)
[42] arXiv:2412.03075 (cross-list from cs.CL) [pdf, html, other]
Title: ASR-EC Benchmark: Evaluating Large Language Models on Chinese ASR Error Correction
Victor Junqiu Wei, Weicheng Wang, Di Jiang, Yuanfeng Song, Lu Wang
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[43] arXiv:2412.03074 (cross-list from cs.CL) [pdf, html, other]
Title: Analytic Study of Text-Free Speech Synthesis for Raw Audio using a Self-Supervised Learning Model
Joonyong Park, Daisuke Saito, Nobuaki Minematsu
Comments: APSIPA ASC 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
Total of 43 entries
Showing up to 50 entries per page: fewer | more | all