- 권한신청
- P-ISSN1013-0799
- E-ISSN2586-2073
- KCI
내용기반 음악검색 시스템의 비교 분석
A Comparative Analysis of Content-based Music Retrieval Systems
- 다운로드 수
- 조회수
초록
본 연구는 웹에서 접근 가능한 내용기반 음악검색(CBMR) 시스템들을 조사하여, 탐색질의의 종류, 접근점, 입출력, 탐색기능, 데이터베이스 성격과 크기 등의 관점에서 특성을 비교 분석하고자 하였다. 비교 분석에 사용된 특성을 추출하기 위해 내용기반 음악정보의 특성과 시스템 구축에 필요한 파일의 변환, 멜로디 추출 및 분할, 색인자질 추출과 색인, 매칭에 사용되는 기술들을 선행연구로 리뷰하였다. 15개의 시스템을 분석한 결과 다음과 같은 특성과 문제점이 분석되었다. 첫째, 도치색인, N-gram 색인, 불리언 탐색, 용어절단검색, 키워드 및 어구 탐색, 음길이 정규화, 필터링, 브라우징, 편집거리, 정렬과 같은 텍스트 정보 검색 기법이 CBMR에서도 검색성능을 향상시키는 도구로 사용되고 있었다. 둘째, 시스템들은 웹에서 크롤링하거나 탐색질의를 DB에 추가하는 등으로 DB의 성장과 실용성을 위한 노력을 하고 있었다. 셋째, 개선되어야 할 문제점으로 선율이나 주선율을 추출하는데 부정확성, 색인자질을 추출할 때 사용되는 불용음(stop notes)을 탐색질의에서도 자동 제거할 필요성, 옥타브를 무시한 solfege 검색의 문제점 등이 분석되었다.
- keywords
- CBMR(content-based music retrieval), QBH(query by humming), QBN(query by music notation), QBC(query by contour), 내용기반 음악 검색시스템, 선율검색, 노래검색. 악보검색, 내용기반 음악정보
Abstract
This study compared and analyzed 15 CBMR (Content-based Music Retrieval) systems accessible on the web in terms of DB size and type, query type, access point, input and output type, and search functions, with reviewing features of music information and techniques used for transforming or transcribing of music sources, extracting and segmenting melodies, extracting and indexing features of music, and matching algorithms for CBMR systems. Application of text information retrieval techniques such as inverted indexing, N-gram indexing, Boolean search, truncation, keyword and phrase search, normalization, filtering, browsing, exact matching, similarity measure using edit distance, sorting, etc. to enhancing the CBMR; effort for increasing DB size and usability; and problems in extracting melodies, deleting stop notes in queries, and using solfege as pitch information were found as the results of analysis.
- keywords
- CBMR(content-based music retrieval), QBH(query by humming), QBN(query by music notation), QBC(query by contour), 내용기반 음악 검색시스템, 선율검색, 노래검색. 악보검색, 내용기반 음악정보
참고문헌
구경이. (2003). 주제 선율 색인을 이용한 내용 기반 음악정보 검색 시스템. 데이터베이스 연구, 19(3), 34-45.
김무정. (2011). Query By Humming 응용을 위한 Midi 파일에서의 자동 멜로디 트랙 선택방법 (405-408). 한국정보과학회 한국컴퓨터종합학술대회 논문집.
노정순. (2011). 정보검색 : 이론과 실제:글누리.
박만수. (2006). 실제 잡음 환경에 강인한 오디오 핑거프린팅 기법. Telecommunications Review, 16(3), 435-446.
유진희. (2007). 허밍 질의 처리 시스템의 성능 향상을 위한 효율적인 빈번 멜로디 인덱싱 방법. 정보과학회논문지 : 데이타베이스, 34(4), 283-303.
최윤재. (2009). 음악의 특성에 따른 피아노 솔로 음악으로 부터의 멜로디 추출. 정보과학회 컴퓨팅의 실제 논문지, 15(12), 923-927.
Arifi, V.. (2003). Automatic synchronization of music data in score-, MIDI-, and PCM-format (-). Proceedings of ISMIR 2003.
Bainbridge, D.. (2004). Music information retrieval research and its context at the University of Waikato. Journal of the American Society for Information Science and Technology, 55(12), 1092-1099.
Bandera, C. de la, Barbancho, A. M.. (2011). Humming method for content-based music information retrieval (49-54). Proceedings of ISMIR 2011.
Cano, P.. (2005). A review of audio fingerprinting. Journal of VLSI Signal Processing, 41, 271-284.
Cartwright, M. B.. (2011). Making searchable melodies: Human versus machine (-). Proceedings of Human Computation.
Chai, W.. (2002). Melody retrieval on the web. Proceedings of ACM/SPIE Conference on Multimedia Computing and Networking, , 226-.
Chandrasekhar, V.. (2011). Survey and evaluation of audio fingerprinting schemes for mobile query-by-example applications (801-806). Proceedings of ISMIR 2011.
Chen, R.. (2012). Chord recognition using durationexplicit hidden Markov models (445-450). Proceedings of ISMIR 2012.
Cheng, H. T.. (2008). Automatic chord recognition for music classification and retrieval (1505-1508). Proceedings of the IEEE International Conference on Multimedia and Expo 2008.
Chew, E.. (2008). Challenging uncertainty in query by humming systems: A fingerprinting approach. IEEE Transactions on Audio, Speech, and Language Processing, 16(2), 359-371.
Cilibrasi, R.. (2004). Algorithmic clustering of music based on string compression. Computer Music Journal, 28(4), 49-67.
Dannenberg, R.. (2007). A Comparative evaluation of search techniques for query by humming using the MUSART testbed. JASIST, 58(5), 587-701.
David, G.. (2003). Pitch extraction and fundamental frequency: history and current techniques. .
Duggan, B.. (2009). Compensating for expressiveness in queries to a content based music information retrieval system (33-36). Proceedings of the International Computer Music Conference(ICMC 2009).
Doraisamy, S.. (2002). Robust polyphonic music retrieval with n-grams. Journal of Intelligent Information Systems, 21(1), 53-70.
Downie, S.. (1999). Evaluating a simple approach to music information retrieval: Conceiving melodic N-grams as text.
Ghias, A.. (1995). Query by humming : Musical information retrieval in an audio database (231-236). Proceedings of the 3rd Annual ACM International Conference on Multimedia.
Goto, M.. (2004). A real-time music-scene-description system: Predominant-F0 estimation for detecting melody and bass lines in real-world audio signals. Speech Communication, 43(4), 311-329.
Hanna, P.. (2007). On optimizing the editing algorithms for evaluating similarity between monophonic musical sequences. Journal of New Music Research, 36(4), 267-279.
Hug, A.. (2010). Crowdsourcing a real-world on-line query by humming system (-). Proceedings of the 7th Sound and Music Computing Conference.
Kan, M.. (2008). LyricAlly: Automatic synchronization of textual lyrics to acoustic music signals. IEEE Transaction on Audio, Speech, and Language Processing, 16(2), 338-349.
Kline, R. L.. (2003). Approximate matching algorithms for music information retrieval using vocal input (130-139). Proceedings of the Eleventh ACM International Conference on Multimedia 2003.
Kornstädt, A.. (1998). Themefinder : A web-based melodic search tool. Computing in Musicology, 11, 231-236.
Lee, K.. (2008). Acoustic chord transcription and key extraction from audio using key-dependent HMMs trained on synthesized audio. IEEE Transactions on Audio, Speech, and Language Processing, 26(2), 291-301.
이윤주. (2006). 내용기반 음악정보 검색시스템을 위한 이용자 중심의 질의 인터페이스 설계에 관한 연구. 정보관리학회지, 23(2), 5-19.
Lemström, K.. (2007). On comparing edit distance and geometric frameworks in content-based retrieval of symbolically encoded polyphonic music. Musicae Scientiae. Discussion Forum, 4, 135-152.
Lemström, K.. (2003). Transposition invariant pattern matching for multi-track strings. Nordic Journal of Computing, 10, 185-205.
McNab, R. J.. (1996). Towards the digital music library : tune retrieval from acoustic input (11-18). Proceedings of the 1st ACM International Conference on Digital Libraries.
McNab, R. J.. (1997). The New Zealand Digital Library MELody inDEX. D-Lib Magazine, 3(5), 4-15.
Melucci, M.. (2004). Combining melody processing and information retrieval techniques : Methodology, evaluation and system implementation. Journal of the American Society for Information Science and Technology, 55(12), 1058-1066.
Mesaros, A.. (2010). Automatic recognition of lyrics in singing. Journal on Audio, Speech, and Music Processing, , 546047-.
Nam, G. P.. (1187). A new query-by-humming system based on the score level fusion of two classifiers. International Journal of Communication Systems, 25(6), 717-733.
Papadopoulos, H.. (2012). Modeling chord and key structure with Markov logic (127-132). Proceedings of ISMIR 2012.
Pardo, B.. (2004). Name that tune : A pilot study in finding a melody from a sung query. Journal of the American Society for Information Science and Technology, 55(4), 283-300.
Prechelt, M.. (2001). An interface for melody input. ACM Transactions on Computer- Human Interaction, 6(2), 133-149.
Rho, S.. (2008). MUSEMBLE: A novel music retrieval system with automatic voice query transcription and reformulation. The Journal of Systems and Software, 81(7), 1065-1080.
Roger, B.. (2004). Understanding search performance in query-by humming systems (85-89). Proceedings of ISMIR 2004.
Sheh, A.. (2003). Chord segmentation and recognition using EM-trained hidden Markov models (-). Proceedings of ISMIR 2003.
Shiffrin, J.. (2002). HMM-based musical query retrieval (295-300). Proceedings of the 2nd ACM/IEEE-CS Joint Conference on Digital Libraries.
Tripathy, A.. (2009). Query by humming system. International Journal of Recent Trends in Engineering, 2(5), 373-379.
Turetsky, R. J.. (2003). Ground truth transcriptions of real music from forcealligned MIDI syntheses (445-448). Proceeding of ISMIR.
Typke, R.. (2007). Music retrieval based on melodic similarity.
Typke, R.. (2004). Searching notated polyphonic music using transportation distances (128-135). Proceedings of the 12th Annual ACM International Conference on Multimedia.
Typke, R.. (2005). A survey of music information retrieval systems (153-160). Proceedings of ISMIR 2005.
Viro, V.. (2011). Peachnote : Music score search and analysis platform (359-362). Proceedings of ISMIR 2011.
Wan, C.. (2006). Content-based audio retrieval with relevance feedback. Pattern Recognition Letters, 27(2), 85-92.
Wang, A.. (2003). An industrial-strength audio search algorithm (-). Proceedings of the 4th International Conference on Music Information.
Wang, A.. (2006). The Shazam music recognition service. Communications of the ACM, 49(8), 44-48.
Wang, C.. (2006). N-gram inverted index structures on music data for theme mining and content-based information retrieval. Pattern Recognition Letters, 27(5), 492-503.
Wold, E.. (1996). Content-based classification, search, and retrieval of audio. IEEE Multimedia, 3(3), 27-36.
Zhu, Y.. (2003). Warping indexes with envelops transforms for query by humming (181-192). Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data (SIGMOD '03).
- 다운로드 수
- 조회수
- 0KCI 피인용수
- 0WOS 피인용수