Evaluating Music Discovery Tools on Spotify: The Role of User Preference Characteristics

An experimental study was conducted to assess the effectiveness of the four music discovery tools available on Spotify, a popular music streaming service, namely: radio recommendation, regional charts, genres and moods, as well as following Facebook friends. Both subjective judgment of user experience and objective measures of search effectiveness were used as the performance criteria. Other than comparison of these four tools, we also compared how consistent are these performance measures. The results show that user experience criteria were not necessarily corresponded to search effectiveness. Furthermore, three user preference characteristics: preference diversity, preference insight, and openness to novelty were introduced as mediating variables, with an aim to investigating how these attributes might interact with these four music discovery tools on performance. The results suggest that users' preference characteristics did have an impact on the performance of these music discovery tools.

關鍵字

Music Retrieval ； Online Music Services ； Spotify ； Evaluation ； User Experience

並列摘要

本研究以Spotify為研究平台，探討音樂社交軟體的使用者使用不同音樂發掘工具進行音樂欣賞時的主觀評價和客觀推薦成效，以及與使用者偏好結構之間的關係。本研究以實驗法為主，一共有26位參與者，採用拉丁方格的組內設計，每位參與者都使用了4種音樂發掘工具（地區排行導覽工具、情境風格導覽工具、曲目電臺推薦工具、音樂追蹤導覽工具）在限定時間內探索並存取喜好的歌曲，所有參與者和系統互動的過程都以螢幕錄製的方式記錄下來。為了能從多維度、更準確地評估音樂發掘工具之效用，我們使用了主觀評價和客觀推薦成效兩個測量項目：(1)通過實證型的小型實驗來測量受試者之主觀評價，自變項為Spotify所提供的四種音樂發掘工具；中介變項為受試者的偏好結構（偏好洞見、偏好多樣性、偏好開放性）；依變項為實驗後問卷中收集的受試者主觀評價；(2)客觀推薦成效則由受試者在實驗中產生的曲目集合數量之比例決定，即以受測者所感興趣的曲目相較於工具所推薦的歌曲數目的比例。質化研究的部份，採用訪談法，通過實驗後對受試者進行針對性的訪談，為量化研究的結果提供檢定、補充和解釋。研究結果發現：一、不同音樂發掘工具的推薦效用的確有所差異。二、使用者面對不同音樂發掘工具時的主觀評價與客觀推薦成效並不一致。三、使用者的個人偏好結構的確會影響音樂發掘工具的推薦效用。

並列關鍵字

Spotify ；音樂串流服務；系統評估；偏好屬性；推薦系統

參考文獻

Cunningham, S. J., Reeves, N., & Britland, M. (2003, May). An ethnographic study of music information seeking: implications for the design of a music digital library. In Proceedings of the 3rd ACM/IEEE-CS joint conference on Digital libraries (pp. 5-16). Washington, DC: IEEE Computer Society.

Dougan, K. (2012). Information seeking behaviors of music students. Reference Services Review, 40(4), 558-573.

Herlocker, J. L., Konstan, J. A., Terveen, L. G., & Riedl, J. T. (2004). Evaluating collaborative filtering recommender systems. ACM Transactions on Information Systems (TOIS), 22(1), 5-53.

Konstan, J. A., & Riedl, J. (2012). Recommender systems: From algorithms to user experience. User Modeling and User-Adapted Interaction, 22(1-2), 101-123.

Kwon, K., Cho, J., & Park, Y. (2009). Influences of customer preference development on the effectiveness of recommendation strategies. Electronic Commerce Research and Applications, 8(5), 263-275.

國際替代計量

Evaluating Music Discovery Tools on Spotify: The Role of User Preference Characteristics

全文下載

主題瀏覽