2009:Music Recommendation Song Similarity

Song Similarity Subtask

Description

This subtask deals with targeted recommendation. It deals with tag-based radio, audio search, and prestige-ranked browsing (say by genre).

Targeted Search without personalization

Source Data

• Audio Data
• Song Tags
• Artist Tags

Query

Hand-picked playlist of songs describing a particular constraint

Ground Truth

• Option 1: set of hand-picked ordered playlists
• Option 2: ranked set of songs by play list co-occurence

Execution

Algorithms recieve the source data and the query playlist. Output is then matched against the ground truth

Evaluation

• Option 1:
  • Pearsons Correlation (order does not matter) against all play-lists in ground truth, best score is reported
  • Kendall Tau (order matters) same as above
• Option 2: Numeric output (strength of a recommendation)
  • Mean error
  • Recommendation error
• Option 2: Ordered sets
  • ROC area
  • Kendall tau
• Option 2: Unordered sets
  • Pearson correlation
  • F-Measure