TF-IDF Applied to Recommendations

One of the possibilities that Aura is exploring is to leverage an existing TF-IDF implementation in minion.

There are a couple different mappings of the TF-IDF tuples under consideration, but the one considered here is:

TF-IDF Term TF-IDF Variable Aura Mapping Aura Variable Explanation
term t listener listens to music
document d artist a a has created music
corpus d¯

di
tk
c

all artists a¯

ai
k
c

k has listened to ai c times
term frequence f¯

di
tk
f

listener fanaticism f¯

ai
k
f

f percent of the time ai was listened to by k
document frequence F¯

tk
F

listener promiscuity F¯

k
F

k has listened to F percent of the artists
tf-idf tfidf¯

di
tk
w

dedicated fanaticism df¯

ai
k
w

The basic reasoning here is: a user who is a big fan of a limited number of artists is more likely to be focused within similar artists.

The cosine similarity is identical since both methods produce the tuples (or vectors) with the same positional meanings. The question is how similar the results will be.

Leave a Reply

Your email address will not be published. Required fields are marked *