New Last.fm scrobbles database

  • 60
  • Announcement
  • Updated 7 hours ago
  • (Edited)
Hi everyone,

We are beginning to roll out a new scrobbles database. This changes how we store your scrobbles - a big change for us, while to you most things will look the same :)

You will get the following improvements from this:

  • Support for corrections: You can enable and disable corrections properly, with your corrected or uncorrected scrobbles matching in all places

  • Album artists are correctly shown in album views (e.g. the album charts, instead of track artists)

  • Imported plays (e.g. from iTunes, when you first joined) are shown and counted correctly in all views

Please note, as we're gradually rolling out the update, not all of you can see these changes yet.

What you will see:

Your overall scrobble counts should always remain the same.

As a result of the above mentioned improvements, you might see changes to your artist, album and track counts, as well as to scrobble counts of artists, albums and tracks:

  • For example, if you've disabled corrections, your artist, album and track counts usually will go up, and otherwise corrected items will be split up in your charts.

  • Your Loved Tracks now properly support corrections, too. You might see that your Loved Tracks count has decreased when corrections are enabled, as duplicate versions of the same track will have been merged.

  • Where you've previously scrobbled the same album with the same album artist a number of times, you probably would have had these plays split up in your album charts, with the track artists being shown instead. This will now show one album entry, with the album artist as artist. When this happens, you will see a decreased albums count in your library.

  • This also fixes a problem where you could have seen the same album twice in your album charts, with different play counts.

What to do if you notice anything odd:

  • If artists (albums, tracks) have suddenly been split up in your library, check if you have corrections disabled - and if necessary, enable them.

  • If the overall scrobbles count in your library has changed - check if you have imported plays from your media player (when you joined Last.fm; feature available before 2015), these are counted correctly now. The overall scrobbles counts on your profile and in your library should now match.

  • If you notice any slowness in your library, charts or scrobblegraphs not loading - do let us know.

  • If you notice any scrobbles missing or too many - check if any of the above applies, and if not, do let us know.

  • If you have any trouble deleting an artist, album or track from your library - do let us know.

Did you know scrobbling is already turning 16 years old next week? It's been a big journey and our new scrobbles database sets us up for many more years to come. Thanks for scrobbling.

Lots of love,

Team Last.fm
Photo of Laura Last.fm

Laura Last.fm, Official Rep

  • 448 Posts
  • 365 Reply Likes

Posted 8 months ago

  • 60
Photo of Patrick

Patrick

  • 1235 Posts
  • 737 Reply Likes
The new database works flawlessly, but there is a problem. It looks like he cannot recognize Various Artists compilations when I'm listening to them on DEEZER or Spotify. He can recognize them only if I'm listening to them on my desktop machine. Are there any chances to fix this? Account: Samson-91
Photo of Lars Jansson

Lars Jansson

  • 125 Posts
  • 82 Reply Likes
It seems like I have the same problem. No album art appears when playing various artits comipilation. I use spotify desktop app. user:lapeja
Photo of Schander .

Schander .

  • 21 Posts
  • 1 Reply Like
So far, it's all working perfectly fine for me. Thanks a bunch!
Photo of jooyeon

jooyeon

  • 1 Post
  • 0 Reply Likes
My album scrobbles have gone down for quite a few albums in my library, but if I click on the album it'll display the correct number of scrobbles.

For example:

In my library it incorrectly displays the plays for these albums as:



But then if you click on the plays it displays their correct playcount:


(hope that makes sense)

This is just 2 examples, but there's multiple albums where this has happened. My username is wadamz 

Thanks!
Photo of Patrick

Patrick

  • 1224 Posts
  • 726 Reply Likes
I reported that issue that you described two years ago. Jon said that the new database is going to fix this issue.
Photo of Tom

Tom

  • 7 Posts
  • 2 Reply Likes
The new database has CREATED a similar issue for me. So I guess that Jon guy was wrong...
Photo of guiguiae

guiguiae

  • 9 Posts
  • 2 Reply Likes
same here, even with artists...
Photo of decrepitude

decrepitude

  • 2 Posts
  • 0 Reply Likes
Hello, I follow an account with 10 years of scrobbles who haven't scrobbled since 2015, and his library was normal but when this update started it's auto-correction has been automatically turned off and the owner probably won't turn on the auto-correction himself, so if I give you the name of the account could you put back the auto-correction on it's library please ? Sorry I'm not very good at english.
Photo of rndm

rndm

  • 3 Posts
  • 5 Reply Likes
So all my Taeyeon tracks have been split between "taeyeon" and "태연" now, latter being the correct one. It's funny since clicking to "taeyeon" artist page automatically redirects you to "태연" yet my library is all messed up now between the two.


(Edited)
Photo of Tom

Tom

  • 7 Posts
  • 2 Reply Likes
So, I'm assuming this dumb update is what has fucked up all of my scrobbles, randomly splitting albums into multiple different albums for no fucking reason and making me no longer want to use your site.

Well done for profoundly screwing up your website and making it unusable!
Photo of Tom

Tom

  • 7 Posts
  • 2 Reply Likes
I've tried all the fixes listed so far in this thread for similar issues and it's just made the issue even worse for me. Making more albums scrobbles split, and making other scrobbles just flat out disappear.


So I guess the next step for me will be closing my account after 14 years of using it. Seeing as how you've now made it unreliable and unusable. Sorry for the swearing in the initial post, but this is just a tad irritating.
(Edited)
Photo of Patrick

Patrick

  • 1224 Posts
  • 726 Reply Likes
Flooding the forum with your small portion of comments won't help you to solve your issue. It looks like your account is terminated due to mass flooding that you did.
Photo of Patrick

Patrick

  • 1235 Posts
  • 737 Reply Likes
It looks like I have another issue. For some odd reasons, all my listening activities went to this album. I never listened to Sign In Please. The only record I was listening to is That's the Stuff. For that album, I have 255 plays, but he merged them to Sign In Please. How can I fix this?
Photo of Gadour

Gadour

  • 4 Posts
  • 0 Reply Likes
Man i just want to correct this: https://www.last.fm/user/gadour97/library/music/SIX/_/Ratatat 
It's six by ratatat not the other way around.

https://www.last.fm/music/SIX/_/Ratatat

correct one:
https://www.last.fm/music/Ratatat/_/Six 
Photo of Jared

Jared

  • 7 Posts
  • 1 Reply Like
I was just wondering when this update was going to be rolled out to subscribers. It seems like it might help fix some of the problems in my library and I’d be eager to test it out.
Photo of Hans-Jürgen

Hans-Jürgen, Moderator

  • 2204 Posts
  • 1154 Reply Likes
Check again, it looks like subscribers also see the new scrobbles database again. For example I could finally add pictures and videos to the Fitzwilliam Quartet profile now which wasn't accessible for me yet, probably due to an existing autocorrection to Fitzwilliam String Quartet.
(Edited)
Photo of Jared

Jared

  • 7 Posts
  • 1 Reply Like
I definitely got the database update, but it seems to have caused a lot of problems. The auto-correct setting works, but, either on or off, it’s caused a lot of fragmentation of songs and albums that didn’t exist before. I’m not sure what is going on.
Photo of Jared

Jared

  • 7 Posts
  • 1 Reply Like
I’ve attached an image of what happened to my albums from Kanye West. They’ve been horribly fragmented and I’m not sure what is going on. Manual redirections would fix it, but for now some sort of solution would help.
Photo of Gino Gigiki

Gino Gigiki

  • 13 Posts
  • 18 Reply Likes
Well, it would be just great if you could make last.fm "see" for example 'Armin van Buuren' and "artists" (pseudo-artists) like 'Armin Van Buuren feat. ...' or 'featuring ...' etc. as the same artist (in this case Armin van Buuren is the correct one).

I don't know if just voting for the correct spelling of an artist-album-song name has an effect...

Keep up with the good work.

Photo of Rose De Perio

Rose De Perio

  • 19 Posts
  • 8 Reply Likes
Sorry if something similar has been mentioned as I don't have time to go though the whole thread... There is an album that appears 3 times on my charts because of the different variations of the band's name that happened most likely when someone goofed up the band's name in the song's computer file info or whatever it's called and only realized it after scrobbling the song for some time. It's bugging me that it seems like it cannot be fixed and seeing the album 3 times on my charts really bugs me even more. *sigh*
Photo of Schander .

Schander .

  • 21 Posts
  • 1 Reply Like
It seems I found one discrepancy after all...

A bunch of scrobbles (not exactly sure how many) of The Kovenant, have (I think) been added to Covenant, which was their old name. Two of their albums that were originally released under their old name, were later re-issued under their new name. This is why I have scrobbles for both of these albums, under both of their artist names.

I take it the system somehow auto-incorrected some of these plays? Can this be corrected somehow, or will I have to do this manually? Not a big deal, just thought you should know.
Photo of Schander .

Schander .

  • 21 Posts
  • 1 Reply Like
Now I also discovered an entry Kovenant in my charts, without the article... a tag under which I'm absolutely positive I never scrobbled anything, since it's false.

Could somebody get back to me on this? Before I start deleting loads of plays...
(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
Can you please link me to your library so I can take a closer look?
Photo of Schander .

Schander .

  • 21 Posts
  • 1 Reply Like
I think I know what happened...

I just put the CD's in the drive and noticed the artist tags were all messed up in WMP. It randomly attributes some songs to "Covenant" and others to "The Kovenant", and so fort. This is something I usually correct instantly, but since the website had been forcing the auto-correct all that time, it obfuscated the fact that it was scrobbling these tracks under an incorrect artist tag.

I guess I'll have to delete and re-scrobble these tracks manually... I mean, I don't suppose you guys can simply move scrobbles around?
Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
Not yet, but we're looking into introducing the possibly for subscribers to edit their past scrobbles.
Photo of Elliot Robinson

Elliot Robinson

  • 883 Posts
  • 2146 Reply Likes
YES PLEASE!
Photo of ClarenceD

ClarenceD

  • 10 Posts
  • 2 Reply Likes
I'm having trouble deleting a rogue scrobble. The track "Legend" by the artist Buddy—several scrobbles were deleted, but my library artist page (username: ClarenceD) is showing one remaining in October 2018, which, when I look through that month, I find no scrobble event for. The library track page shows no scrobbles, but the artist remains in my library. Looking for some assistance.
Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
Photo of Lucas Feitoza

Lucas Feitoza

  • 30 Posts
  • 27 Reply Likes
Same thing happening to me. I delete a scrobble and it still appears on my profile, but when I go to the track page it shows that I haven't listened to the track yet.



Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
What's your username Lucas? 
Photo of novsv92

novsv92

  • 7 Posts
  • 0 Reply Likes
Hello everyone!
I have a question. A few days ago I started a topic here https://getsatisfaction.com/lastfm/topics/incorrect-display-the-number-of-scrobbles-in-the-applicati...
At first the question was that a number of scrobbles on website and PC application is displayed differently. For example band "Turnover": 694 in application and 693 on website.





Next example, Limp Bizkit: 





And if I scrobble 1 Limp Bizkit's song, the number of scrobbles will grow on 1 song on application and website but it doesn't match anyway! Please read my post on link I posted above!

Next I noticed more inconsistencies: I selected to show me top albums of 365 days and here it is. First application than website. Pianos become the teeth and Kendrick Lamar doesn't match! But the othrs are ok here.






I tried to figure it out by myself and noticed more strange things. The National record. 708 and 712? Why? It was selected "overal". Kendrick Lamar is also displayed with a one song mistake.  





But it displays 708 anyway here...?



Excuse me for many screanshots but this problem is really annoying me. It happening because of new last fm data base and it will be fixed in future?

with regards!
looking forward to your reply and have a nice day!

Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
Hi, what is your username? 
Photo of novsv92

novsv92

  • 7 Posts
  • 0 Reply Likes
my username is dnimruoyeerf.
I guess the examples of inaccuracies I noticed above are not the only ones...I already noticed more of them on my page...
(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
These should be fixed for you now, but if you spot any further problems, please let us know.
Photo of novsv92

novsv92

  • 7 Posts
  • 0 Reply Likes
Yes, something has changed. Thank you! But I still see the difference in 1 Limp Bizkit song. Can you please fix it too like it worked with Turnover band?
Everything else look right now!
(Edited)
Photo of novsv92

novsv92

  • 7 Posts
  • 0 Reply Likes
Jon, sorry for bothering you again. I see you answering here to another people and may not notice my message. All problems are gone! Except difference with Limp Bizkit's 1 song. Can you please fix it too? 
You already did a lot for me! I noticed that multiple albums are connected to one now! I didn't even asked for this, thank you! 



(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
I can run it again to be sure, but it's just come to my attention that the last.fm api (and therefore both apps) are still using the old database currently.  Sorry for any confusion there.
Photo of novsv92

novsv92

  • 7 Posts
  • 0 Reply Likes
so as I understand this will be fixed with new database update someday?
Photo of Emma

Emma

  • 3 Posts
  • 1 Reply Like
I also have the same problem with deleting a particular scrobble/album (username: stereosoldiers). My library shows I only have 1 scrobble of Ellie Goulding yet two albums still appear. When I click on the track page for Anything Could Happen, it says I haven't listened to it yet



When I click on the Bright Lights album, it shows one scrobble of Under the Sheets which doesn't show in the initial library, it only appears when you click on the album. Clicking on the track page also says I haven't listened to it yet



I've tried deleting the artist from library, delete album (for both) and also tried scrobbling both songs again to see if it would somehow make the invisible scrobbles appear and then tried deleting again afterwards but nothing works.
(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
Hi Emma, we've run the consistency checker on your account, and the discrepancy should be fixed now (it should say that you have 0 Ellie Goulding scrobbles in all chart pages).
(Edited)
Photo of AJ Woods

AJ Woods

  • 7 Posts
  • 0 Reply Likes
Hi Jon,

Is there any chance I can get the consistency checker ran on my account? Awoodz92 I have multiple albums that are scrobbling incorrectly.
Photo of AJ Woods

AJ Woods

  • 7 Posts
  • 0 Reply Likes
Is there any chance I can get this consistency checker ran on my page? I commented with issues months ago and they still haven't been corrected.
Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
Hi AJ I can run this, but not while you're scrobbling.
Photo of AJ Woods

AJ Woods

  • 7 Posts
  • 0 Reply Likes
I'm off from scrobbling at the moment
Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
Thanks, I'm running it now.
Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
Should be done now.
Photo of AJ Woods

AJ Woods

  • 7 Posts
  • 0 Reply Likes
It looks like I have a bunch of split albums still.
Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
I explained this behaviour here and in more detail here.  The consistency checker won't fix that; I'm afraid you'll need to wait until we're able to do album corrections on the site.
(Edited)
Photo of Spacehog

Spacehog

  • 9 Posts
  • 0 Reply Likes
Hi Jon,
There is still a 10 plays difference with my scrobbler counter.
https://getsatisfaction.com/lastfm/topics/my-scrobbling-counter-is-broken

Shouldn't it be fixed with the new catalogue database?
My username is Spacehog.

Thanks

Photo of Spacehog

Spacehog

  • 9 Posts
  • 0 Reply Likes

Photo of Spacehog

Spacehog

  • 9 Posts
  • 0 Reply Likes
It seems the API is still pointing to the old database. Am I right?
Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
>>>It seems the API is still pointing to the old database. Am I right?

Yes that's correct, we'll be rolling the new database out to the api shortly.  You shouldn't be seeing this problem on the website though.
(Edited)
Photo of Spacehog

Spacehog

  • 9 Posts
  • 0 Reply Likes
Indeed the bug has been fixed on the website.
Photo of Spacehog

Spacehog

  • 9 Posts
  • 0 Reply Likes
It seems the API is now connected to the new database!
Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
Photo of Taishaku

Taishaku

  • 6 Posts
  • 1 Reply Like
So I found a temporary solution when scrobbling Japanese music through Spotify, which is to switch the language from English to Japanese on the desktop app (or going to Settings on your phone and switching the language). Tags will scrobble like they always did. The ugly part, is that if you want to scrobble Korean or Chinese artists, you'll have to switch to the language of the music you're listening to, otherwise it'll scrobble the incorrect tag most of the time.
Hope you guys fix this sometime soon.
(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
Kind of off topic, but rather than changing the language on your device, what I've started doing is scrobbling spotify via the chrome web scrobbler extension, because it lets you edit tags before you submit the scrobble (and it remembers the change for next time, which is extremely useful).  For this to work you need to have spotify's web player open in a background tab, but you can still play music through the desktop app.  You can also export the corrections you've made to a file, which you can then import to another browser.
Photo of Houndworld

Houndworld

  • 32 Posts
  • 87 Reply Likes
I have a problem with capitalisation. I have autocorrect turned off, but the capitalisation is still being altered on some artist names. For example, I recently scrobbled:

Graymatter -- has been changed to 'GrayMatteR'
Kramer -- has been changed to 'kRaMeR'

My old gripes with autocorrect are otherwise resolved now I can switch it off again (many thanks for this!) but this seems slightly odd.

Apologies if it's already been raised.
Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
To reduce storage space, scrobbles in the database are stored as ids not strings, and we use the casing from the catalogue instead.
Photo of Houndworld

Houndworld

  • 32 Posts
  • 87 Reply Likes
Ok, understood.

Having reported both of these with the incorrect capitalisation form a couple of days ago, I see now that they have been fixed. Thank you!
Photo of rafwuk

rafwuk

  • 7 Posts
  • 1 Reply Like
Any way to restore the Top Tracks sort order to alphabetical by track title? It has now changed to alphabetical by artist [first] name, and as I listen to whole albums this is not useful to me. Thanks.

Photo of guiguiae

guiguiae

  • 9 Posts
  • 2 Reply Likes
Same. We should have an option for how we want the order.
Photo of Maxim  'max Frostenberg' Morozov

Maxim 'max Frostenberg' Morozov

  • 6 Posts
  • 3 Reply Likes
Hello. About 3 months ago i wrote about problems with cyrillic tagnames (on Russian). Someone from your team ansered me that you will chceck this problem and answer me a little later . And now, I repeat, 3 months later. of course, i haven't answer yet. What can you tell mу about this now?
P.S i have correct tagname in music player. 

example of page with incorrect tagname https://www.last.fm/ru/music/+noredirect/%D0%94%D0%BC%D0%B8%D1%82%D1%80%D0%B8%D0%B9+%D0%9C%D0%B0%D0%BB%D0%B8%D0%BA%D0%BE%D0%B2/_/%D0%97%D0%BE%D0%BB%D0%BE%D1%82%D0%BE%D0%B9+%D0%A0%D0%B0%D1%81%D1%81%D0%B2%D0%B5%D1%82
my profile https://www.last.fm/ru/user/max-frostenberg
Autocorrection is off
(Edited)
Photo of Patrick

Patrick

  • 1235 Posts
  • 737 Reply Likes
Can anybody help me? It looks like I accidentally left Autograph (U.S.A.) in album tag and now almost 500 plays for the album that's the stuff merged into Autograph (U.S.A.). When I visit that page, I see my avatar in top listeners charts, but when I visit top listener's tab, I don't see which track I mostly listened from that album. All I see is a blank space.
Photo of Janderson Chagas

Janderson Chagas

  • 6 Posts
  • 0 Reply Likes
Since the new database, I’m having a lot of problems in my music profile... I’m trying to delete an album over a week and won’t work.

can someone solve my problem? all I wanna do is scrobbling my songs in peace

https://getsatisfaction.com/lastfm/to...
Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
Sorry about this, our engineers are aware of the problem and looking into it.  For more information please see: https://console.getsatisfaction.com/lastfm/conversations/scrobble-is-not-appearing-in-my-library
Photo of Janderson Chagas

Janderson Chagas

  • 6 Posts
  • 0 Reply Likes
I found a way to make “phantom scrobbles” didn’t showing up in my library, but I still can’t delete an particular album

Can you look it? Thanks https://www.last.fm/user/johnnyzest/l...
Photo of Jon

Jon, Community & Customer Services

  • 4705 Posts
  • 3510 Reply Likes
Our engineers are looking into this problem.
Photo of Matheus Rodrigues

Matheus Rodrigues

  • 1 Post
  • 0 Reply Likes
Just as Maxim 'max Frostenberg' Morozov, i'm having a big issue with Russian artists. I use Zero last.fm, so i can't fix the data in the website and this is turning a mess. Please, fix this issue <3