New Last.fm scrobbles database

  • 60
  • Announcement
  • Updated 3 weeks ago
  • (Edited)
Hi everyone,

We are beginning to roll out a new scrobbles database. This changes how we store your scrobbles - a big change for us, while to you most things will look the same :)

You will get the following improvements from this:

  • Support for corrections: You can enable and disable corrections properly, with your corrected or uncorrected scrobbles matching in all places

  • Album artists are correctly shown in album views (e.g. the album charts, instead of track artists)

  • Imported plays (e.g. from iTunes, when you first joined) are shown and counted correctly in all views

Please note, as we're gradually rolling out the update, not all of you can see these changes yet.

What you will see:

Your overall scrobble counts should always remain the same.

As a result of the above mentioned improvements, you might see changes to your artist, album and track counts, as well as to scrobble counts of artists, albums and tracks:

  • For example, if you've disabled corrections, your artist, album and track counts usually will go up, and otherwise corrected items will be split up in your charts.

  • Your Loved Tracks now properly support corrections, too. You might see that your Loved Tracks count has decreased when corrections are enabled, as duplicate versions of the same track will have been merged.

  • Where you've previously scrobbled the same album with the same album artist a number of times, you probably would have had these plays split up in your album charts, with the track artists being shown instead. This will now show one album entry, with the album artist as artist. When this happens, you will see a decreased albums count in your library.

  • This also fixes a problem where you could have seen the same album twice in your album charts, with different play counts.

What to do if you notice anything odd:

  • If artists (albums, tracks) have suddenly been split up in your library, check if you have corrections disabled - and if necessary, enable them.

  • If the overall scrobbles count in your library has changed - check if you have imported plays from your media player (when you joined Last.fm; feature available before 2015), these are counted correctly now. The overall scrobbles counts on your profile and in your library should now match.

  • If you notice any slowness in your library, charts or scrobblegraphs not loading - do let us know.

  • If you notice any scrobbles missing or too many - check if any of the above applies, and if not, do let us know.

  • If you have any trouble deleting an artist, album or track from your library - do let us know.

Did you know scrobbling is already turning 16 years old next week? It's been a big journey and our new scrobbles database sets us up for many more years to come. Thanks for scrobbling.

Lots of love,

Team Last.fm
Photo of Laura Last.fm

Laura Last.fm, Official Rep

  • 447 Posts
  • 365 Reply Likes

Posted 7 months ago

  • 60
Photo of EvanderTyson

EvanderTyson

  • 19 Posts
  • 16 Reply Likes
This reply was created from a merged topic originally titled Artist scrobble to wronge name.

There is problem with band ÖfÖ Am, when I listem them I see that they are scrobbled to https://www.last.fm/pl/music/%C3%96f%C3%B6+Am which is ok, but in my library I have this https://www.last.fm/pl/music/+noredirect/%C3%B6f%C3%B6+am
Why?


Photo of mickey

mickey

  • 24 Posts
  • 7 Reply Likes
Can you just change some things back to how they used to be? I dont understand the purpose of some of the changes that were made. For example, I understand that Ke$ha has changed to Kesha, but for the purposes of organization can you just keep all of her songs under Ke$ha, or all under Kesha? It doesnt make sense to have 2 seperate artists when its the same person. Same for Travis Scott, I think at this point it should just be kept to Travi$ Scott or just make everything Travis Scott. Also, for the next update can you make it so we can decide for ourselves how to organize our music? I think this would fix alot of the recurring issues people post on here. I have spent alot of time on this site trying to organize my music and with every new update comes more issues than solutions it seems. Maybe allow us to edit scrobbles or be able to fix album names so we can group all songs together? For example, if a song is released as a single before an album comes out, being able to edit these scrobbles so the total album plays are accurate? Just some ideas. This site is amazing byt these little bugs is making it extremely frustrating. The autocorrect option all together is just a mess!! 
Photo of Elliot Robinson

Elliot Robinson

  • 872 Posts
  • 2133 Reply Likes
Maybe allow us to edit scrobbles or be able to fix album names so we can group all songs together? For example, if a song is released as a single before an album comes out, being able to edit these scrobbles so the total album plays are accurate?
Seconded. I suspect, should it come to fruition, it'll be a subscriber benefit - I'd probably advise it, tbh, as it should help minimise abuse.
Photo of Jon

Jon, Community & Customer Services

  • 4515 Posts
  • 3381 Reply Likes
>>>Can you just change some things back to how they used to be?  I dont understand the purpose of some of the changes that were made.

Even though it did some things right (sort of), the old scrobble database was fundamentally broken and prevented us from fixing long term problems (like adding new catalogue corrections). This is why it was replaced.

>>>For example, I understand that Ke$ha has changed to Kesha, but for the purposes of organization can you just keep all of her songs under Ke$ha, or all under Kesha? It doesnt make sense to have 2 seperate artists when its the same person.

You're right, and we want to create a correction from Ke$ha to Kesha, but we can't do this yet because the last.fm catalogue in its current state doesn't support adding new catalogue corrections, or removing old/bad ones. Updating the scrobbles database was the first step in fixing this problem, the next step is to make changes to the catalogue to support adding / editing of corrections.  Once that's done your Kesha scrobbles will be fixed.
 
But for now, Kesha's old and new records are showing up under different names in your library.  Same with Travis Scott and any artist that has changed their name since mid 2015.  We're sorry for the inconvenience caused by this in the meantime, we are planning to fix this.

>>>Maybe allow us to edit scrobbles or be able to fix album names so we can group all songs together?

Yep, this is also in development.

>>> I suspect, should it come to fruition, it'll be a subscriber benefit - I'd probably advise it, tbh, as it should help minimise abuse.

Yes, I expect it will.
(Edited)
Photo of mickey

mickey

  • 24 Posts
  • 7 Reply Likes
Thank you so much for your response! I dont intend to sound rude when I post these, I just get really frustrated on here sometimes, im sorry! This site has soooo much potential to be amazing and it is amazing, but every once in a while something comes up that makes it so frustrating. Im glad to hear about the ability to make scrobble edits being in development, i think that will solve alot of problems! If we are able to manually edit an artists name or edit the spelling of scrobbles, that would absolutely fix just about every issue I have faced on here. I would not mind paying to use that service at all! 
Photo of Schander .

Schander .

  • 21 Posts
  • 1 Reply Like
Hi.

I'm not sure if this is related, but I've been encountering this issue regularly since the migration.

There seems to be a display error, where certain scrobbles don't get add up at one location, but do get add up at another location. Kinda hard to explain, but here's an example...

Track (6 plays):
https://www.last.fm/user/Schander/library/music/Dream+Theater/_/A+Nightmare+to+Remember

Album (5 plays):
https://www.last.fm/user/Schander/library/music/Dream+Theater/Black+Clouds+&+Silver+Linings

Artist chart (6 plays again):
https://www.last.fm/user/Schander/library/music/Dream+Theater/+tracks

I've checked all the tags, but that's not it. Most of the time it's simply a delay. After refreshing a couple of times, or rebooting the browser, it'll be corrected... but on some occasions (like the one above) it stays the same.

Is this a known issue affecting the entire website, or is it just me? If so, could that consistency checker thingy perhaps provide some further information?


(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4501 Posts
  • 3377 Reply Likes
Hi, yes this is a known issue which our team are currently trying to get to the bottom of.  For more info, please see: https://getsatisfaction.com/lastfm/topics/scrobble-is-not-appearing-in-my-library
Photo of Schander .

Schander .

  • 21 Posts
  • 1 Reply Like
Ah, thanks.
Photo of Schander .

Schander .

  • 21 Posts
  • 1 Reply Like
I've just deleted the latest play of the aforementioned track, to re-scrobble it... but it still refuses to be added up on the album-chart page, while other tracks are scrobbling just fine.

Am I correct to assume this bug seems to affect specific tracks only?
Photo of Ado7121

Ado7121

  • 16 Posts
  • 2 Reply Likes
I’ve just scrobbled two songs from Cartoon and on main page it shows my scrobbles but it is not counted in artist page. It shows that I don't have any scrobbles from Cartoon.
(Edited)
Photo of Ado7121

Ado7121

  • 16 Posts
  • 2 Reply Likes
Now it's working.
Photo of Andżej Żurawski

Andżej Żurawski

  • 1 Post
  • 0 Reply Likes
This reply was created from a merged topic originally titled Autocorrection reverse problem.

I've found that autocorrection of some music was reversed. 
For example: swietliki and Świetliki are obviously the same band, but are counted separatedly. Or Püdelsi and Pudelsi.
It is very strange, because it worked fine at least since 2010, it suddenly went wrong a couple of weeks ago. It is a bit problematic: my all-time ranking right now makes no sense.
Photo of mickey

mickey

  • 24 Posts
  • 7 Reply Likes
Suggestion: when a single comes out before an album is released, usually its not available to listen through the album or the album name is unknown. For example, "Shake it Off" by Taylor Swift came out months before 1989, and it was purchased / available for streaming through the single (Shake it off - Single). After the album came out, however, I listened to this song through the album (1989). My suggestion for a new update which I believe would benefit alot of people would be to allow us to change the name of the album, or artist or track or whatever, in order to make it all fit. That way, songs like Shake it off will not be divided up by the single and the album, and the # of album plays will be more accurate. Also, if we're allowed to edit the artist name we can fix the Kesha/Ke$ha issue and others like that.
Photo of fukker

fukker

  • 5 Posts
  • 0 Reply Likes
I noticed something strange yesterday, which might have with the new DB upgrade to do. When browsing my Motörhead library, I found that I had 148 scrobbles for the album Ace of Spades but for some reason I also had 37 scrobbles for the album Ace of Spades, although that last album seems to have 0 scrobbles and 0 listeners. I see that it seems to have been 'auto corrected' to the misspelt artist Motorhead. I have auto correction on but I guess that I sometime (2009-2010 according to stats) scrobbled the artist as Motorhead instead of Motörhead. It seems this has now been split, in a wrong way, although I have auto correction set to on.

Keep up the good work and I can't wait until some function gets implemented which let's me collect all my scrobbled (disc 1), (disc 2: Subcategory) etc. into some kind of collected 'release group' much in the same way as MusicBrainz works nowadays.
(Edited)
Photo of Darcie Marie Thurman

Darcie Marie Thurman

  • 2 Posts
  • 0 Reply Likes
I can't delete a few artists.
Photo of Jon

Jon, Community & Customer Services

  • 4612 Posts
  • 3445 Reply Likes
Hi, which artists are you trying to delete?  Can you link to your library please?
Photo of Darcie Marie Thurman

Darcie Marie Thurman

  • 2 Posts
  • 0 Reply Likes
I clear my scrobbles each time I see them. The scrobbles get cleared, but not all of the artists do. More get added each time I listen to my Spotify. Here's my big artist list: Coolio, Cosmo Sheldrake, Ella Mai, Eminem, Feist, Filter, Gorillaz, Hoobastank, Iron & Wine, Jessie Ware, John Popper, Lin-Manuel Miranda, Radiohead, Ryan Star, Shakira, Sublime, The Cardigans, The Judds, The Vines, The Weeknd, and Three Days Grace. https://www.last.fm/user/DarkBitterSea/library/artists
Photo of Jon

Jon, Community & Customer Services

  • 4612 Posts
  • 3445 Reply Likes
Thanks, this should now be fixed.
Photo of Jon

Jon, Community & Customer Services

  • 4623 Posts
  • 3454 Reply Likes
Official Response
Hi,

We've become aware of a a display issue with charts falling out of sync and not showing the correct scrobble count on some library pages.  Your actual scrobbles have not been affected, but you may see some inconsistencies in playcounts between different library pages.  For example, you might see that a track has 2 plays in your charts, but when you open the track page you only see one scrobble for the track.

Our engineers are aware of the problem and are working on a fix, which we expect will go out early next week.  Sorry for any inconvenience or concern caused by this in the meantime.

For more information, this problem is being tracked and discussed here.  
Photo of lovechrrymorgan

lovechrrymorgan

  • 1 Post
  • 0 Reply Likes
This reply was created from a merged topic originally titled Bug with merged artist tags splitting scrobble count in user chart.

https://www.last.fm/user/lovechrrymor...
The artist tag GFRIEND redirects to the above linked Korean language tag. I had my music tagged in my local library as GFRIEND for a long time and it automatically scrobbled under 여자친구. Eventually months ago I changed it to match the Korean tag 여자친구 so that a third-party app I use could display my playcounts correctly. Now I realized that even though GFRIEND redirects to the Korean, my plays for the exact same song and album show up separately, as you can see in my profile above, for example the album “Snowflake” appears twice so my charts are all messed up. Is this fixable as a bug? I’m sure the same thing happened for other artists on my profile too which have merged tags.
Photo of Jon

Jon, Community & Customer Services

  • 4515 Posts
  • 3381 Reply Likes
Ok this took  me a while to get my head around, but I think I understand it now.  It's because of this behaviour described in detail in my post above, however I didn't realise it applied to albums as well.  

If you've scrobbled both spellings of an artist that's been corrected to another artist, and the album you're scrobbling hasn't been corrected to the right artist spelling in the catalogue yet (in other words, it was released after the site relaunch in 2015 when we froze the corrections dataset), then you'll see the album twice under the corrected artist name.   

For example, you can reproduce the problem by manually scrobbling the following with universal scrobbler:

Artist: Radiohead
Track: Test track
Album: Test Album A
---
Artist: Radiohae
Track: Test track
Album: Test Album A


You'll end up with 2 albums called 'Test Album A', and 2 tracks called 'test track' in your library under Radiohead:

e.g. https://www.last.fm/user/Lastfmsupport/library/music/Radiohead

It happens because we have an artist correction from Radiohaed to Radiohead, but Test Album A and test track are new to the catalogue so the artist correction hasn't been applied to them.  This will be fixed when we're able to update the corrections dataset again, which will then propagate the artist correction to these newer albums and tracks (and the same for your GFRIEND scrobbles).  Sorry it looks a bit messy for now.
(Edited)
Photo of decrepitude

decrepitude

  • 2 Posts
  • 0 Reply Likes
Hello, I follow an account with 10 years of scrobbles who haven't scrobbled since 2015, and his library was normal but when this update started it's auto-correction has been automatically turned off and the owner probably won't turn on the auto-correction himself, so if I give you the name of the account could you put back the auto-correction on it's library please ? Sorry I'm not very good at english.
Photo of James L.

James L.

  • 182 Posts
  • 486 Reply Likes
Been having trouble with scrobbling Animal Collective's "Keep" properly.

It's an EP that features one song by each member of the band. However, it's been very glitchy lately as it's not scrobbling properly under each artists name.

For example, The Preakness is written by Panda Bear, but when I listen to it it changes to Animal Collective but also shows I listened under Panda Bear. It's very confusing.

https://www.last.fm/user/hashtagbluejay/library/music/Panda+Bear/_/The+Preakness
https://www.last.fm/user/hashtagbluejay/library/music/Panda+Bear/KEEP

https://www.last.fm/user/hashtagbluejay/library/music/Animal+Collective/Keep


Photo of Jon

Jon, Community & Customer Services

  • 4616 Posts
  • 3450 Reply Likes
Hi James, are you scrobbling this EP from your local mp3 collection or a streaming service?  If local, can you tell me what the id3 tags look like for this track  -- e.g. Artist, album artist, title, album.  If you're using a streaming service, can you tell me which one and what you're using to scrobble it?  Thanks.
Photo of James L.

James L.

  • 182 Posts
  • 486 Reply Likes
I use foobar2000, and I saved the album artist under "animal collective" to make it more organized. I've said things as the album artist before where it didn't scrobble under that name. Is that why this is happening?
Photo of Jon

Jon, Community & Customer Services

  • 4616 Posts
  • 3450 Reply Likes
Ok, this is the normal / expected behaviour, and is what the website used to do until the site was relaunched in late 2015.  As Laura mentioned in her original post, album artists are now shown in album views, such as your top albums in your library. 

Basically: the track artist (artist name in foobar) is the artist that the track will actually be scrobbled under, and will count towards that artist's plays in your library.  The album artist is mainly used to organise soundtracks and compilations, and is what will show on your album chart here: https://www.last.fm/user/hashtagbluejay/library/albums (Keep is on page 17).  We do it this way so that soundtracks are counted properly in your charts, and are not split up across multiple tracks / artists (which is what the website started doing from late 2015 due to a bug).

So what you should see is that the individual tracks are scrobbled under each artist's name (i.e. Avey Tare and Panda Bear) on Recent Tracks, and these will count towards your plays for Avey Tare and Panda Bear respectively on your Top Artists chart, because those are the actual artists you scrobbled.

https://www.last.fm/user/hashtagbluejay/library/music/Avey+Tare/_/Call+Home+(Buy+Grapes)
https://www.last.fm/user/hashtagbluejay/library/music/Panda+Bear/_/The+Preakness

However, the album itself will be listed under Animal Collective in your album charts, because you've set Animal Collective as the album artist.  You can see this here:  

https://www.last.fm/user/hashtagbluejay/library/albums?page=17
https://www.last.fm/user/hashtagbluejay/library/music/Animal+Collective/Keep

Note that this won't actually count towards your plays for Animal Collective, because Animal Collective aren't the tracks' artists -- in the same way that the band "Various Artists" should never be counted on compilation releases (because then you might end up with 'Various Artists' as your top artist). 

If you look carefully, you might have noticed that the number of scrobbles on this page doesn't match the count on the individual track pages.  This is because in 2016 you scrobbled these tracks 5-6 times without the "Animal Collective" album artist tag, so the album was attributed to Avey Tare and Panda Bear instead.

https://www.last.fm/user/hashtagbluejay/library/music/Avey+Tare/Keep
https://www.last.fm/user/hashtagbluejay/library/music/Panda+Bear/KEEP

So, the website is doing the correct thing, the question is whether you want to leave your mp3s tagged as Animal Collective, change them to Various Artists, or remove the album artist tag completely (so the album is attributed to each artist).  It's really up to you, but my inclination would be to leave it tagged as Animal Collective, since it's technically still an EP by them, and that ensures that it gets listed under their page in your library: https://www.last.fm/user/hashtagbluejay/library/music/Animal+Collective/+albums as well as your overall album chart: https://www.last.fm/user/hashtagbluejay/library/albums
(Edited)
Photo of Sumer

Sumer

  • 12 Posts
  • 5 Reply Likes
When are you going to fix iPod scrobbling?
Photo of rndm

rndm

  • 3 Posts
  • 5 Reply Likes
Any ETA on when you'll fix the auto correction database? It's been months now and pretty much all of my Asian artist scrobbles are still completely broken and split between their original names and the romanizations. This happened after you launched your new database.