New Last.fm scrobbles database

  • 60
  • Announcement
  • Updated 4 weeks ago
  • (Edited)
Hi everyone,

We are beginning to roll out a new scrobbles database. This changes how we store your scrobbles - a big change for us, while to you most things will look the same :)

You will get the following improvements from this:

  • Support for corrections: You can enable and disable corrections properly, with your corrected or uncorrected scrobbles matching in all places

  • Album artists are correctly shown in album views (e.g. the album charts, instead of track artists)

  • Imported plays (e.g. from iTunes, when you first joined) are shown and counted correctly in all views

Please note, as we're gradually rolling out the update, not all of you can see these changes yet.

What you will see:

Your overall scrobble counts should always remain the same.

As a result of the above mentioned improvements, you might see changes to your artist, album and track counts, as well as to scrobble counts of artists, albums and tracks:

  • For example, if you've disabled corrections, your artist, album and track counts usually will go up, and otherwise corrected items will be split up in your charts.

  • Your Loved Tracks now properly support corrections, too. You might see that your Loved Tracks count has decreased when corrections are enabled, as duplicate versions of the same track will have been merged.

  • Where you've previously scrobbled the same album with the same album artist a number of times, you probably would have had these plays split up in your album charts, with the track artists being shown instead. This will now show one album entry, with the album artist as artist. When this happens, you will see a decreased albums count in your library.

  • This also fixes a problem where you could have seen the same album twice in your album charts, with different play counts.

What to do if you notice anything odd:

  • If artists (albums, tracks) have suddenly been split up in your library, check if you have corrections disabled - and if necessary, enable them.

  • If the overall scrobbles count in your library has changed - check if you have imported plays from your media player (when you joined Last.fm; feature available before 2015), these are counted correctly now. The overall scrobbles counts on your profile and in your library should now match.

  • If you notice any slowness in your library, charts or scrobblegraphs not loading - do let us know.

  • If you notice any scrobbles missing or too many - check if any of the above applies, and if not, do let us know.

  • If you have any trouble deleting an artist, album or track from your library - do let us know.

Did you know scrobbling is already turning 16 years old next week? It's been a big journey and our new scrobbles database sets us up for many more years to come. Thanks for scrobbling.

Lots of love,

Team Last.fm
Photo of Laura Last.fm

Laura Last.fm, Official Rep

  • 447 Posts
  • 365 Reply Likes

Posted 7 months ago

  • 60
Photo of Ashley Smith

Ashley Smith

  • 3 Posts
  • 1 Reply Like
I have a similar problem.  I scrobble from Spotify and WMP.  In WMP, my catalogue is grouped by surname of the artist, which is different from Spotify.  Thus, scrobbling the same album from these 2 different sources, now results in the scrobbles being divided into 2 artists, so I cannot go to artists and see the total albums I have scrobbled by that artist. Similarly, my album list has been divided, as an album from the same artist (eg. Ryley Walker) now sits under Walker, Ryley and Ryley Walker.  So, rather than seeing 60 scrobbles for Primrose Green, I have X30 scrobbles for Primrose Green for Walker, Ryley and 30 for Primrose Green for Ryley Walker.  Hence my top albums have been thrown out considerably for male or female artists.  It also means the album art for Walker, Ryley needs to be added...a lot more work and less organization.  Is there an ability to merge these artists?  Every one of my male and female artists now needs merging (if I listened to the same album from 2 different sources - Spotify and WMP for example). The track count is consistent however.  Auto correction does not change this album artist problem.  PTMuso is my username.
Photo of Ashley Smith

Ashley Smith

  • 3 Posts
  • 1 Reply Like
Will it be possible to merge artists?  Common artists e.g. Van Morrison are recognized if the metadata for the artist is Morrison, Van or Van Morrison.  However, artists as above end up being spread between 2 artists:
https://www.last.fm/user/PTMuso/library/music/Ryley+Walker
https://www.last.fm/user/PTMuso/library/music/Walker,+Ryley with all the tracks being ascribed to Ryley Walker.  The issue relates to my cataloguing artists alphabetically by their surname.  
The ability to merge albums to the one artist would help fix this issue.  Thus, my album list is not accurate as this album for example is applied to 2 separate artists.
Thanks!
Photo of Adylise Skylar Larkyn

Adylise Skylar Larkyn

  • 35 Posts
  • 35 Reply Likes
I'm sure this is by design and is working as intended, but I wonder if something will be done about artists that sometimes use "&" instead of "and"? For instance:

https://www.last.fm/music/+noredirect/Nick+Cave+and+the+Bad+Seeds

https://www.last.fm/music/Nick+Cave+&+The+Bad+Seeds

For all intents and purposes, these two are the exact same artist, but have two separate pages due to auto correction. One page has tons of comments, and the other has none. So I guess I wonder if anything can be done or if something will be done. I'm not sure what the solution would be, other than using auto correction, but these pages being merged with maybe "alternate spellings" being listed could be an idea maybe for artists that have several different spellings or accents.

Another instance would be this:

https://www.last.fm/music/Einst%C3%BCrzende+Neubauten

https://www.last.fm/music/+noredirect/Einsturzende+Neubauten

Having someway to acknowledge that these two artist pages are for the exact same artist and listing all of the comments and stats on a single page would be helpful. Again, not sure what the optimal solution would be.

Photo of cptchi

cptchi

  • 134 Posts
  • 180 Reply Likes
They would need to add redirections to those artists and with autocorrection they would be redirected but Last.fm isn't accepting new ones atm.
(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
I'm sorry, but I don't understand your feedback.  There's already a correction from 'Nick Cave and the Bad Seeds' to 'Nick Cave & The Bad Seeds'.  That's why their stats are merged and there's '+noredirect' in the url of the corrected artist.  Same for Einstürzende Neubauten.
(Edited)
Photo of Fuuuser

Fuuuser

  • 3 Posts
  • 0 Reply Likes
My Top Albums doesn't fit to my real scrobbles from Spotify, it's been like thise for a few days... it seems that it doesn't work at all and deleted all my albums data...






Is it normal? Thanks for your work.
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Can you tell me your username please?
Photo of Fuuuser

Fuuuser

  • 3 Posts
  • 0 Reply Likes
'Fuuuser', but it seems to be ok now. Thanks.
Photo of dancingmongoose

dancingmongoose

  • 77 Posts
  • 43 Reply Likes
This is such great news, glad that we can finally see some progress
Photo of ncam

ncam

  • 4 Posts
  • 2 Reply Likes
So great to see the last.fm team making progress on the database!

Since the rollout, I noticed that my old account (used 2011 - 2015) has stopped displaying albums in the library. There are only 19 albums being displayed but there should be hundreds. Please see here:

https://www.last.fm/user/LCNikita/library/albums

Please let me know if you figure out why this is happening. 

In case you are wondering, I do continue to use the platform on a new account since 2018. I'm very excited to finally see some updates!
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Yep, sorry about that, this is a bug that a number of people have encountered.  One of our shards wasn't imported to the new database correctly -- we're in the process of fixing this now.
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Should be fixed for you now. :)
Photo of TinySparrows

TinySparrows

  • 3 Posts
  • 1 Reply Like
So I didn't realize there was a new database that was affecting a bunch of the albums and artists and I deleted a couple before coming here.

My profile: https://www.last.fm/user/TinySparrows

The issues I had were with Utada Hikaru (宇多田ヒカル) and other asian artists' albums being displayed properly. I deleted the Utada Hikaru issues (kinda wish I could undelete them), but her album Fantôme was showing her English name rather than her Japanese name, even with corrections on; also, I had a number of scrobbles of that album that were incorrectly spelled Fantome, even though I've only listened to the album through Spotify. For Daichi Miura, A-mei Chang, and Will Pan, all three artists I've listened to some tracks from and their scrobbles are displaying their English names and not their names in Asian characters. I think it might be affecting other Asian artists I might have listened to, but I only looked over the first couple of pages to get an idea.

For all of these issues, the artist link appears to redirect correctly to the artist's page, but when I click on the album or song link, it redirects to an empty album/song page.

I am assuming that with the new scrobbles database, it broke some of the corrections for Asian artists, albums, and songs, but there should be a fix soon?
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Ah, that sucks that you deleted them.

I think the issue you're seeing is the same that Shyames posted about on Friday:

https://getsatisfaction.com/lastfm/topics/new-last-fm-scrobbles-database?topic-reply-list[settings][...

Please see my reply there for an explanation of what you're seeing.  It will be fixed when we can add new corrections to the site.

You'll most likely see this problem with:
  • Artists where we have a redirection in place to redirect the English spelling of their name to their own language (e.g. Utada Hikaru -> 宇多田ヒカル ); and they have
  • Released new music since mid 2015 (like Fantôme, i.e. tracks that weren't in the Last.fm catalogue before we relaunched the website); which you've
  • Scrobbled via Spotify, using the English spelling of their name.  
This is because the corrections dataset is static and can't be edited, which means we can't map existing artist corrections to their new tracks yet -- as soon as we're able to do this, this problem will fix itself.
(Edited)
Photo of mickey

mickey

  • 24 Posts
  • 7 Reply Likes
This reply was created from a merged topic originally titled Everything is messed up all of a sudden.

Went on my last.fm this morning and all of my songs are messed up. All of my playcounts are messed up, all added like 500 plays out of nowhere. Really annoyed because I paid for a universal scrobbler subscription and spent days importing all of my songs. I enjoy this site and use it all the time, which is why I am very irritated. Someone help please! 
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Hi mickey, can you please tell us your Last.fm username and link us to some specific examples in your library where things aren't displaying as you expect.  Also can you please let us know if you have auto-corrections enabled or disabled in your website settings.  
Photo of mickey

mickey

  • 24 Posts
  • 7 Reply Likes
Mickss16
I have it disabled now
If you look at my songs many of them are now in the 1000s when the most any of them had was like 700. They just randomly added hundreds of scrobbles.
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Thanks, I've asked our development team to investigate.
(Edited)
Photo of reagan0

reagan0

  • 19 Posts
  • 0 Reply Likes
This reply was created from a merged topic originally titled Sudden unexplained 10K increase in scrobble count!.

This afternoon, as I was preparing to leave work, I pulled out the Last.fm web page that I had minimized in the taskbar to check the revised total play count for the day. I reloaded the page, and noticed that the grand total play count jumped by more than 10,000! Now, I know I didn't listen to that many tracks in one month, let alone one workday. I began looking around the site, and adding up the play counts from the various categories. I cannot find the extra 10K scrobbles -- anywhere.

I know there's a discrepancy in the statistics, but I had already taken that into account before I reloaded the page. This was an instantaneous addition of 10,000+ scrobbles.

Any idea what is going on -- and even more importantly -- how I can locate the additional scrobbles and correct the problem?

I was using WMP on Windows 10, at the time. And it occurred around 7:00PM Central Standard Time (U.S.). I think the number of artists in my library also jumped by about 33, but I can't be sure, as I wasn't looking at that statistic when I reloaded the page. I think it said 1054, now it says 1087.

When I look at the stats using either of my smartphones (personal (LG Stylo 4) and company provided (iPhone 6)), they both report the same play counts. This is the first time I've seen anything like this, and I am surprised, befuddled and flummoxed even.
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Hi, what's your username?  
Photo of reagan0

reagan0

  • 19 Posts
  • 0 Reply Likes
Photo of reagan0

reagan0

  • 19 Posts
  • 0 Reply Likes
I think I found the extra scrobbles last night. I listed all the tracks I've played, went to the earliest tracks on the list (the last page), and found a lot of tracks without scrobble dates. They appear to be grouped by track. I'm not sure what order they're in. But, if they don't have play dates, that would explain why they don't show up in charts that are date-dependent. I haven't checked to see if they're showing up in my artists or albums charts. I'll look at that later today, when I have more time.

Since my account has always included scrobbles from the initial library scan, these can only be duplicates. What would happen if I deleted them? (It will be a long laborious process, I know.)
Photo of reagan0

reagan0

  • 19 Posts
  • 0 Reply Likes
BTW, I had 1052 artists before the great conflagration, not 1054. I still had my profile page open on a computer at home, from the day before. Now, I have 1087.
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
I'm looking at your profile now and I'm only seeing a difference of a few hundred scrobbles (75,777 vs 75,480) - did you delete some?   

The scrobbles without timestamps would be your bootstrap scrobbles, from when you imported playcounts from your media player.  Prior to the new database, the website didn't display or count these correctly in your library (compare https://www.last.fm/user/reagan0/library with https://www.last.fm/user/reagan0 in an incognito / private window).  Differences in artist counts can be explained by artist corrections changes explained in Laura's post above.
(Edited)
Photo of reagan0

reagan0

  • 19 Posts
  • 0 Reply Likes
The difference that you see now, (75,777 vs 75,480) has actually been around for several years. That difference is due to my correcting artist/album/track data, but not finding and deleting all of the incorrect data. (Sometimes that's easier said than done.) The difference that I was referring to was the overall play count before the DB correction vs the overall play count after the DB correction. The only way to see that number, now, is to add up all the play counts for the years I've had an account. To do that look at the "https://www.last.fm/user/reagan0/library/artists?date_preset=ALL" page, and add up the "Listening History" yearly graph data. That's how and why I figured that the discrepancy is date dependent. Right now, the difference is 75,818 vs 65,412. Both numbers progress as I listen to more tracks.

Thanks.
Photo of Mi

Mi

  • 1 Post
  • 0 Reply Likes
This reply was created from a merged topic originally titled Scrobbles moved to another album.

I had 16 scrobbles from a song marked in it's original release album: totalizing 148 scrobbles with the other songs from the album, but yesterday I noticed that suddenly 12 of these scrobbles from this certain song is now marked on a live version of the same singer. The scrobbles from this song just changed to another album  and these scrobbles are from May!
Now the album is marking 136 scrobbles... Well, I will listen to this song again, of course, so eventually the album will recover it's original scrobbles but I'm concerned about it, if it keeps happening I will have to abandon the site. But my question is: Has it happened to someboy else? 
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Hi we're testing a new scrobble database which fixes a number of problems with user libraries.  For details on the changes you will see, please read Laura's post here.

If you think something looks wrong, can you please let us know your Last.fm username, and link to specific examples in your library and describe how they differ to what you're expecting to see.  Thanks.
Photo of Drynwhyl

Drynwhyl

  • 127 Posts
  • 163 Reply Likes
Thanks so much guys! Incredible update. I was especially ecstatic to read this bit:

"Imported plays (e.g. from iTunes, when you first joined) are shown and counted correctly in all views".


However, this isn't taking effect in my library:


That "Unknown date" is 48 imported plays all rolled into one. This one is just an example, the unknowns dates still make up 50% or so of my library. Can I please get confirmation if i'm one of those users who will benefit from this update? :)
(Edited)
Photo of R.J.Edwards

R.J.Edwards

  • 2 Posts
  • 0 Reply Likes
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Thanks for reporting, this has been flagged with the development team to investigate.

I think the scrobbles have been deleted from your library (e.g. https://www.last.fm/user/IJWMFTT/library/music/Tears+for+Fears/_/Everybody+Wants+to+Rule+the+World+(...) , but it looks like some pages in the library are still counting them.
Photo of Cornel Diaconu

Cornel Diaconu

  • 750 Posts
  • 318 Reply Likes
I overlooked news from getsat, and I just now saw this thread...

I guess I'm not on any test group :-)
For me, at this moment, those problems I had with scrobbles that can not be deleted (as I wrote on this thread: https://getsatisfaction.com/lastfm/topics/deleted-scrobbles-keep-coming-back-in-my-library-over-and-... -- not only the ones mentioned in the first posts, but the whole list I compiled with problem scrobbles, about 85 songs, as mentioned in my last post there) are still with me now; I just tried to see if removing some of them work, and no, it doesn't.

Is it reasonable to dream of the new database to be 100% implemented for all users at Christmas time ? Or rather it will be someday in January next year ? (this I presume will finally help me with deleting whose scrobbles I came to hate in the meantine :-) )




Photo of Alisson Farias

Alisson Farias

  • 1 Post
  • 1 Reply Like
When will this work for my account?  My username is: alissonfariias
Photo of missme

missme

  • 7 Posts
  • 0 Reply Likes
Hi, thanks for updates,but some issues occurred with my account.i’ve lost ~300 artists from my library,scrobbles overview still the same.autocorrections disabled. https://www.last.fm/user/missMinny
Photo of Jon

Jon, Community & Customer Services

  • 4612 Posts
  • 3445 Reply Likes
On the old database your account shows 86,389 scrobbles, 11,096 artists, and 200 loved tracks.  On the new, it shows: 86,389 scrobbles, 11,356 artists, and 200 loved tracks.  So your artists have actually gone up? (which is expected with corrections turned off).
Photo of missme

missme

  • 7 Posts
  • 0 Reply Likes
Something weird.my corrections turned off since I found this feature (long time ago).thats what I saw yesterday and what I see now
(Edited)
Photo of missme

missme

  • 7 Posts
  • 0 Reply Likes
Before I login it shows my actual artists~11,347 (so this is real numbers ,google cash knows) ,after ~ 11,098 therefore it looks like db change places in my account
(Edited)
Photo of missme

missme

  • 7 Posts
  • 0 Reply Likes
Could you please answer,will I have my artists back in my account?is it just temporary problems because of rollout or what? Thnx in advance
(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4612 Posts
  • 3445 Reply Likes
That's strange, I'm looking at your page now, and it definitely says 11,360 artists both logged in and out (with corrections off).  Please monitor it over the weekend and if it continues to change, let me know and I'll ask our developers to look into this for you.
Photo of missme

missme

  • 7 Posts
  • 0 Reply Likes
This problem still exists and looks permanent. after login last fm shows my artists 11,100,log out and voila they are 11,360.i’ve checked it on various pc’s,iOS , diff browsers.last fm scrobbler shows artists how 11,100. I would appreciate it, if you could fix it somehow
(Edited)
Photo of missme

missme

  • 7 Posts
  • 0 Reply Likes
What should we do in order to get stuff attention to this issues about log in/off different numbers ?its just irritating and makes using last fm uncertain...
(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4612 Posts
  • 3445 Reply Likes
Sorry for the late reply.  At the time of writing, 11,435 is the correct number, and is what the new database shows.  11,173 is what the old database has, which is wrong because it's not handling your "corrections off" setting properly (i.e. it's correcting artist spellings, hence the number is smaller).

The reason they're mixed up (i.e. you're seeing the smaller number logged in), is because your account is not set to see the new database yet, and won't until we roll this out to 90% of users.  However, there's a 50% chance for logged out users to view the new database, as we're testing performance on visitors as well as logged in users -- that's why you're seeing the correct number logged out.  

Sorry for the confusion, this will be fixed for you when we roll this out to 90% of users.
Photo of missme

missme

  • 7 Posts
  • 0 Reply Likes
Thank you for the answer.i thought about this inconsistencies the same way.hope new db fix it
Photo of Drynwhyl

Drynwhyl

  • 127 Posts
  • 163 Reply Likes
Update: I checked now and the imported plays are all split individually according to the playcount. Although they're still not being counted in date-dependent charts (like the graphs in library) since they have no timestamps attached to them.

My guess is that the old last.fm importer imported only the playcounts for each song and not the timestamps, so this is no fault of this update.

Still, in my case this is a huge improvement over how it was before, thanks again guys!
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Yes, that's by design.  Those scrobbles don't have a timestamp (and thus can't appear in date-based charts) because back in the day they were imported from you media player when you first joined last.fm.  We call them bootstraps because the idea was to bootstrap your account with artists and plays so that you can get recommendations radio right away.  However they weren't actually imported as 'true' scrobbles (with a timestamp), and were stored separately from your actual scrobble data -- a decision that has caused us quite a few problems since. 

So what we've done with this update is convert them into 'real' scrobbles (albeit without a timestamp still), which means the library can correctly display and count them (previously it wouldn't, resulting in a difference in your overall playcount between your profile page and library), and you can manage them like normal scrobbles (e.g. delete them).

The other way you can end up with scrobbles with an unknown date is if you signed up before 2005, which is before we started storing timestamps.
Photo of Drynwhyl

Drynwhyl

  • 127 Posts
  • 163 Reply Likes
Thank you for shedding some light on the matter, Jon. I did know a few things here and there about bootstraps but didn't know they were handled and stored differently.

Actually, this update might have solved another bug (since the system has now begun counting them as real scrobbles like you've said) that causes songs, artists and albums in your library that had only imported plays (bootstraps) to appear as new discoveries in the weekly chart if you re-listen to them again.

The only issue I have now is that the new update seems to be playing hide and seek with me. Makes my library switch in and out of the new database. Kind of funny.
(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
>>>The only issue I have now is that the new update seems to be playing hide and seek with me. Makes my library switch in and out of the new database. Kind of funny.

Are you sure you're logged in?  Can you maybe describe this behaviour in more detail?  It shouldn't be fluctuating. 
Photo of Drynwhyl

Drynwhyl

  • 127 Posts
  • 163 Reply Likes
It's a pattern I've noticed since the update was rolled out for my account 3 days ago. It's like It's being switched "On" and "Off" several times a day, that's how I would describe it. No specific triggers.

ON: I would visit my profile in the morning (logged in or logged out, tried both scenarios) and the update is "On", I could tell by Artists-count being up by 2 since I have auto-corrections always switched off + with new database still intact.

Off: Later in the day or maybe even an hour later, another visit to my profile and the update is "Off", Artists-count is down by 2 + most of the new improvements are gone; Album views in the charts are back to using the track artist and not the album artist. The view for imported plays has reverted to the old one; all rolled up in one 'Unknown date' scrobble representing the entire playcount.

Sometimes though not often, after I've visited my profile while I'm logged out, I'd see that the update is "ON" but then immediately after I log in it turns itself off. Other times it'll "stay put".

Mind you, this was all observed while in Incognito mode, which is primarily how I browse last.fm. So it's not a cookie issue.
(Edited)
Photo of tapenoon

tapenoon

  • 141 Posts
  • 230 Reply Likes
Jon, something is definitely wrong with my account too. I've been monitoring it over the weekend and have taken some (OK, a lot) screengrabs I thought I'd post today because it fluctuates so much it's beginning to worry me a bit. they are below (please note it makes no difference whether I am logged in or out; I have cleared my browser cookies (in case it was a cookie issue) but it made no difference and I only use Safari; I have auto-correction turned off.)
nov. 24 at 5:34am: 
nov. 24 at 7:45am:
nov. 24 at 8:21am (logged-in): 
nov. 26 at 3:20am: 
nov. 26 at 3:40am: 
nov. 26 at 5:33am:
Photo of tapenoon

tapenoon

  • 141 Posts
  • 230 Reply Likes
this is still happening. can I get an answer please?
Photo of untutorable

untutorable

  • 2 Posts
  • 0 Reply Likes
any update on being able to remove tracks/artists that have only been scrobbled on an "unknown date?" it just makes my library messy and i would really just rather have those scrobbles deleted.
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Typically these are plays you imported from your media player when you first joined last.fm (called bootstrap scrobbles), and scrobbles from before 2005 when we started logging timestamps (if you joined before then).  

You can view and delete these with the new database, if you want.
Photo of untutorable

untutorable

  • 2 Posts
  • 0 Reply Likes
thanks so much for the reply! as always, i'm looking forward to seeing last.fm improve even more in the future. 
Photo of Raphael Oliveira

Raphael Oliveira

  • 2 Posts
  • 1 Reply Like
This reply was created from a merged topic originally titled Auto-correct is not working properly.

It is working only for the "Artist" section ):
The "Recent Tracks" and "Top Albums" sections are not considering names that were always merged.

https://www.last.fm/user/vernonchwe1


Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
I've answered this in more detail here and here.

To prevent a whole host of problems (e.g. not being able to delete tracks), corrections in your library now correctly match corrections in the Last.fm catalogue (before they used two separate datasets and were out of sync, which caused huge problems).

e.g. You can see there's no correction from https://www.last.fm/music/GFRIEND/_/Sunny+Summer to https://www.last.fm/music/%EC%97%AC%EC%9E%90%EC%B9%9C%EA%B5%AC/_/Sunny+Summer, so likewise these tracks won't be corrected in your library either.  Same with the Jun.K tracks.

That's because the catalogue corrections dataset is static and can't be edited (yet), which means we can't map existing artist corrections to their new tracks yet -- as soon as we're able to do this, this problem will fix itself.  Unfortunately for now it'll look a bit weird for these artists, as their newer releases will display their english names (but should count under the correct name in hangeul, as your example shows).
(Edited)
Photo of Alexander Smith

Alexander Smith

  • 5 Posts
  • 1 Reply Like
This has caused a bug where split albums and compilations that have a separate Album Artist tag aren't showing up in the total scrobbles for the artist, making them essentially worthless.

So if something is scrobbled with the Album Artist tag as "Artist 1 & Artist 2" but the tracks by separate artists, they don't show up for either artist OR the Album Artist as no songs are actually scrobbled with that artist tag.

This means I've totally lost a lot of scrobbles by artist with many compilation tracks, split LP tracks etc.

Can anything be done about this?
Photo of Alexander Smith

Alexander Smith

  • 5 Posts
  • 1 Reply Like
Here's an example:

The split album, only viewable by browsing albums in my library now: https://www.last.fm/music/Capers+&+Arkhe/Detta+%C3%84r+Inte+Spel+Det+%C3%84r+Mord

Library page for the AA that the album was scrobbled with (note 1 album, 0 scrobbles): https://www.last.fm/user/lnqdty/library/music/Capers+&+Arkhe

Library page for one of the artists from the split (2 tracks, one from another compilation, 0 albums): https://www.last.fm/user/lnqdty/library/music/Capers+&+Arkhe

I don't see why tracks from compilations/splits with separate AAs don't show up for the respective artists on that album?



Photo of Lars Jansson

Lars Jansson

  • 123 Posts
  • 80 Reply Likes
It ́s not a question if last fm can do something about this. They have to. They can ́t keep destroying there service, every major update. They ́ll have
 to back now!
(Edited)
Photo of Alexander Smith

Alexander Smith

  • 5 Posts
  • 1 Reply Like
It seems like instead of making the Album Artist tag useful they've forced it to be exactly the same as the Artist tag and made it useless, as a hacky way to do user library corrections.
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
To clarify, if you scrobble:

- Album artist: Various artists
- Track artist: Test Artist
- Album: Test Album
- Track: Test Track

Like so: https://www.last.fm/user/Lastfmsupport/library?rangetype=1day&from=2018-11-23

You should see the following:

Artist charts: Scrobbles count towards the individual Track artist's ranking in your artist chart:
https://www.last.fm/user/Lastfmsupport/library/artists?from=2018-11-23&rangetype=1day

Album charts: Scrobbles count towards the album artist and album's ranking in your artist chart:
https://www.last.fm/user/Lastfmsupport/library/albums?rangetype=1day&from=2018-11-23

Track charts: Scrobbles count towards the track artist and track ranking:
https://www.last.fm/user/Lastfmsupport/library/tracks?rangetype=1day&from=2018-11-23

On the artist page, it should show the tracks the artist contributed on.
https://www.last.fm/user/Lastfmsupport/library/music/Test+Artist?rangetype=1day&from=2018-11-23

On various artists, it should show the albums you've scrobbled, however there's a currently bug where it doesn't show the albums (note how it says 1 album, but doesn't display anything, that's wrong).  We'll be fixing this soon (this is likely the issue with https://www.last.fm/user/lnqdty/library/music/Capers+&+Arkhe).
https://www.last.fm/user/Lastfmsupport/library/music/Various+Artists?from=2018-11-23&rangetype=1...

On the album page, it should list the tracks and the featured track artists, however there's another bug which is preventing the track artists from being displayed sometimes.  Again, we're going to fix this.
https://www.last.fm/user/Lastfmsupport/library/music/Various+Artists/Test+Album?rangetype=1day&f...

On the track page, it should list all scrobbles of the track by that track artist. Note that this includes scrobbles that weren't from a compilation as well (we should really show album artist, if scrobbled, on this page imo).
https://www.last.fm/user/Lastfmsupport/library/music/+noredirect/Test+Artist/_/test+track?from=2018-...

>>>Library page for one of the artists from the split (2 tracks, one from another compilation, 0 albums): https://www.last.fm/user/lnqdty/library/music/Capers+&+Arkhe

Did you mean to post the same link as the first example?
(Edited)
Photo of Alexander Smith

Alexander Smith

  • 5 Posts
  • 1 Reply Like
The second link was supposed to be: https://www.last.fm/user/lnqdty/library/music/Arkhe

The main problem I'm having is with the album list being per Album Artist rather than per Artist.

It's nice to have albums displayed under the Album Artist but in a lot of cases where the AA doesn't appear as an artist on the album, it makes those albums very difficult and inconvenient to browse to.

Also, in cases like this: https://www.last.fm/user/lnqdty/library/music/Vomir

Almost a dozen albums disappeared from the list because they're split releases with a different Album Artist. It would be nice to see splits and compilation contributions in the list of albums.


(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Ok, I think I understand.

Technically you can get to these albums from the track's page (since for each scrobble it lists the album name)

e.g. From  https://www.last.fm/user/lnqdty/library/music/Vomir/_/Untitled you can get to:

https://www.last.fm/user/lnqdty/library/music/Vomir+&+Trou/Vomir%2FTrou
https://www.last.fm/user/lnqdty/library/music/Vomir+&+The+Bringer+Of+Everything/Vomir%2FThe+Brin...
https://www.last.fm/user/lnqdty/library/music/Vomir+&+Rien/Vomir%2FRien
https://www.last.fm/user/lnqdty/library/music/Vomir+&+No-Joy/Vomir%2FNo-Joy
etc

But I can see why you'd want a way to navigate to these collaboration releases directly from an artist's page as well.  I'll put it forward for consideration.

On the old db, although it lists the albums, they link to the wrong page: https://www.last.fm/user/lnqdty/library/music/Vomir/Vomir%2FTrou, I believe that's why we removed them.  
Photo of Alexander Smith

Alexander Smith

  • 5 Posts
  • 1 Reply Like
Thanks a lot for raising this issue, it would be great to see the album list as it was along with the much needed improvements to the Album Artist tag handling.

I see that it's possible to navigate to collaborations from the tracks page but it's a bit hacky. Really I like to look at all the albums I've scrobbled from an artist in one list so I can know what in my library I've scrobbled and what I haven't, at a glance.

Not to mention the obvious problem with your example: all Vomir's tracks have the same name.
Photo of holland25

holland25

  • 330 Posts
  • 394 Reply Likes
So, my total number of scrobbled tracks doesn't correspond with the numbers in my library. https://www.last.fm/user/holland25 I even deleted an artist (Simple Plan) that seemed to be the problem and it didn't help. Any advice?

Photo of Rob_209

Rob_209

  • 99 Posts
  • 137 Reply Likes
Today I noticed that my charts are displaying albums by the album artist for Various Artists releases, thankyou to all the staff at last.fm that were involved, really appreciate the hard work you do that we do & don't see. 
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Official Response
Thanks for your feedback everyone, we've rolled this out to all users now.  With that in mind, I want to try and clarify a change we've made that's come up a few times, but isn't mentioned in the original post, concerning artist corrections and newer releases:  

  • Where there were previously corrections that only existed in the library, but not in the catalogue - these have been undone, so that the corrections seen in the library match those seen in the catalogue. This fixes numerous bugs people have been experiencing (e.g. not being able to delete scrobbles, not being able to unlove tracks, certain artists / albums appearing twice in the charts, other corrections weirdness, etc).
We didn't mention this before, because it's somewhat complicated to explain, and appears as a regression even though we have valid reasons for doing it. 

So what does this actually mean?

If you scrobble music from an artist that's corrected to something else (e.g. Utada Hikaru which corrects to 宇多田ヒカル ), you will find that their newer tracks and albums (mid 2015 onwards) are still displayed in your library under the 'noredirect' spelling. 

If you're used to how corrections work on the site (especially in the past), this might seem counter-intuitive, so I'm going to use an example: 

If I scrobble  by Utada Hikaru on Spotify, it will scrobble on my profile as 宇多田ヒカル.  This is because we already have a catalogue correction for that track, which you can view here (notice that it redirected you to the correct spelling).

Now, if I scrobble  by Utada Hikaru on Spotify (from the 2016 album Fantôme), it scrobbles on my profile as Utada Hikaru — 道.  This is because we don't yet have a catalogue correction for that track yet,as you can see here (notice that it doesn't correct you to the right page, even though the artist page is corrected).


Shouldn't artist corrections just automatically apply to all tracks?


Conceptually yes, but in practise no. As the Last.fm Catalogue corrections dataset is static and can't be edited, we can't map existing artist corrections to their new tracks yet -- as soon as we're able to do this, this problem will fix itself. 

Note that we will still count those scrobbles under the corrected spelling (e.g. 宇多田ヒカル) in your artist chart. So the main place you're going to notice this issue is under your recent tracks, top tracks, and top albums.  Top artists shouldn't be affected, and anything that was already in the Last.fm catalogue before we relaunched the website in 2015 should be displayed under the correct name. 

Again this will only affect new music from artists where you're scrobbling the uncorrected / noredirect spelling (e.g. k-pop and j-pop artists played in Spotify, but any new release scrobbled with the noredirect spelling).  We will fix this, but sorry for any inconvenience caused in the meantime.


Why is this happening at all? 

For clarity, I'm going to grossly simplify the actual technical reasons, but in essence: to display your scrobbled data correctly and efficiently, your user library and the Last.fm catalogue each maintain their own separate version of the corrections mapping dataset.  When we relaunched the website in August 2015, a problem resulted in these two sets of corrections to fall out of sync with each other, i.e. the library had corrections that the catalogue didn't know about, and vice versa.  

This caused the vast majority of the problems people have been reporting over the last 3 years, such as not being able to unlove or delete tracks; artists and albums appearing twice in your library; tracks and albums not being clickable, etc.  It also prevented us from finishing the catalogue project, which would allow us add new corrections to the site, and remove bad ones.  So even though the library was doing the right thing in some cases, it was doing it in the wrong way, and causing serious problems with user libraries and the catalogue as a whole.  

To fix this, we first need to ensure that the library and catalogue corrections datasets are properly in sync again, and that's what this change does, even though it's going to look wrong for some releases.  The next step to fully fixing this is to complete work on the Last.fm Catalogue so that we can start applying artist corrections to their new tracks.  Once that's that done, these problems should be fixed for good, however I don't have a timeline for when exactly we're going to address that part of the work yet (we're still monitoring the rollout of the new database, and the new catalogue page design).  Thanks for your understanding and patience in the meantime.
(Edited)
Photo of Elliot Robinson

Elliot Robinson

  • 877 Posts
  • 2140 Reply Likes
Forgive me if this is a stupid question, Jon, but why do our libraries and the Last FM catalogue need/have different correction datasets?

The next step to fully fixing this is to complete work on the Last.fm
Catalogue so that we can start applying artist corrections to their new tracks.
What percentage of the catalogue remains incomplete? I realise you've said you don't have a timeline but do you not even have a rough estimate, e.g. next summer or even Christmas 2019? I'm guessing from the vagueness that there's still a fair amount of work to do on it.
Photo of cptchi

cptchi

  • 134 Posts
  • 180 Reply Likes
Photo of Kim Seulgi

Kim Seulgi

  • 4 Posts
  • 0 Reply Likes
This reply was created from a merged topic originally titled Scrobble bug.

My scrobbles from some artists were messed up

- There are albums with the wrong artist name.
Ex; The artist name is 'SHINee', but now some are like '샤이니 (SHINee)'.
I always keep the Auto-correct on.
- Has duplicate albums
- scrobbles disappeared

I hope that last.fm fixes this.
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Hi, can you post a link to your library please?
Photo of holland25

holland25

  • 330 Posts
  • 394 Reply Likes
This reply was created from a merged topic originally titled Scrobbles messed up after the update.

So, I'm glad you guys released a new database, since it's a huge step forward, but it left my library broken. Yesterday I noticed some wrongly scrobbled duplicate artists, which I've taken care of. But I had to delete all my scrobbles of this band https://www.last.fm/user/holland25/library/music/Zdob+%C5%9Ei+Zdub, since they kept being corrected to that with an uppercase ş. Everything would be cool if it actually worked, but it didn't. I'm still seeing 5 scrobbled tracks with autocorrections turned off and 53 with autocorrections on. I can't delete them. I've tried at least 20 times. Is this a display issue that should resolve itself? Those scrobbles are messing up my total scrobbles and my library.

Another, not that important, issue I'm seeing is 346 plays here https://www.last.fm/user/holland25/library/music/Kylie+Minogue
and only 345 on her artist page and in the list of artists in my library. Any idea how to fix those two "bugs" or whatever they are?

Thanks in advance!

Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
>>>I had to delete all my scrobbles of this band https://www.last.fm/user/holland25/library/music/Zdob+%C5%9Ei+Zdub, since they kept being corrected to that with an uppercase ş.

Ah, maybe next time you could flag this with us before hitting the delete button?  Maybe we could have done something. :(

>>>>>>Everything would be cool if it actually worked, but it didn't. I'm still seeing 5 scrobbled tracks with autocorrections turned off and 53 with autocorrections on. 

If you click through to the individual scrobbles (by clicking on the listening history bars) you'll see that the tracks have actually been deleted. 

e.g. https://www.last.fm/user/holland25/library/music/Zdob+%C5%9Ei+Zdub?from=2017-07-01&rangetype=1mo...

It's just that some views are still displaying them -- this is a bug we're currently investigating.

>>>I'm seeing is 346 plays here https://www.last.fm/user/holland25/library/music/Kylie+Minogue and only 345 on her artist page and in the list of artists in my library

I'm not sure what's going on there - I'll ask the team and get back to you next week.
(Edited)
Photo of holland25

holland25

  • 330 Posts
  • 394 Reply Likes
Thank you for a quick response. I'll wait. As for Zdob si Zdub, I've always had this problem, so I decided to get rid of the "incorrectly" tagged scrobbles once and for all. And yes, I noticed the scrobbles don't show up elsewhere. That's why I asked if it was a display issue. When this is resolved, will it affect my total number of scrobbles as well? All artists I've scrobbled are at an even number of scrobbles but my total is odd (it's either Zdob si Zdub or Kylie causing this)
(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
>>>When this is resolved, will it affect my total number of scrobbles as well?

We're still looking into this, but I'd expect all pages to agree with each other.
Photo of holland25

holland25

  • 330 Posts
  • 394 Reply Likes
Sweet, that sounds good. You know, I have some sort of OCD which makes me hate odd numbers
Photo of holland25

holland25

  • 330 Posts
  • 394 Reply Likes
Just a little update from me. I tried scrobbiling Zdob Şi Zdub with the uppercase Ş, which Last.fm considers to be correct and some songs scrobbled with uppercase Ş and some with a lowercase one. I have autocorrections turned off and correct tags everywhere. This band is one HUGE mess

And I took care of Kylie myself, so that's one less problem
(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Ah, we actually have bug tickets for both issues.  Can you please not delete/scrobble anything to those artists while we investigate?  Thanks. :)

>>>I tried scrobbiling Zdob Şi Zdub with the uppercase Ş, which Last.fm considers to be correct and some songs scrobbled with uppercase Ş and some with a lowercase one.
Which songs did you try, and which appeared differently, so we can test this?
(Edited)
Photo of holland25

holland25

  • 330 Posts
  • 394 Reply Likes
Oh. Too late. I've already rescrobbled everything. Sorry about that

As for Zdob si Zdub, I've only scrobbled 4 songs. Their demo, which scrobbled with Ş and one of the songs that are still showing up in my library, even though I deleted them - Hardcore Moldovenesc (Brutal Mix) . That one scrobbled with a lowercase Ş so I deleted the play :)

I won't scrobble anything to Zdob si Zdub until the issue is resolved
(Edited)
Photo of holland25

holland25

  • 330 Posts
  • 394 Reply Likes
Bah. Deleted this track https://www.last.fm/music/Absu/_/Prelusion+To+Cythraul+%2F+And+Shineth+into+the+Cold+Cometh and the site still says I've listened to it once. Another display issue? It's still included in my total number of Absu scrobbles

Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Hi we're trying to run a repair operation on your account, but can't do this while you're scrobbling. :)  Is there a time when you're usually offline / not scrobbling? (shouldn't take more than ~45 minutes)
Photo of holland25

holland25

  • 330 Posts
  • 394 Reply Likes
Hey! Only noticed this reply now. I see you already did it (at least in the "autocorrections off" version). The ghost scrobbles are gone and the numbers are correct. But yes, I never scrobble anything between 10 PM CET (1 PM PST) and 9 AM CET (midnight PST), in case you still need this info

PS: Zdob si Zdub is still scrobbling both to the lowercase and uppercase instance

Meanwhile, something went wrong here. https://www.last.fm/user/holland25/library/music/Alkaline+Trio Their artist page (and my artist list) shows 201 plays instead of 204
(Edited)
Photo of holland25

holland25

  • 330 Posts
  • 394 Reply Likes
Meanwhile, something went wrong here. https://www.last.fm/user/holland25/library/music/Alkaline+Trio Their artist page (and my artist list) shows 201 plays instead of 204

This has been fixed. Thank you, guys!
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Thanks, I've asked the development team to schedule the consistency checker tool to run between those times, this should fix any remaining inconsistencies in your charts.
Photo of holland25

holland25

  • 330 Posts
  • 394 Reply Likes
My charts seem to be okay now. At least the "autocorrections off" ones. The "autocorrections on" still show 57 plays for Zdob si Zdub. Thanks again :)
(Edited)
Photo of holland25

holland25

  • 330 Posts
  • 394 Reply Likes
So, here I am. I'll be ready in about 10-15 mins and I won't be scrobbling for another 3 hours :)
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
OK, it shouldn't take very long, but please don't scrobble until I post here again.
(Edited)
Photo of holland25

holland25

  • 330 Posts
  • 394 Reply Likes
Okay, I'll wait. And thanks :)
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
It'll be about another 15 - 25 minutes; I think it's taking longer because you have more scrobbles than most people.
Photo of holland25

holland25

  • 330 Posts
  • 394 Reply Likes
Well, I've been a member for 10 years now and I scrobble a lot. No rush, I'll wait
Photo of holland25

holland25

  • 330 Posts
  • 394 Reply Likes
So, can I start scrobbling again? The stats seem to be correct now
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Sorry, not quite yet -  I had to restart it, as it found another inconsistency after it finished.
Photo of holland25

holland25

  • 330 Posts
  • 394 Reply Likes
Thaaat might have been me. I deleted two duplicate scrobbles from a few days ago
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Ok it's done, hopefully everything is correct now!
Photo of holland25

holland25

  • 330 Posts
  • 394 Reply Likes
I see no discrepancies anywhere. Thank you :)
Photo of Niels Markus

Niels Markus

  • 2 Posts
  • 1 Reply Like
This reply was created from a merged topic originally titled scrobbles disappeared.

Hello, It seems that some of my scrobbles have been deleted. I used to have a lot more scrobbles for artists like Nick Cave and The Bad Seeds and the Arcade Fire, but they're much lower in my all time-rankings. Do you know why they disappeared and is it possible to fix it?
Photo of dustin prewitt

dustin prewitt

  • 29 Posts
  • 42 Reply Likes
probably because it's now seperating them between "nick cave and the bad seeds" and "nick cave & the bad seeds", and "arcade fire" and "the arcade fire"

check your itunes to make sure album artist and artist fields match in song info.  as far as on last.fm's side, either wait for them to (allegedly) fix it, or just delete and rescrobble from scratch
Photo of Jon

Jon, Community & Customer Services

  • 4627 Posts
  • 3455 Reply Likes
Hi can you post a link to your library please?  

Most likely your scrobbles haven't been deleted, but have been corrected to a different spelling (e.g. Nick Cave & The Bad Seeds).  Turning corrections off will display your artists as you originally scrobbled them.
Photo of dustin prewitt

dustin prewitt

  • 29 Posts
  • 42 Reply Likes
Im convinved that it may just be easier and more reliable to delete the old incorrect scrobbles and rescrobble with the corrected tags.