Catalogue importer has missed this album...

  • 14
  • Problem
  • Updated 1 month ago
  • In Progress
I've left the title generic in case it would be more useful to have a single thread with albums that have clearly been missed by the importer which users can mention in the replies to this conversation.

My particular impetus for creating this thread - as per Jon's request in a now archived thread - is for the album Follow Me by Anuhea, which was released about 2 months ago and should have a proper entry on Last FM by now, as it's on all the usual sites (MusicBrainz, iTunes, Amazon, Spotify).

Thanks
Photo of Elliot Robinson

Elliot Robinson

  • 883 Posts
  • 2151 Reply Likes

Posted 2 years ago

  • 14
Photo of Andreas_Wotte

Andreas_Wotte

  • 1007 Posts
  • 1397 Reply Likes
Good hint Elliot. Beneath the extrem annoying archieving hype, with the bad habit effect, to lost the access to important thoughts of the community, I've checked some new releases and didn't found them on LFM. A few weeks ago Harald Nordgren was posting this thread:
https://getsatisfaction.com/lastfm/to...
Is this bug an artifact that affect only some albums, or didn't work the catalogue update since some weeks not at all?
(Edited)
Photo of Wiraccc

Wiraccc

  • 72 Posts
  • 103 Reply Likes
Fever Ray's album Plunge (https://www.last.fm/music/Fever+Ray/Plunge) is also still missing after over a month since its release.
(Edited)
Photo of Andreas_Wotte

Andreas_Wotte

  • 1007 Posts
  • 1397 Reply Likes
On Musicbrainz.org you can find "Tramontana" by Toto Blanke & Rudolf Dašek, edited in 2012, But not imported to LFM. Well, thanks the improved searching tool, you can find the album on LFM with an "/" instead of "&" and the wrong tracklist. - Better than nothing. - But that isn't the writing by musicbrainz and discogs:
MB: https://beta.musicbrainz.org/release/...
DC: https://www.discogs.com/de/Toto-Blank...
(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4781 Posts
  • 3573 Reply Likes
Photo of Andreas_Wotte

Andreas_Wotte

  • 1007 Posts
  • 1397 Reply Likes
Unfortunately, yes, the album still hasn't imported. But thanks for care about it.
(Edited)
Photo of Mikko Myllykangas

Mikko Myllykangas

  • 1 Post
  • 0 Reply Likes
This album is imported incorrectly, only one track shown: https://www.last.fm/music/Antipope/Denial%2FSurvival
Correct album data is available on Musicbrainz, though: https://musicbrainz.org/release/197cbd80-6a70-4972-89cf-3037196f72e0
Photo of Andreas_Wotte

Andreas_Wotte

  • 1007 Posts
  • 1397 Reply Likes
On tuesday I added the album "Erster Einsatz" by "Mobiles Jazzkommando" to the musicbrainz catalogue. But it wasn't imported to the last.fm catalogue on friday.
Photo of Andreas_Wotte

Andreas_Wotte

  • 1007 Posts
  • 1397 Reply Likes
Looks like the import is working again. Here my example, edited on musicbrainz last week:
https://www.last.fm/music/Mobiles+Jaz...
Photo of Elliot Robinson

Elliot Robinson

  • 883 Posts
  • 2151 Reply Likes
Not properly. The album I included in my original post is still not imported and I added it to MusicBrainz at the start of October.
Photo of Andreas_Wotte

Andreas_Wotte

  • 1007 Posts
  • 1397 Reply Likes
Indeed Elliot, too sad. Also the album, refered by Mikko. I've just deleted the "0s" from the tracklist off "Denial Survival" on Musicbrainz for testing. If this works ...
(Edited)
Photo of Gijs Wittenaar

Gijs Wittenaar

  • 1 Post
  • 0 Reply Likes
Scandinavian Boy from Joost is also missing as an album https://open.spotify.com/album/0XJBeA...
Photo of James Joul

James Joul

  • 983 Posts
  • 2019 Reply Likes
I'm confused. Jon specifically asked for examples of missing releases in another thread and several users (including myself) replied with links. But then the thread was closed and archived with the reason 'Please stop posting the same thread over and over. There's already an open topic on this'.

So are we supposed to post them in here? I only replied because he asked...
Photo of Elliot Robinson

Elliot Robinson

  • 883 Posts
  • 2151 Reply Likes
For the time being, maybe post them in here.

Also, everyone who's following this conversation, remember to "me too" it at the top, as that is supposedly a factor in how significant (and therefore how much of a priority) the Last FM team deems the thread.
Photo of Andreas_Wotte

Andreas_Wotte

  • 1007 Posts
  • 1397 Reply Likes
I was wondering too James. But I've learned, the kind of care to "keep this forum clean" isn't very british I guess, but it has its very own character.
(Edited)
Photo of Ryan

Ryan

  • 96 Posts
  • 209 Reply Likes
I noticed that too and, quite frankly, if that's the kind of response I'm going to get while I'm attempting to assist in getting this website back to where it used to be then I'm done trying, subscription cancelled.
(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4781 Posts
  • 3573 Reply Likes
Sorry everyone, you're right that thread was archived in error.  It's been restored.
Photo of Andreas_Wotte

Andreas_Wotte

  • 1007 Posts
  • 1397 Reply Likes
Such news are read with pleasure. Thank's.
Photo of whoislibrious

whoislibrious

  • 51 Posts
  • 35 Reply Likes
Seriously? It's been literally MONTHS and the catalogue is still outdated. This is something that was supposed to be already working. Now imagine the future updates, clearly updating the website doesn't mean it will work as it's supposed to. Honestly, Last.fm, get your shit together. We're all tired at this point.
Photo of mlwry

mlwry

  • 51 Posts
  • 108 Reply Likes
Still outdated, missing dozens and dozens of big releases.
Photo of Wiraccc

Wiraccc

  • 72 Posts
  • 103 Reply Likes
Sure would be nice to get some sort of ETA for a fix, it's been months now and it's becoming a bit frustrating.
Photo of Jon

Jon, Community & Customer Services

  • 4780 Posts
  • 3572 Reply Likes
Yes, I know it's frustrating, but realistically I think it will be some time before we can fix this. We're very much aware that the catalogue generation service has issues, and some albums are not being imported with the full / correct tracklist, or in some cases at all.  However, as I've mentioned elsewhere, the data team are 100% committed to delivering a mission critical project right now (rebuilding the realtime scrobble storage service), to the exclusion of pretty much everything else.  This is why updates on the site have been infrequent in the last 4-5 months, and also why unexpected problems like itunes scrobbling and spotify playback breaking have taken longer than expected to address.  We're sorry for any inconvenience caused by this.

It's worth stressing that the service we're replacing is the root cause of the vast number of longstanding problems on the site concerning user libraries, scrobble corrections, loved tracks, and charts, and is also the main blocker for us adding new corrections to the site (and removing bad/outdated ones like Noah Cyrus).  As much as we want to fix the problems with the catalogue generation, it's not possible for us to tackle both at the same time with our current resources -- and much of the remaining catalogue work (such as implementing new scrobble corrections) depends on us replacing the scrobble service first.  

So, it's on our radar, and I'll continue raising this with the team, but I believe our hands are still tied for the next few months at the very least.  Thanks for your continued patience and understanding, and again we apologise for any inconvenience caused by this.
Photo of Elliot Robinson

Elliot Robinson

  • 883 Posts
  • 2151 Reply Likes
Thanks for the reply, Jon. I think most of us just appreciate an update - even if it is just a text update like this, letting us know what you're working on. Frequently, I think it's the silence and perception of being ignored that gets people frustrated. What you say makes sense in terms of an order of doing things.

Fingers crossed it comes together without any further hiccups.
Photo of KatyLB

KatyLB, Moderator

  • 455 Posts
  • 379 Reply Likes
Here's another example (not sure if you want us to report these?) of a new album partially imported, 6 of 11 tracks but complete on MusicBrainz: https://www.last.fm/music/Dream+Wife/Dream+Wife
Photo of Patrick

Patrick

  • 1299 Posts
  • 932 Reply Likes
This reply was created from a merged topic originally titled LFM is not importing a catalog for the latest release..

https://www.last.fm/music/Judas+Priest/Firepower

Four days have passed since Judas Priest Group released its latest album. LFM still hasn't imported a catalog, neither he imported the tracklist. LFM still keeps flagging Judas Priest - Turbo 30 (Remastered 30th Anniversary Deluxe Edition) as the latest release. Can you fix this, please? Thanks.
Photo of Jon

Jon, Community & Customer Services

  • 4781 Posts
  • 3573 Reply Likes
We've identified and corrected at least one possible cause of this problem, so we're now waiting until the next catalogue generation job finishes (around Friday) to see if it's made a difference.
Photo of Elliot Robinson

Elliot Robinson

  • 883 Posts
  • 2151 Reply Likes
Certainly a lot of releases have appeared - particularly new ones, which is excellent - but there are some releases I've noticed haven't returned (i.e. they used to be part of the database, for some reason lost their official entry, and haven't returned with this update).

e.g.
Mariah Carey - Merry Christmas
Mariah Carey - Me. I Am Mariah...The Elusive Chanteuse (Deluxe Version)
Betty Boo - Boomania (Deluxe Edition)
Betty Boo - GRRR! It's Betty Boo (Deluxe Edition)
Michael Jackson - Dangerous
Photo of Jon

Jon, Community & Customer Services

  • 4781 Posts
  • 3573 Reply Likes
Thanks...

Are these examples on musicbrainz and discogs? The Deluxe one's have expanded tracklists, right?
(Edited)
Photo of Elliot Robinson

Elliot Robinson

  • 883 Posts
  • 2151 Reply Likes
Yep, on both points.

Merry Christmas: Discogs / MusicBrainz
Me. I Am Mariah...The Elusive Chanteuse (Deluxe Version): Discogs / MusicBrainz
Boomania (Deluxe Edition): Discogs / MusicBrainz
GRRR! It's Betty Boo (Deluxe Edition): Discogs / MusicBrainz
Dangerous: Discogs / MusicBrainz

It's certainly odd that "Merry Christmas" and "Dangerous" have been missed as these are both hugely successful albums!
Photo of Jon

Jon, Community & Customer Services

  • 4781 Posts
  • 3573 Reply Likes
With the deluxe editions, it's likely that we're not importing the tracklist because Musicbrainz and Discogs account for multiple release types, whereas Last.fm doesn't.  As far as I know, there's no special provision to map the deluxe edition of "Boomania" from Musicbrainz to "Boomania (Deluxe Edition)" on Last.fm.  In the long run, I think what we want to do is a similar thing to Musicbrainz and have one album page "Boomania" (the title), that can list multiple release types (regular, deluxe, etc) and their respective soundtracks.

 
Photo of Elliot Robinson

Elliot Robinson

  • 883 Posts
  • 2151 Reply Likes
Re: Boomania - and all those five album, in fact - Last FM had actually imported them previously; they have since had their details disappear and are yet to return.

I think it makes sense for all the assorted editions of albums to be listed under a master album page and perhaps have their stats totalled, but I think it would be wrong to remove the individual listings from a scrobbling perspective. The master album page is great from a global, general viewing point of view, but for us users, we want to be able to see our listening information recorded and listed as accurately as possible. Also, the artwork is frequently changed for deluxe (and other) editions.

This is why, on a slight tangent, it bugs me that the images next to tracks in our libraries doesn't use the artwork for the album we have listened to it the most from, rather it shows the artwork for (I believe) the most popular associated album. If you're not going to use our actual scrobbling data (which you used to do on the previous iteration of the site by listing in descending order all the albums we had listened to that track on), I think it would be more desirable to at least find a way to use either the associated single release or studio album rather than some god-awful compilation album with naff artwork.
Photo of jeroenslagt

jeroenslagt

  • 2 Posts
  • 0 Reply Likes
Same here:

The album 'Studio Moscow' by Yukka has no tracks listed.
https://www.last.fm/music/Yukka/Studio+Moscow

The album has three tracks. The tracks are being scrobbled, but are not part of any album.
1. https://www.last.fm/music/Yukka/_/Woman+has+no+Soul
2. https://www.last.fm/music/Yukka/_/About+that+day
3. https://www.last.fm/music/Yukka/_/Downtown

The album was released March 8th, 2018.

See also:
https://musicbrainz.org/release/f508e63d-2ee9-4b52-9098-dd7f547887aa
https://www.discogs.com/Yukka-Studio-Moscow/release/11519529
Photo of KatyLB

KatyLB, Moderator

  • 455 Posts
  • 379 Reply Likes
Hi Jeroen. This release is affected by the ongoing catalogue problems, which are known to staff.
(Edited)
Photo of KatyLB

KatyLB, Moderator

  • 455 Posts
  • 379 Reply Likes
This release is now in the catalogue with all three tracks listed. :)
Photo of Patrick

Patrick

  • 1299 Posts
  • 932 Reply Likes
What are we going to do with this? https://www.last.fm/music/Icon/Icon

The album has a wrong tracklist: https://en.wikipedia.org/wiki/Icon_(Icon_album)#Track_list
Photo of KatyLB

KatyLB, Moderator

  • 455 Posts
  • 378 Reply Likes
These appear to be tracks belonging to an electronic artist called Icon, from a release called Icon. Here it is on Beatport. While I believe the Icon you've linked is certainly the most important and likely to be looked up of the two, it's a difficult one to address because the release listing isn't actually incorrect (and, of course, you already know we don't have a way of splitting artists with the same name). It's certainly not a symptom of the catalogue importer issues that this thread covers.
(Edited)
Photo of Patrick

Patrick

  • 1299 Posts
  • 932 Reply Likes
Icon is a self-titled album of a heavy metal band Icon released in 1984. The tracklist for this heavy metal album was correct until the tracklist for a dub-step band popped out of nowhere.
(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4780 Posts
  • 3572 Reply Likes
It's an example where you have two bands with the same name, who both have self-titled albums.   So they share both the artist page and the album page.

Until we do artist disambiguation, I would expect the tracklists to randomly change between the two.
Photo of KatyLB

KatyLB, Moderator

  • 455 Posts
  • 379 Reply Likes
Good news! As others have noticed, the fix applied earlier this week seems to have made a big difference and resulted in a lot of these issues being fixed. New releases from Friday (e.g. this) have been widely added, as well as a lot of missing releases from earlier in 2018 and last year (e.g. the Fever Ray album mentioned in this thread is now present).
(Edited)
Photo of He's dead, Jim!

He's dead, Jim!

  • 1606 Posts
  • 408 Reply Likes
Photo of Jon

Jon, Community & Customer Services

  • 4780 Posts
  • 3572 Reply Likes
That first example came out on the 14th of March, and was added to MBz on the 16th, so it would have missed the train (metaphorically) 

I'm not sure about the others, though they're all pretty obscure releases.  I've asked the team.
Photo of He's dead, Jim!

He's dead, Jim!

  • 1606 Posts
  • 408 Reply Likes
Thanks for looking into it. I like obscure releases and they should be easier to import as there isn't as many special versions, de luxe editions and regional editions as there can be for mainstream music.

Generally it seems various artists releases are trickier to import. A few more:
https://www.last.fm/music/Various+Artists/We+Love+Industrial from https://musicbrainz.org/release/402eb908-4079-4758-8741-f21ccb7abae8

https://www.last.fm/music/Various+Artists/Halotan+Records+Sampler+10 from https://musicbrainz.org/release/f27bf789-0db7-4c05-ba54-4f4217127395

https://www.last.fm/music/Various+Artists/Rush+for+Black+Celebration:+Russian+Industrial+Depeche+Mod... from https://musicbrainz.org/release/760640eb-8b96-46b5-99dc-37b373652dcb

https://www.last.fm/music/Various+Artists/Latvijas+punk%2Fhc from https://musicbrainz.org/release/867fe880-36df-40fc-a6b9-3e887d5ecad1

https://www.last.fm/music/Various+Artists/Latvijas+Punk%2FHC+%232 from https://musicbrainz.org/release/c0fc36cb-daed-49ae-8609-5a02980e2214

https://www.last.fm/music/Various+Artists/Svensk+postpunk from https://musicbrainz.org/release/857a1712-d258-4488-9906-3c84daccc6e6

https://www.last.fm/music/Various+Artists/Music+for+the+Murdered from https://musicbrainz.org/release/d0a3cea5-7dec-4954-b857-ba7d7bde9e49

https://www.last.fm/music/Various+Artists/Swedish+Electro,+Volume+4+:+The+Unsigned from https://musicbrainz.org/release/65cf8146-c21d-4a87-bfbd-8ec2e495e1ae

https://www.last.fm/music/Various+Artists/CIA+Volume+6 from https://musicbrainz.org/release/d20d3074-27fd-44ae-924e-ed1f0c18e79e
Photo of He's dead, Jim!

He's dead, Jim!

  • 1606 Posts
  • 408 Reply Likes
And here is a mainstream one that is missing
https://www.last.fm/music/Various+Artists/The+Golden+Collection from https://musicbrainz.org/release/f5740f75-958c-459e-9337-8e7c6c4370cc

Here the massive size may be an issue.
Photo of Jon

Jon, Community & Customer Services

  • 4780 Posts
  • 3572 Reply Likes
There might be a known issue with VA releases, I'm trying to get clarification on that.
Photo of Natalie H

Natalie H

  • 26 Posts
  • 11 Reply Likes
Tulijoutsen by Kuolemanlaakso is missing a track in its tracklisting on here. If it could be fixed, I'd seriously love you guys forever because the missing track is my top track and my header has looked ugly for the past two years ;D 

https://www.last.fm/music/Kuolemanlaakso/Tulijoutsen

https://musicbrainz.org/release/8f2d6be6-b91b-42d5-a8b5-ffa196a8fae4
Photo of KatyLB

KatyLB, Moderator

  • 455 Posts
  • 379 Reply Likes
This seems to be because the missing track, Track 8, isn't on some listings because it's a bonus track, and the system is picking up the track listing from somewhere that doesn't have it. See the master group in Discogs, for example: https://www.discogs.com/Kuolemanlaakso-Tulijoutsen/master/658788
(Edited)
Photo of Natalie H

Natalie H

  • 26 Posts
  • 11 Reply Likes
Is there a workaround for it? Basically, it's a track on the more widely bought CD, but it just doesn't appear on the vinyl. And a lot of places seem to list the vinyl as the 'main' tracklisting, hah.
Photo of KatyLB

KatyLB, Moderator

  • 455 Posts
  • 379 Reply Likes
Followers of this thread may be interested in the following article, which reconfirms the situation on missing releases and how best to handle them: How do I add or report a release that's missing from the catalogue?
Photo of Diego Marcel

Diego Marcel

  • 1 Post
  • 0 Reply Likes
So, there's a brazilian duo called "Sandy e Junior" and they have two self-titled albums, the first one being released in 2001 and the last one in 2006. Last.fm's catalogue only have the last one (with the only problem being the incorrect cover) and the 2001's album is somehow merged with another 1999 album that already is added to the catalogue.

Last.fm:
2006 album
1999 album
1999 and 2001 albums merged 

MusicBrainz info:
1999 album
2001 album
2006 album
Photo of RiffmasterRick

RiffmasterRick

  • 81 Posts
  • 37 Reply Likes
This album has a pretty messed up track list, including weird typos.
https://www.last.fm/music/Crashdïet/Generation+Wild
This should be the correct one: https://musicbrainz.org/release/a087a5f3-2c25-34a6-94db-68bda5f65888

Thanks in advance. :)
Photo of He's dead, Jim!

He's dead, Jim!

  • 1606 Posts
  • 408 Reply Likes
Photo of cptchi

cptchi

  • 140 Posts
  • 201 Reply Likes
(Edited)
Photo of Jon

Jon, Community & Customer Services

  • 4780 Posts
  • 3572 Reply Likes
Yeah, we've been having problems with it -- the last few catalogue jobs failed to complete.  The latest job is still running and will probably take a few more days to finish (it's currently 4 days in, and usually takes ~7). I think Mark gets back on Monday, so I'll ask him to look into it if there are still problems. 
Photo of cptchi

cptchi

  • 140 Posts
  • 201 Reply Likes
Still having problems with it I assume
Photo of cptchi

cptchi

  • 140 Posts
  • 201 Reply Likes
Hi, the importer seemed to work this week, thanks. The entries I had submitted appeared on lastfm, except for these: 1, 2

Also I would like to ask if there's some importing magic you could do to some releases by artist Oh Shu which are missing from his page?

Artist Page on lastfm

Villa Tereze 
Spotify
iTunes

Wang
Spotify
Apple Music

don't hurt pride / Muzhhik
Spotify
iTunes
Photo of He's dead, Jim!

He's dead, Jim!

  • 1606 Posts
  • 408 Reply Likes
Photo of KatyLB

KatyLB, Moderator

  • 455 Posts
  • 378 Reply Likes
The importer isn't working still, there hasn't been an update for a while. These were released after the last update so I'd assume they'll both be added when it's finally up and running again.
(Edited)
Photo of haim91

haim91

  • 1 Post
  • 0 Reply Likes
I have found the missing album from the page:
https://www.last.fm/music/C%C5%93ur/Trinity

But for some reason it doesn't show up on the actual page or in connection with the tracks. Probably something to do with the ongoing database issues.