discogs.com music scraper - development help and bug reports wanted!

**spiff** · 2008-12-31, 02:06

hey,

after seeing all the polite and constructive requests, as well as some not so constructive whining, for a better music scraper, i finally gave in and did it myself.

r16773

let the bug reporting commence

kriziz · 2009-01-02, 12:32

Wow nice, thank you for the work you did!
I had a quick go with it and it seems to work.. 4 new albums got scraped nicely using 'Update library'. 1 album came back with false results, though. I'll try to figure out what went wrong later today and report back.

Jeroen · 2009-01-03, 09:16

Aahh, excellent! I was hoping for a discogs scraper

Working great so far, much much better results than with allmusic.
Still need to do a full scan, will report on how that goes.
Thanks a lot spiff!

nekrosoft13 · 2009-01-06, 15:25

nice, just tried it today on a rather small collection of music, just one thing to report.

discography doesn't work for any artist.

**spiff** · 2009-01-06, 15:32

artist scrapes i have hardly worked on, personally i still use allmusic for artists

kriziz · 2009-01-10, 13:22

Finally had some time to do more testing; I cleared my music library today and ran album lookups using the discogs scraper on 50+ albums. All mp3s have proper id3 tags, i always use musicbrainz picard before anything is added to the library.

Think I've found one bug, which looks fixable. Not sure though if it's the scraper or XBMC's scraper framework which is broken. The details for Albums with a single quote in their name are never fetched from discogs. That is: the GetAlbumSearchResults thingy is executed (i have wireshark and strace logs that show the discogs HTTP request and response), but the album details lookup is never executed.

When looking up the album details XBMC briefly shows the 'Looking up album names..' dialog, which then disappears without further notice.

I'll try to create a patch and submit it.

Roborob · 2009-01-20, 16:10

Where can I get the file ??

**spiff** · 2009-01-20, 17:26

it's in svn

CONKER UNIT1 · 2009-01-22, 07:32

im not clear on how to get this or how to install...
can someone please help...thanks

**spiff** · 2009-01-22, 09:43

no. we won't help lazy ppl. everything you need is in the manual, and i bet google is available at your location.

besides, this is a DEV forum.

Quote:

Scraper Development Developers forum for meta data scrapers. Scraper developers only!
Not for posting feature requests or end-user support requests!

2008-12-31, 02:06	#1
spiff Grumpy Bastard Developer Join Date: Nov 2003 Posts: 7,715	discogs.com music scraper - development help and bug reports wanted! hey, after seeing all the polite and constructive requests, as well as some not so constructive whining, for a better music scraper, i finally gave in and did it myself. r16773 let the bug reporting commence __________________ Always read the XBMC online-manual, FAQ and search the forum before posting. Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules. For troubleshooting and bug reporting please make sure you read this first.

2009-01-03, 09:16	#3
Jeroen Skilled Skinner Join Date: Feb 2008 Location: The Netherlands Posts: 610	Aahh, excellent! I was hoping for a discogs scraper Working great so far, much much better results than with allmusic. Still need to do a full scan, will report on how that goes. Thanks a lot spiff! __________________ latest update: 11.01.09 Download

2009-01-06, 15:32	#5
spiff Grumpy Bastard Developer Join Date: Nov 2003 Posts: 7,715	artist scrapes i have hardly worked on, personally i still use allmusic for artists __________________ Always read the XBMC online-manual, FAQ and search the forum before posting. Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules. For troubleshooting and bug reporting please make sure you read this first.

2009-01-20, 17:26	#8
spiff Grumpy Bastard Developer Join Date: Nov 2003 Posts: 7,715	it's in svn __________________ Always read the XBMC online-manual, FAQ and search the forum before posting. Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules. For troubleshooting and bug reporting please make sure you read this first.

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

2009-01-02, 12:32	#2
kriziz Junior Member Join Date: Jun 2008 Location: UT, Netherlands Posts: 4	Wow nice, thank you for the work you did! I had a quick go with it and it seems to work.. 4 new albums got scraped nicely using 'Update library'. 1 album came back with false results, though. I'll try to figure out what went wrong later today and report back.

2009-01-06, 15:25	#4
nekrosoft13 Fan Join Date: Dec 2008 Posts: 322	nice, just tried it today on a rather small collection of music, just one thing to report. discography doesn't work for any artist.

2009-01-10, 13:22	#6
kriziz Junior Member Join Date: Jun 2008 Location: UT, Netherlands Posts: 4	Finally had some time to do more testing; I cleared my music library today and ran album lookups using the discogs scraper on 50+ albums. All mp3s have proper id3 tags, i always use musicbrainz picard before anything is added to the library. Think I've found one bug, which looks fixable. Not sure though if it's the scraper or XBMC's scraper framework which is broken. The details for Albums with a single quote in their name are never fetched from discogs. That is: the GetAlbumSearchResults thingy is executed (i have wireshark and strace logs that show the discogs HTTP request and response), but the album details lookup is never executed. When looking up the album details XBMC briefly shows the 'Looking up album names..' dialog, which then disappears without further notice. I'll try to create a patch and submit it.

2009-01-20, 16:10	#7
Roborob Member Join Date: Jan 2009 Location: The Netherlands Posts: 75	Where can I get the file ??

2009-01-22, 07:32	#9
CONKER UNIT1 Junior Member Join Date: Jan 2009 Posts: 7	im not clear on how to get this or how to install... can someone please help...thanks

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)