Multiple site scraper

sstarcher · 2009-02-06, 17:54

Sorry I looked over the scrapers, but I can't fiqure out if this is possible.
Would it be possible to say scrape TheTVDB for pictures, then scrap another site for data, such as ratings.

If this is possible I think I might have some work ahead of me.

Thank you

**vdrfan** · 2009-02-06, 18:03

Quote:

Originally Posted by sstarcher

Sorry I looked over the scrapers, but I can't fiqure out if this is possible.
Would it be possible to say scrape TheTVDB for pictures, then scrap another site for data, such as ratings.

If this is possible I think I might have some work ahead of me.

Thank you

Yeah, it's possible. What exactly do you want to scrape?

acaranta · 2009-02-07, 03:00

It is possible from my point of view ... the real problem is to link the different sites ...

For movies for example, you get the infos from ... let's say allocine.fr, you want picture from tvdb and rating from imdb ... the real issue I see is ... the missing link ...

It would be easy if all the sites had a common ID (imdb ID is not available everywhere for instance), of if you could be sure all the site hev the same spelling for a particular title ...

Butr theorically, it IS possible

sstarcher · 2009-02-09, 15:05

Cool when I have some time I'll look into how to do it.
Reason I was asking is I wanted to write a scapper for AniDB.net, but the problem is they have no art work outside of a single picture. So I wanted to use TheTVDB's artwork and episode information where possible.

I talked to the guys over at AniDB and they are still working on there API, but they are slow.

2009-02-06, 17:54	#1
sstarcher Junior Member Join Date: Aug 2008 Posts: 9	Multiple site scraper Sorry I looked over the scrapers, but I can't fiqure out if this is possible. Would it be possible to say scrape TheTVDB for pictures, then scrap another site for data, such as ratings. If this is possible I think I might have some work ahead of me. Thank you

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

2009-02-07, 03:00	#3
acaranta Junior Member Join Date: Jan 2009 Location: Mougins, France Posts: 27	It is possible from my point of view ... the real problem is to link the different sites ... For movies for example, you get the infos from ... let's say allocine.fr, you want picture from tvdb and rating from imdb ... the real issue I see is ... the missing link ... It would be easy if all the sites had a common ID (imdb ID is not available everywhere for instance), of if you could be sure all the site hev the same spelling for a particular title ... Butr theorically, it IS possible

2009-02-09, 15:05	#4
sstarcher Junior Member Join Date: Aug 2008 Posts: 9	Cool when I have some time I'll look into how to do it. Reason I was asking is I wanted to write a scapper for AniDB.net, but the problem is they have no art work outside of a single picture. So I wanted to use TheTVDB's artwork and episode information where possible. I talked to the guys over at AniDB and they are still working on there API, but they are slow.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)