XBMC Community Forum  

Go Back   XBMC Community Forum > Development > Scraper Development

Scraper Development Developers forum for meta data scrapers. Scraper developers only!
Not for posting feature requests, bugs, or end-user support requests!

Reply
 
Thread Tools Search this Thread Display Modes
Old 2009-04-13, 18:03   #1
ababak
Junior Member
 
ababak's Avatar
 
Join Date: Apr 2009
Location: Kiev, Ukraine
Posts: 8
ababak is on a distinguished road
Send a message via Skype™ to ababak
Thumbs up KinoPoisk2 (Russian Movies) Scraper

Hi,

Let me present another KinoPoisk.ru scraper. It's a completely re-worked scraper Kinopoisk.ru with following features:
  • Optimized regexps
  • Low-res cover if no poster present (really helpful on some old movies)
  • Artists' roles
  • Can fetch movie stills fanart, wallpapers fanart, or both
  • Fixed incorrect parsing of outline/plot

Download version 1.0 of KinoPoisk2 from here:
http://files.me.com/andrey_babak/gtxbcl

P.S. I'd like to thank spiff for his help!

Last edited by ababak; 2009-04-14 at 01:57.
ababak is offline   Reply With Quote
Old 2009-04-13, 18:35   #2
spiff
Grumpy Bastard Developer
 
spiff's Avatar
 
Join Date: Nov 2003
Posts: 7,715
spiff is on a distinguished road
Default

awesome for you russians

one question though; what does that ServerEncoding tag do?
__________________
Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.
spiff is offline   Reply With Quote
Old 2009-04-13, 22:43   #3
diemos
Senior Member
 
Join Date: Feb 2009
Posts: 154
diemos is on a distinguished road
Default

you are the man! spasibo balshoye. I was waiting for this.

Zemlyak, ya tozhe s Kieva teper v NY.
__________________
The Transforminators HD Movie Trailer
- from the creators of Terminator and Transformers -
diemos is offline   Reply With Quote
Old 2009-04-14, 01:30   #4
ababak
Junior Member
 
ababak's Avatar
 
Join Date: Apr 2009
Location: Kiev, Ukraine
Posts: 8
ababak is on a distinguished road
Send a message via Skype™ to ababak
Default

Quote:
Originally Posted by spiff View Post
awesome for you russians

one question though; what does that ServerEncoding tag do?
I didn't check the source of the parser but as far as I can tell looking at the original scraper, it defines how the external URLs are parsed. Maybe it just does nothing though ;-) (or works in Plex only)
ababak is offline   Reply With Quote
Old 2009-04-14, 01:38   #5
spiff
Grumpy Bastard Developer
 
spiff's Avatar
 
Join Date: Nov 2003
Posts: 7,715
spiff is on a distinguished road
Default

i know that it must be a plex thing as i wrote the scraper parser and most of the surrounding code
__________________
Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.
spiff is offline   Reply With Quote
Old 2009-04-14, 01:41   #6
ababak
Junior Member
 
ababak's Avatar
 
Join Date: Apr 2009
Location: Kiev, Ukraine
Posts: 8
ababak is on a distinguished road
Send a message via Skype™ to ababak
Default

By the way, does the parser handle server encoding returned in headers? It would be great to make scraper completely UTF-8
ababak is offline   Reply With Quote
Old 2009-04-14, 01:45   #7
spiff
Grumpy Bastard Developer
 
spiff's Avatar
 
Join Date: Nov 2003
Posts: 7,715
spiff is on a distinguished road
Default

scraper code does honor the encoding you set on the returned xml.

i guess the ServerContentEncoding is used to convert the html pages to utf-8 prior to passing them to the scrapers. i will dig in the plex git

edit: dug a bit. it's nonsense from the plex devs. the servercontentencoding is just a dupe of the encoding set on the returned xml
__________________
Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.

Last edited by spiff; 2009-04-14 at 01:49.
spiff is offline   Reply With Quote
Old 2009-05-14, 17:02   #8
hamp
Skilled Skinner
 
Join Date: Jul 2008
Posts: 56
hamp is on a distinguished road
Default

When xbmc load info from the site, Kinopoisk.ru ban me about 30 minutes. Because of what? At the Plex this does not happen.
hamp is offline   Reply With Quote
Old 2009-05-14, 18:24   #9
TigerHeart
Junior Member
 
Join Date: Feb 2009
Posts: 11
TigerHeart is on a distinguished road
Unhappy Scraper doesn't work

I try to get info about the movie Butterfly effect (I type movie name in russian - "Эффект бабочки"). But the scraper returns me next list of movies:
==============
Интервью с вампиром
Сделка с дьяволом
Мадагаскар 2
Ирония судьбы. Продолжение.
Загадочная история Бенджамина Баттона
Суини Тодд,демон+парикмахер с Флит-стрит
==============
And I see the same list every time when I try to get info about any movie. Whats wrong?
Thanks.
PS. I made the screenshots, but I can't understand how to attach them here. But I can send them to anyone by e-mail.
TigerHeart is offline   Reply With Quote
Old 2009-05-14, 20:42   #10
GooglieS
Junior Member
 
Join Date: Oct 2008
Posts: 7
GooglieS is on a distinguished road
Default

This script does not load any information/art from kinopoisk! Something is broken?
//не работает! фильм из списка находит, но никакую инфу с кинопоиска не подгружает Что делать?
GooglieS is offline   Reply With Quote
Reply

Bookmarks

Tags
kinopoisk, russian, scraper


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +2. The time now is 15:23.


Protected by Akismet, We recommend WordPress blogs
Copyright © 2008, XBMC Project