PDA

View Full Version : Is DVD Order from TheTVDB scraper working?


ashlar
2009-02-03, 02:23
I've backed up the whole Buffy show. Season 6, in DVD, has 21 episodes. The first one being a double episode. When aired, there were 22 episodes.

Standard order on XBMC gives the wrong assignments to the episodes, as number 1 is number 1, but number 2 is number 3 (since episode one is 1+2).

Fine, there's a DVD order option in the scraper, I set that just for the Buffy share. 0 episodes found out of 144. If I select aired order 143 episodes are found (due to the aforementioned problem).

Edit: this is the order I'd need http://www.thetvdb.com/index.php?tab=season&seriesid=70327&seasonid=15&lid=7&order=dvd

althekiller
2009-02-03, 02:32
Did you name the first file properly as a multi-episode video? Where's the debug log?

kizer
2009-02-03, 02:33
Sometimes even 2 parters are labled as E01 and E02 even thou they are technically 1 episode

I'd bet they are
Buffy the Vampire Slayer - S06E01.avi
Buffy the Vampire Slayer - S60E02.avi
'
'
'
'
'
'
'
'
'
Buffy the Vampire Slayer - S06E22.avi

Worst case create some dummy files using notepad and change the .txt to avi and see if it finds them for the sake of testing. Thats how I learned how to use MIP "Movie Info Plus" because I wanted to make sure it didn't alter any of my files and sure enough it figured it out.

Of course you have to make sure you have all your files in the folders like so
Buffy the Vampire Slayer\Season 6\Buffy the Vampire Slayer - S06E01.avi

Just guessing of course and I could be completely wrong. ;)

ashlar
2009-02-03, 02:42
It's Buffy.s06e01.mkv and Buffy.s06e02.mkv, should it be Buffy.s06e01e02.mkv and then all the others till 22?

It kind of defeats the purpose of having a DVD order option if I have to rename the files differently (don't know, can't see the logic behind it, there might well be one).

Also, the strange thing is that all the other seasons are not found as well. And they are listed on TVDB.com as DVD order with 22 episodes each, it's just season 6 that gets a double episode.

Regarding the debug, I was pretty sure (and wrong) that debug didn't cover scrapers activities.

ashlar
2009-02-03, 02:51
Here's the debug log: http://pastebin.com/f18af6fde

The episodes are found, but nothing is stored in the database.

mattb
2009-02-03, 03:27
Confirming this with rev17541. Episodes aren't added to the database when the "DVD order" option is checked in the TVDB scraper settings. Without this option set, the episodes are added to the library. Log follows.

http://mattb.alwayssleeping.com/files/xbmc17541_tvshow_dvdorder.log

nekrosoft13
2009-02-03, 05:59
Confirming this with rev17541. Episodes aren't added to the database when the "DVD order" option is checked in the TVDB scraper settings. Without this option set, the episodes are added to the library. Log follows.

http://mattb.alwayssleeping.com/files/xbmc17541_tvshow_dvdorder.log

i can confirm same issue. ran into this problem with Firefly show.

have to use DVD order, because the default order is just wrong.

ashlar
2009-02-03, 11:08
Should we open a ticket on Trac? Is this Windows specific?

vdrfan
2009-02-03, 11:23
Please try again using a more recent daily build as there were some 'pathcleanup' related issues (and might still be). Until this is completely sorted its not really worth creating a ticket.

EDIT: Oops misread it, creating a ticket might be a right way :)

vdrfan
2009-02-03, 11:38
Mind trying the following modified tvdb scraper? http://xbmc.pastebin.com/m7f62e8a6

ashlar
2009-02-03, 13:30
Mind trying the following modified tvdb scraper? http://xbmc.pastebin.com/m7f62e8a6If nobody else will, I'll do it tonight. In the office currently. :;):

ashlar
2009-02-04, 01:37
Tried it... nothing changed.

Or... I had to select "this folder contains a single TV Series" and the scraper scraped the episodes (I had DVD order selected). Too bad that Season 6 still has the wrong order.

Unless... did I still need to do the s06e01e02 thing? Because I did not rename it and had s06e01 containing the double episode. 21 files in the directory, 21 episodes scraped. Only the season stops at episode 21 instead of 22 (starting with episodes 1 and 2 as separate episodes).

nekrosoft13
2009-02-04, 02:39
Mind trying the following modified tvdb scraper? http://xbmc.pastebin.com/m7f62e8a6

what was changed?

jmarshall
2009-02-04, 02:40
Your best bet would be to exam what thetvdb.com gives back in this respect.

ashlar
2009-02-04, 10:24
Your best bet would be to exam what thetvdb.com gives back in this respect.Meaning? I can see that the DVD order on tvdb is written in the x.y format. 1.0, 1.1, 2.0, 3.0... where the first two are the double episode.

Naming it s06e01e02 I have a working solution, with 22 episodes listed and the first two "together", in that if I play either of them both get selected. But I get this using the "aired" order, not the DVD order.

jmarshall
2009-02-04, 10:48
What I mean is the xml in the zip that xbmc downloads. If thetvdb.com is listing them both separately in the dvd ordering, then you'll need to use the multi-episode labelling of the first 2 episodes. If you take a nosy through your logs, it'll show you the URL of the zip file.

Cheers,
Jonathan

ashlar
2009-02-04, 12:50
What I mean is the xml in the zip that xbmc downloads. If thetvdb.com is listing them both separately in the dvd ordering, then you'll need to use the multi-episode labelling of the first 2 episodes. If you take a nosy through your logs, it'll show you the URL of the zip file.Ok, found it (and thanks for pointing me in the right direction). This is the xml portion dedicated to Season 6: http://xbmc.pastebin.com/m20974f2f
Is anyone able to tell me how to go about it?

Furthermore, the solution I have now is ok for my use. I guess for Firefly things would be far worse and really counterintuitive, considering there *is* a DVD order option in the scraper.

Edit: to make developers life easier, here's the xml referring to Firefly: http://xbmc.pastebin.com/m4dbc61dc

jmarshall
2009-02-04, 21:14
Notice that the DVD order in the first link you supply is identical to the aired order.

Thus, you'll need the multiepisode.

Similarly, the Firefly dvd order appears the same as the aired order as well according to the xml file at least, so I presume the same will supply.

If you think these are incorrect, then best take it up with thetvdb.

Cheers,
Jonathan

kizer
2009-02-04, 21:25
Heres what the aired order says and personally its how I would order my videos.
http://www.thetvdb.com/?tab=season&seriesid=70327&seasonid=15&lid=7

ashlar
2009-02-04, 22:49
Notice that the DVD order in the first link you supply is identical to the aired order.

Thus, you'll need the multiepisode.This still doesn't explain why I was getting zero episodes while scraping with DVD order.Similarly, the Firefly dvd order appears the same as the aired order as well according to the xml file at least, so I presume the same will supply.Check here and re-check the xml: http://www.thetvdb.com/index.php?tab=season&seriesid=78874&seasonid=15791&lid=7&order=dvd&order=aired the two orders are *far* from being the same (unless the xml is completely different from what they correctly display online).

ashlar
2009-02-04, 22:54
Heres what the aired order says and personally its how I would order my videos.
http://www.thetvdb.com/?tab=season&seriesid=70327&seasonid=15&lid=7Sorry, this is a backup of the whole DVD set (for real, I'm no stranger to downloading stuff, but Buffy I own :)). On Season 6, disc 1, you have 3 episodes, not 4. Three video files. The first one includes two episodes.
Having compressed them to x264, I get three .mkv files.
On MediaPortal's TV-Series, by choosing DVD order I get the correct 3 episodes selectable (first one is Bargaining, two episodes in one, as it's a single file). On XBMC I don't.

I'd strongly argue that, in this case, MediaPortal's behaviour is the desirable one. You need DVD order when you are scraping for DVD backups. And this avoids a manual step. Again, leaving Firefly aside (check it) which would be really not smart to do manually...

nekrosoft13
2009-02-07, 06:11
any news on this?

still can't scan Firefly with dvd order, it just keeps sating 0

vdrfan
2009-02-07, 12:28
any news on this?

still can't scan Firefly with dvd order, it just keeps sating 0

You've already tested the modified scraper posted by me?

nekrosoft13
2009-02-07, 23:48
You've already tested the modified scraper posted by me?

episdoes got scanned, but your version of scrapper ignores DVD order setting.
I had selected DVD order, but it scanned episode in this order
http://thetvdb.com/?tab=season&seriesid=78874&seasonid=15791&lid=7

correct order of episodes is the DVD order
http://thetvdb.com/index.php?tab=season&seriesid=78874&seasonid=15791&lid=7&order=dvd


it will add the episodes but in the wrong order.

Sorry, but that doesn't fix anything, it was fine about 2 weeks ago, i don't remember in which build it changed.

ashlar
2009-02-08, 02:55
episdoes got scanned, but your version of scrapper ignores DVD order setting.
I had selected DVD order, but it scanned episode in this order
http://thetvdb.com/?tab=season&seriesid=78874&seasonid=15791&lid=7Exactly what I already reported in post #12.

nekrosoft13
2009-02-08, 04:13
maybe i missed the post

i want my Firefly in correct order :eek:

paco
2009-02-08, 05:37
I don't know if it's related, but I can't get any TV Shows to update with the latest releases. I added 5 episodes of one series and 2 of another. Even manually refreshing, I get no info. Everything was working fine the last time I added TV Shows (a week and a half ago).

I restored my backup and started trying SVN's I had on my system. Of the old SVN's I had handy, 17341 works fine, but 17484 or anything greater, doesn't scan my TV series (movie scans are unaffected by newer SVN's). I'm not certain when it was broken.

althekiller
2009-02-08, 05:53
I don't know if it's related, but I can't get any TV Shows to update with the latest releases. I added 5 episodes of one series and 2 of another. Even manually refreshing, I get no info. Everything was working fine the last time I added TV Shows (a week and a half ago).

I restored my backup and started trying SVN's I had on my system. Of the old SVN's I had handy, 17341 works fine, but 17484 or anything greater, doesn't scan my TV series (movie scans are unaffected by newer SVN's). I'm not certain when it was broken.

No, it's not related. Please start a new thread, or better yet, latch on to one that is actually on-topic (yes there are some).

vdrfan
2009-02-08, 14:13
maybe i missed the post

i want my Firefly in correct order :eek:

Mind creating a dummy show folder with given episodes as 0byte files so we can reproduce it? Please file a new bug report (xbmc.org/trac) and attach a dummy show folder + debug log.

ashlar
2009-02-08, 19:58
maybe i missed the post

i want my Firefly in correct order :eek:It wasn't a retort, just confirmation. :D

Edit: tried with fake files, with a different build... now things get strange. This is a build (unfortunately I don't know the SVN version and the debug doesn't specify it, apart from it having been built on Jan 10th) older than current. And the scraping worked perfectly.

Not only the DVD order was respected, but the first episode (check here http://thetvdb.com/index.php?tab=season&seriesid=78874&seasonid=15791&lid=7&order=dvd) is correctly set as a single Serenity episode. So with 14 files I am left with 14 episodes, even if the first one is named firefly.s01e01.mkv and not firefly.s01e01e02.mkv. This is the correct behaviour, the one I was seeking for Buffy. Here's the log: http://xbmc.pastebin.com/m7b066102

I will try adding Buffy with this build, then download one of the latest ones and see if the behaviour differs (from past experiences it will).

Edit 2: same build, added Buffy 6th Season with episodes from s06e01 to s06e21 (no special naming, nothing) and DVD order got it right with no problem (so I was right, the special naming is not needed for DVD order if it works correctly). Log: http://xbmc.pastebin.com/f40572d66

Edit 3: Jester build SVN 17621. Same naming, same folder structure. No episodes get scraped. Log: http://xbmc.pastebin.com/f5308cc7e

ashlar
2009-02-08, 22:56
Ticket: http://xbmc.org/trac/ticket/5871

nekrosoft13
2009-02-09, 01:56
here is the firefly dummy files

http://www.mediafire.com/download.php?ztznnwylwzg

vdrfan
2009-02-09, 09:26
here is the firefly dummy files

http://www.mediafire.com/download.php?ztznnwylwzg

Please attach the dummy files and the debug logs to the ticket. Otherwise they will get lost in the pastebin nirvana ;)

nekrosoft13
2009-02-09, 19:36
done

natethomas
2009-02-24, 23:30
I was just curious if this has been resolved at all. I haven't downloaded an extremely recent build yet. My current method to work around the issue is to install an old build, scrap, export to nfo, then install the most current build and scrape (thereby importing the nfo info). Any chance I can stop that?

nekrosoft13
2009-02-24, 23:46
i don't know what happened, but every few days i tried to scrape Firefly to see if it does it correctly, about 2-3 days ago it scrape it correctly, in correct DVD order.

it was probably somewhere around XBMCSetup-Rev18025.

give it a try.

natethomas
2009-02-25, 10:52
You are correct. Everything appears to have worked perfectly fine. Sweet!

ashlar
2009-02-25, 10:56
??? Did it fix things by itself?

The ticket shows zero changes.

theuni
2009-03-27, 05:24
The ticket now shows a change ;)

TheUni