[RELEASE] DVDProfiler importer script - import the movie database from DVD Profiler

[BigBellyBilly]

Do you use the PC application 'DVDProfiler' to catalogue your DVD collection ?
Then this is the script for you, as it gives you the ability to view your own collection (XML via SMB) or any other online (alias) collection.
Also has IMDb lookup on selected title.

Basic instructions:
1) set a PC SMB share on <install dir>/DVDProfiler/
2) export XML to .../DVDProfiler/EXPORT/collection.xml
3) run script and point to the SMB share.

Should be on XBMCScripts.com (http://www.xbmcscripts.com) soon.
Requires a post sept. XBMC build.
Thanks to those who helped me test it.
Any probs, just ask.
cheers
BBB

[BigBellyBilly]

v1.1 now on XBMCScripts.com (http://www.xbmcscripts.com/index.php?option=com_docman&task=doc_download&gid=385&Itemid=Array)

Changelog:
New: Startup mode selection.
1) SMB 2) Local 3) Online
New: Filters. Select multiple and/or combinations of:
1) Genre 2) Tags
New: Main Menu options:
Filters, Fetch All Images,
New: Config Menu option:Always Startup Mode Local
Change: Overscan setup - Now uses own window that moves arrows.
Change: Direct access buttons no contect sensitive (according to startup mode).
Change: Improved IMDb
Change: Improved foreign characer handling.
Change: Code reorganised into libraries.
Change: Several cosmetic tweaks for different rez.
Change: Lots of other minor improvments.


Thanks to Arboc & baldtelf for their code contributions/testing of this version.
I guess that makes at least 3 users ...

Any probs/suggestions, let me know.

[HarshReality]

I'll give this a spin when I get home tomorrow looks really promising. As I am not too awful familiar with it cant comment much as yet but if it works as I think it might I have alot of my series TV shows on DVD (1 Season per DVD)... might be able to make a really good use of it.

[HarshReality]

Billy, question.. it started up with the selection option (smb etc.) but its telling me I am missing Image.py.. might need to update it for ImageLib.py

[BigBellyBilly]

not sure why that would be unless the ImageLib really is missing?
If it is then the xbmc.log would indicate an error stating so.

Can you run myTV or any other script that uses images ?

What build of xbmc are you running ?

DVDProfiler itself is an excellent PC app. for cataloguing collections, really easy to use. Highly recommend it (its free too)

[BigBellyBilly]

sorry didnt see your sig for the xbmc build (had them turned off in user options)

but I have to point the finger first at dash: xbmc (self compiled custom) and say, try a standard T3CH build.
I've checked with several people all using different builds and it runs without a prob.

[Seanster]

Just tried v1.2 with a 45 mb collection.xml.
It copies it to the cache then chokes on it.
After that, it continually chokes on the cache copy.

the error in the dialog box appears truncated but the gist of it is
"readfile() bbbLib.py in line 200"

[BigBellyBilly]

45mb. Do you forfeit sleeping in order to watch that lot? How many films is that ?

Anyway, thats way more than I've ever tested against so its probably blowing memory as it attempts to read the whole file.

Any chance you could send me the xml so I can make changes and test against it ?
Send it to bigbellybilly AT gmail DOT com (you'll have to use a hosting service such as www.yousendit.com otherwise gmail will probs reject it)

Do you also upload your collection to the online service, if you do, does it work against that (as selected from startup menu) ?
Please PM/mail me your online collection ID, so I can test against that too.

Thanks for letting me know.
BBB

[Seanster]

The collection belongs to a friend of mine. This collection file has 3382 entries. I peeked into your code, it is definitely going to chew through more memory than is available. I didnt look at how it parses the data, but I would assume we are looking at storing the original complete file plus the parsed data, however much that would be.

He doesn't have an online collection. I emailed you a rar file if you want to check it out.

[BigBellyBilly]

I do have an idea how to fix it. I didnt get the file to gmail - try www.yousendit.com method as that just send a link.

thanks

[maccadon]

Great script but i got a request.
I use it with my online alias
Is it possible to change the www.intervocative.com/dvdcollection.aspx/alias
to http://www.invelos.com/dvdcollection.aspx/alias?
This is their new site.

Thanx in advance.

[BigBellyBilly]

All to be taken care of in next release. thanks for the interest.

BBB

[BigBellyBilly]

Hi.

I'm working on DVDProfiler script to accomodate v3 and the new hosting site of www.invelos.com

I need some help with the new site as I dont have a registration and it limits upload to 50 titles.

Seems that the cover images come from this URL

http://www.invelos.com/mpimages/50/<cover_id>f.jpg

Im unsure if the /50/ in the URL is the same for all users or is that just for unregistered accounts?
If you could view your online collection then look at the Properties of a cover image to check, that would be a big help.

Thanks

[BigBellyBilly]

ignore that request, i've sussed that the subpart of the url is always the first 2 digits of the cover_id.

If someone has a full www.invelos.com registered account and would like to beta test it for me, please drop me a PM or mail me please.

ta.

[BigBellyBilly]

new v1.3 up on xbmcscripts.com

Changes:

Works with both v2 (Intervocative) & new V3 (Invelos) DVDProfiler.
Handles much larger collections (tested upto 2100 titles).
Fixed IMDb lookups (due to site changes)

Any problems let me know.

cheers
BBB

[BigBellyBilly]

Does anyone have a large (2000+ titles) online collection (V2 or V3)? if you do could you PM me your alias so I can check on a few things ?

cheers
BBB

[SteveK]

Nice script. Thanks for sharing it!

[SteveK]

I'm using the on-line mode to get my DVD profile from Invelos. Everything works fine, I can see my collection, but the "Additional Information" fields for each DVD show only "N/A". For example, Rating, Runtime, Region, etc all show N/A for every DVD. :confused2:

[BigBellyBilly]

They've probably changed the html layout that its scraping from. I'll need to re-check it.

[Mcgeiver]

Everything working on install and network linking to collection.xml (script verifies the connection) can browse my movie collection after ftp file to xbox, but if using SMB enabled option progress dialog shows 100% and "success" then locks up.

Any help would be appreciated

[BigBellyBilly]

its nearly always a samba path / setup or PC access problem.

Ensure the PC user has full permissions on PC etc.

alternatively, enable DEBUG (in bbbLib.py) and set loglevel to 1 in xbmc's advancedsettings.xml then re-run and send me the xbmc.log

[Mcgeiver]

I've enabled debug = True in the bbblib.py. However, I can't find any advancedsettings.xml anywhere in the XBMC directory structure.

Is that the correct file?

I've no problems in other areas of XBMC accessing shares.

Thanks

[BigBellyBilly]

v1.5 now available on www.xbmcscripts.com

Changes since v1.3

New: Uses UserData for all storage (settings, collection, images ...)
New: Language support (only english supplied)
New: SMB Config; To specify DVDProfiler Share
New: SMB Config; To specify subfolders for EXPORT and IMAGES
New: SMB Config; To specify Movies Share
New: Media playback on A button for titles that have Location defined in the v3 XML
Change: Config Menu option "Start Local?" to "Startup Mode:" [MENU,SMB,LOCAL,ONLINE]
Fix: IMDb information scrapes
Fix: IMDb information window layout cleanup.
Fix: Online Collection retrieval of information.
Change: Main script and supporting libs code.
Fix: Improved SMB setup and ironed out some quirks.
New: Checks for newer collection via SMB
New: Animation on Open/Close
New: Config Menu option to check for new script update.

Readme updated to explain a bit more about new SMB setup.

fyi AdvancedSettings.xml only exists if you create it in xbmc's UserData folder
Create file then enter this to enable more logging to xbmc.log

<advancedsettings>
<loglevel>1</loglevel>
</advancedsettings>

[smcnally75]

Hi Billy,
How do I use your script? I'm new to this so please bear with my ignorance. I put the followed the information in the readme file, went to XBMC scripts, found the dvd profiler script and selected it. Then it said it installed it but I don't know what to do from there. I can't find anywhere to enter my information or where to even run the script. It doesn't show up in the list of scripts, and if I then click on the button labeled "Scripts" XBMC just goes to a blank screen. Can you help out a guy that is completely lost?

Thanks,
-Steve

[BigBellyBilly]

The script will have been installed to the folder Q:\scripts\DVD Profiler.

Selecting the Scripts button on the xbmc home page will take you to a folder full of script icons, you click on the script icon to run it (it can also be added to your favourites by selecting the white button)

If you don't get the scripts display, I'd suggest your xbmc isn't installed corrected, you need to see help elsewhere.

This script looks to your remote PC (via a share) for all your DVDProfiler information and displays it. The readme has more detail on setup and use.

but, you need to sort out your xbmc installation first.

BBB

[jeepcook]

Hello,
Actually in dvd profiler, we can only chose to view infos from imdb. Is there a solution to change this by allocine (from france),

Thanks

[BigBellyBilly]

imdb is the only supported online information resource.

is there a reason why you would want to use allocine instead ?

[jeepcook]

imdb is the only supported online information resource.

is there a reason why you would want to use allocine instead ?

Yes !! I'm french !!

[zakhounet]

Hi BigBelly,

Very nice job ;-)

I am using the 'local' way to view my collection, but i can't launch my DVD (.ISO), where do I have to fill the location of the file ??

Thanks

[BigBellyBilly]

DVDProfiler v3 allows you to store a 'location' against each title.

The script will append this location onto the SMB movies path you need to define in the settings.

I've done some work on the script recently, added language and self updating support, as well fixed IMDb lookup etc. should be out next week if I get the time to finish it.
BBB

[BigBellyBilly]

zakhounet: I can see that if your only using DVDProfiler in 'Local' mode that appending your stored media 'location' to a smb won't work. I've changed the script so that if your in local mode it won't join to a smbpath but attempt to playback from local storage. Your stored 'location' path will have to reflect this. eg 'E:\myvideos\Ronin.iso' or simliar

[BigBellyBilly]

Changelog:

Change: Removed ClientCookie.py by using python 2.4 cookieLib instead.
Change: Self update improved.
Fix: IMDb
New: German language strings.
New: IMDb Slideshow of gallery images
New: Filter of 'Location' - Show only films with a location stored in XML (DVDPro v3 only XML)
New: For V3 XML, titles with Location have icon displayed and can be filtered.
New: Setting option to set startup mode (Menu,SMB,Local,Online)

on http://www.xbmcscripts.com

any problems, let me know.

BBB

[zakhounet]

thank Big, I will try it asap

:grin:

[poppo]

Everything working on install and network linking to collection.xml (script verifies the connection) can browse my movie collection after ftp file to xbox, but if using SMB enabled option progress dialog shows 100% and "success" then locks up.

Any help would be appreciated

I am having a similar problem. What I found is that after the collection.xml is 'processed' the images are. and that is where it is locking up. Im not sure if the script tries to copy the image files as is, or if it tries to resample them, but here is an examp,le of what happens.

For my first movie (i.e. The 6th Day) the DVD profiler image is named (doing this from memory so it's just an example) 987652321i.jpg. But the image that the script is trying to create is named 09876543210i.jpg (note the extra lading zero and the extra number near the end. This file gets 'stuck' as a zero byte file and the xbox locks up.

Now if I manually copy the image over and rename it to what the script is calling it (the one with the extra numbers) the script will succcessfullly start in SMB mode and the image for the first movie (6th Day) is displayed. However as soon as I select another title, it locks up again as it tries to create/copy the image.

So, here are my thoughts:

1. SMB is working since it does fetch the collection.xml file.
2. I have upgraded from a previous version of DVD Profiler to V3, so I don't know if there is some discrepency in image names (i.e. the script is looking for the longer name and can't find it and thus locks up when it is creating/copying it.
3. I use high quality mode images for DVD Profiler
4. I don't know why the file names are different and if it's a 'can't find' issue as stated in #2, or if there is a problem with the conversion if the image is being resampled.

[BigBellyBilly]

Hi.

thanks for the feedback.

When people have contacted me about this before, its usually down to them not setting in the scripts settings menu the correct subfolder where the cover are located.
This is a different location than v2 DVDProfiler.

The image filenames are taken from the XML, the DVD's <ID> tag
eg. 0043396062498.2 and append 'f.jpg' (0043396062498.2f.jpg)

Look in the collection.xml and find the film '6th day' then make a note of its <ID>
Then search for *id_num*.* in the remote PC's images subfolder. It could be that the 'f.jpg' I append ontot end isn't true for hi-rez images?


If you've found that your hi-rez cover don't match these filenames, let me know.

You can do two things;
1) send me (a zip) of your v3 collections file with a few of the first few films cover images, so I can try and re-create your problem.
or
2) run it in debug mode and send me the xbmc.log.
You will need to create a file in UserData called AdvancedSettings.xml
and in it have
<advancedsettings>
<loglevel>1</loglevel>
</advancedsettings>

cheers
BBB

[BigBellyBilly]

Heres an example settings showing that I have a the main smb share:

'smb_dvdpro_share': 'DVD Profiler'
'smb_images_dir': 'Databases/default/IMAGES',

so its expects the given images subfolder to exist under your defined smb share.
smb://user:pass:PCNAME/DVD Profiler/Databases/default/IMAGES

The collection.xml is brought from the other subfolder definition:
Defined as eg 'smb_collection_dir': 'EXPORT'
making:
smb://user:pass:PCNAME/DVD Profiler/EXPORT

Does that example help you check your serttings ?

BBB

[poppo]

Heres an example settings....

'smb_images_dir': 'Databases/default/IMAGES',

so its expects the given images subfolder to exist under your defined smb share.
smb://user:pass:PCNAME/DVD Profiler/Databases/default/IMAGES



Hmmm.... That may be the problem. I have it pointed to DVD Profiler/Images directory which may be the old DVD Profiler 2 location and not the one you show as being under databases/default. I'll look at it when I get home. If that's the case, a note might need to be made to let people know that if they updated from a previous version of Profiler, the images are in a different place as updating did not remove the old ones.

[poppo]

Ok, problem solved after a little hair pulling. It was indeed the location of the images and the location change from DVD Profiler v2. My v3 images are buried in My Documents. After sharing that directory as Images, and after deleting the dat files in the script data cache directory, that the script had previously made (because it still locked up) all is well.

Something I would suggest. Perhaps put an options screen on the main choice screen because once you set the SMB settings you can't easily get back into them (if you made a mistake and things lock up). You can get to them by going into local mode first, but if that locks up, you have to FTP in and delete stuff to start over.

Also as mentioned above, perhaps the readme.txt could expand on the different image locations between v2 and v3.

Anyway, this is a great script. It saves me time from having to fire up the computer every time I want to look something up. And DVD Profiler v3 is no speed demon on loading.

[BigBellyBilly]

"Perhaps put an options screen on the main choice screen"

could you explain a bit further? Do you mean 'Settings option on the 'Startup Menu' ?

As you say entering into Local mode gives you access to Settings menu, not sure why it would lockup in that mode thou as it doesn't do any SMB transfers (for covers etc).
There is a Clear Data option in Settings Menu, maybe that wouldve helped?

I could expand the SMB menu to check that all the entered paths exist as well as just the SMB connection check.

and I'll expand the readme, tbh, someone promised me to re-write it for me but I never heard back from them.

Anyway, glad you got it going. As your a v3 user, have you tried the video playback feature as v3 now holds media location?

cheers
BBB

PS. any contributions for a better script logo most welcome!

[poppo]

"Perhaps put an options screen on the main choice screen"

could you explain a bit further? Do you mean 'Settings option on the 'Startup Menu' ?

As you say entering into Local mode gives you access to Settings menu, not sure why it would lockup in that mode thou as it doesn't do any SMB transfers (for covers etc).
There is a Clear Data option in Settings Menu, maybe that wouldve helped?

I could expand the SMB menu to check that all the entered paths exist as well as just the SMB connection check.


Yes, I meant on the main startup menu. I guess I was thinking that if someone is trying to use SMB and it's locking up, they may not know they can get to the SMB settings through the local mode. Again, the reamde is a bit lacking on what files need to be FTPed and where to put them, so some may not even try it. It took me a little while to figure it out and it was really just by accident.

Yes, the clear data probably would have helped but I was already getting proficient at knowing what to delete to start over.;)

Expanding the SMB connection check would probably help or at least have the main script just error out if the files it's looking for are not where it was told by the SMB settings. As it stands now, it looks like it tries to create the jpg first (thus the 0 byte file) and then dies if the source is not there.

I have not tried the option to actually play videos yet because I don't have them 'on line' yet. But it looks like a nice feature.

Anyway, in no way am I trying to nit pick. I know a lot of work goes into these things and I for one appreciate it. Thanks!

[Zahnmeister]

hello,

first I want to say that the dvdprofiler script is awesome. Thanks a lot BigBellyBilly!

I think I found a bug in the new version 1.6:
I use DVDProfiler v3 and xbmc (self compiled build from march 2008) in combination with the dvdprofiler script v1.6 in local mode.
I was wondering, because the additonal movie information isn't displayed any more (after the description only "N/ AN /AN /AN Video: N/ AN/ AN/ AN ...").
I searched the bug and figured out, that in case of a german "umlaut" (ä, ö, ü) or of a german "scharfes s" (ß) in the movie description, the additional movie information is not displayed.
I come from Germany and in almost every movie description there are those characters. In v1.5 everything worked great.

You can simply reproduce the bug by adding one of those characters to the movie description. It would be great if you could fix this :)

[BigBellyBilly]

I look into it, thanks for letting me know.

[BigBellyBilly]

please send me a sample of your v3 collection.xml, that has the offending characters, so I can try and make a fix .


thanks
BBB

[jeepcook]

Hello,

I have a problem with dvdprofiler xbmc 1.6.

With dvd profiler 3 I created collection.xml. I have 655 dvd.

I put it in the folder cache, dvdprofiler 1.6 generate only 578 dvd. where are the others ? when I edit the collection.xml file, the DVD that don't appear on the plugin are OK in the file. No active filter ...

Could you please help me ?

Thanks

[BigBellyBilly]

sure, mail me a rar/zip of your collection.xml and I'll see what I can find. email address in the readme.txt included with script

[jeepcook]

In fact, I caused myself the problem !!

I changed a little your script to show <slot> instead of <CollectionNumber>, because I need this parameter to exploit my collection, without that I need to launch window dvdprofiler version to find the dvd. So it seems that this parameters don't have to be duplicate and I have for dvds the same slot number.

If I use your original script I have no problem but slot information is unavailable ..

How to modify your script to show this parameter ?

Another problem is that I'm french so we have a lot of special caracters é î ' .... all this characters are badly showed. For a lot of DVDI have N/AN/AN/A... that appears after overview and video: .

I send you by mail my collection.xml

It would be nice to find a solution for me !

Thanks a lot.

[jeepcook]

Sorry BBB, but I can't find you email adress to send you my collection.xml.. please pm me.

[wintermute115]

Is XBMCScripts.com down? I'd really love the opportunity to play with this and see if it'll work for me, but I can't get at the site.

Is there another source I can download it from?

Thanks.

[BigBellyBilly]

it is down at moment.

get script for a limited period from this link http://www.yousendit.com/download/bVlES3d1cTJ1Yk5MWEE9PQ

[Cheekyboy]

I love the script, but it would be even better if there was a plugin version so that the DVD's appeared in the library view of xbmc. Is that on the radar by any chance?

[BigBellyBilly]

It is on radar, along with a xbmc 'Atlantis' compatiblity update.

I'd be interested in what you'd expect a plugin version to show ?

[Cheekyboy]

It is on radar, along with a xbmc 'Atlantis' compatiblity update.

I'd be interested in what you'd expect a plugin version to show ?

Personally I'd just like it to perform as if it was in normal xbmc library mode and support all the normal skin views. I dont know if its possible to fully integrate it within the current library views for genre, title etc but I'm not sure if that would be a good or a bad thing really anyway. I guess it might be if you could exclude them (for those times when you cant be bothered to prose yourr butt off the sofa to look for the disk :))
I think a plugin on the same lines as the apple movie one would be fine.
I think it would be good if should you attempt to play a DVD it could display a screen with the DVD number on.
Before I found out about your great script I did have a little play with building jpg files with the disc number on and naming them as "myfilm blah.avi" and adding them to the normal library. That concept seemed to work well but I just never got round to building all the image files.

[BigBellyBilly]

If your using DVDProfilerv3, the script now allows you to store each DVD library number and it shows up in the list of infos.

I'll give the plugin ver some consideration before I do it.
thanks
BBB

[djerock]

i would like to know where to get this plugin i cant seem to find it anywhere and the link is still down..

[BigBellyBilly]

Your requested prompted me to finish and release the latest version. v1.7
Skinned and Atlantis compatible.

Get it from this link (http://www.box.net/shared/x83hi76bys)

[p|cky]

I may be doing something wrong but can i get your script to run a windows PC running xbmc?

[Olli]

hallo Guy's

I need help with my DVD collection.
I have a huge collection of DVDs and store all the information about it in a program called DVD Profiler.
So, all the information’s in the program, I would like to transfer to XBMC.
Does anyone have the same problem like I do or have a idea how I can transfer the information?

At the moment I use the way described in the following thread http://xbmc.org/forum/showthread.php?t=40329&highlight=library.csv. The problem is, I have to download all the information again, allocate the storage location and have to correct them.
Is there any way to generate an Excel or CSV file with all the Information about the movie and load this into the XBMC movie Base?

About help, I would be happy :grin:

Thank You