Large Library = Slow Performance?

[Duduke]

Hi All,

Is anyone else experiencing extremely low performance (FPS=1 CPU=100) when browsing a library that has 200+ items?

[SandmanCL]

I have 562 items in my video library and don't see that problem.

[BLKMGK]

Nor here, I too am umm "over" 550. Response is damned good.

[Duduke]

Is your performance still fast even after getting the IMDB info and movie poster for all your movies?

[BLKMGK]

Almost all of my IMDB info was brought down on the XBOX and transferred over. I'm not sure I have poster stuff downloaded but I do have actor info etc.. A problem I have, since I'm not using the XBOX controller and thus sometimes have issues figuring out how to do certain things like update movie info and delete sources. I'll try to get around to figuring that out and get back, hopefully someone else has a fully loaded up database and can comment too.

[xgrep]

My library is chunky as well. About 200 movies, mostly populated with IMDB info.

Haven't noticed things like 1fps, but when I'm in Library mode scrollers start/stop constantly and if I play a movie it start/stop/skips a lot. Dropping out of Library mode and everything is fine again (may require xmbc restart, I forget).

Next time I try I'll compile with debugging enabled and check things like mem/cpu/fps etc...

[Weavus]

I have issues with my library when I try and look at actors. I have 2500 movies indexed which has created over 300,000 actors and it takes a good minute or two to show the actors index screen!

I'm thinking about parsing the nfo's to only contain 5 or so actors per movie as most of them are bit parts etc...

[anthonyfellows]

I have around 800 movies, using the ICON view so the movie posters are displayed and it seems to be as fast scanning through them as it was when I used the LIST view. Only problem I have is that I need to figure out how to manually change some of the info that imdb put in there, because it's not all correct.

[C-Quel]

I have issues with my library when I try and look at actors. I have 2500 movies indexed which has created over 300,000 actors and it takes a good minute or two to show the actors index screen!

I'm thinking about parsing the nfo's to only contain 5 or so actors per movie as most of them are bit parts etc...

Why not just switch off "Full Cast" because by my calculation thats over 100 actors per movie which sounds to me like you have it enabled in scraper settings. Disabling this could chop 75% of the unimportant cast from being added to the db.

[notdenizen]

My library is chunky as well. About 200 movies, mostly populated with IMDB info.

Haven't noticed things like 1fps, but when I'm in Library mode scrollers start/stop constantly and if I play a movie it start/stop/skips a lot. Dropping out of Library mode and everything is fine again (may require XBMC restart, I forget).

Next time I try I'll compile with debugging enabled and check things like mem/cpu/fps etc...

I've got exactly the same problem, I posted a thread about it here. (http://xbmc.org/forum/showthread.php?t=30326)
It's strange that people with larger libraries than mine are not experiencing it though.

[Duduke]

Whenever I enable the 'Library Mode', CPU spikes to around 16% and I get this repeating message in the Log:

20:39:22 T:2962807696 M:677642240 DEBUG: Running thread 2962807696
20:39:22 T:2962807696 M:677642240 DEBUG: thread start, auto delete: 0
20:39:22 T:3057063776 M:677642240 DEBUG: Load defaultFolderBig.png: 2.3ms (bundled)
20:39:22 T:3057063776 M:677642240 DEBUG: Load list-focus.png: 4.7ms (bundled)
20:39:22 T:2962807696 M:677642240 DEBUG: staticThread, deleting thread graphic context
20:39:22 T:2962807696 M:677642240 DEBUG: Thread 2962807696 terminating
20:39:22 T:3057063776 M:677515264 DEBUG: CGUIMediaWindow::GetDirectory ()


When diving into 'Titles' CPU goes 100% and I have the following messages in the log:

20:45:30 T:3057063776 M:654364672 DEBUG: Load /opt/XBMC/UserData/Thumbnails/Video/3/3db38c94.tbn: 31.0ms
20:45:30 T:3057063776 M:653885440 DEBUG: Load defaultVideoBig.png: 2.3ms (bundled)
20:45:30 T:3057063776 M:652226560 DEBUG: Load /opt/XBMC/UserData/Thumbnails/Video/2/2644803f.tbn: 27.0ms
20:45:31 T:3057063776 M:650162176 DEBUG: Load /opt/XBMC/UserData/Thumbnails/Video/5/58fd3f0c.tbn: 28.9ms
20:45:31 T:3057063776 M:649019392 DEBUG: Load /opt/XBMC/UserData/Thumbnails/Video/0/0c2b1ff5.tbn: 27.8ms
20:45:31 T:3057063776 M:648687616 DEBUG: Load list-focus.png: 4.7ms (bundled)
20:45:31 T:3057063776 M:646840320 DEBUG: Load /opt/XBMC/UserData/Thumbnails/Video/6/639a7ed3.tbn: 28.8ms
20:45:31 T:3057063776 M:669884416 DEBUG: CGUIMediaWindow::GetDirectory (videodb://1/2/)
20:45:31 T:3057063776 M:669884416 DEBUG: ParentPath = [videodb://1/2/]
20:45:31 T:3057063776 M:669884416 WARNING: CreateFile, error 2 opening file </tmp/xbmc/vdb-17492a19.fi>, flags:0, mode:100.
20:45:31 T:3057063776 M:669884416 WARNING: CreateFile, error 2 opening file </tmp/xbmc/vdb-17492a19.fi>, flags:0, mode:100.
20:45:31 T:3057063776 M:669884416 DEBUG: CVideoDatabase::GetTitlesNav() query: select movie.*,files.strFileName,path.strPath from movie join files on files.idFile=movie.idFile join path on files.idPath=path.idPath limit 5000 offset 0
20:45:31 T:3057063776 M:669884416 DEBUG: Time for actual SQL query = 19
20:45:31 T:3057063776 M:669925376 DEBUG: Time to retrieve movies from dataset = 104
20:45:31 T:3057063776 M:669925376 DEBUG: GetTitlesNav times: Info 8, Cast 0
20:45:31 T:3057063776 M:669925376 DEBUG: CVideoDatabase::GetTitlesNav() query: select movie.*,files.strFileName,path.strPath from movie join files on files.idFile=movie.idFile join path on files.idPath=path.idPath limit 5000 offset 5000
20:45:31 T:3057063776 M:669925376 INFO: msg: CxImage::Load - loading </opt/XBMC/skin/Project Mayhem III/media/DefaultMovieTitle.png> of type <4>
20:45:31 T:3057063776 M:669925376 WARNING: CreateFile, error 2 opening file </opt/XBMC/skin/Project Mayhem III/media/DefaultMovieTitle.png>, flags:0, mode:100.
20:45:31 T:3057063776 M:669925376 INFO: msg: failed to open file. err: 156981364
20:45:31 T:3057063776 M:669925376 INFO: msg: PICTURE::LoadImage: Unable to open image: /opt/XBMC/skin/Project Mayhem III/media/DefaultMovieTitle.png Error: (2)
20:45:31 T:3057063776 M:669925376 ERROR: PICTURE: Error loading image /opt/XBMC/skin/Project Mayhem III/media/DefaultMovieTitle.png
20:45:31 T:3057063776 M:669925376 ERROR: Texture manager unable to load file: /opt/XBMC/skin/Project Mayhem III/media/DefaultMovieTitle.png
20:45:31 T:3057063776 M:669925376 DEBUG: Sort, sorting took 1 millis
20:45:31 T:3057063776 M:669925376 DEBUG: Saving fileitems [videodb://1/2/]
20:45:31 T:3057063776 M:669925376 DEBUG: -- items: 237, sort method: 2, ascending: true
20:45:31 T:2910829456 M:669925376 DEBUG: Running thread 2910829456
20:45:31 T:2910829456 M:669925376 DEBUG: thread start, auto delete: 0
20:45:31 T:2954414992 M:669925376 DEBUG: Running thread 2954414992
20:45:31 T:2954414992 M:669925376 DEBUG: thread start, auto delete: 0
20:45:31 T:2944400272 M:669925376 DEBUG: Running thread 2944400272
20:45:31 T:2944400272 M:669925376 DEBUG: thread start, auto delete: 0
20:45:31 T:2936007568 M:669925376 DEBUG: Running thread 2936007568
20:45:31 T:2936007568 M:669925376 DEBUG: thread start, auto delete: 0
20:45:31 T:2927614864 M:669884416 DEBUG: Running thread 2927614864
20:45:31 T:2927614864 M:669884416 DEBUG: thread start, auto delete: 0
20:45:31 T:3057063776 M:669884416 DEBUG: Load defaultFolderBackBig.png: 1.8ms (bundled)



Library: ~200 Movies withe Info/Posters pulled using IMDB.

[bripeace]

I too am getting the choppiness and stutters or whatever you call them once you turn on library mode.

here is what is always repeating in my logs for me:


18:41:51 T:2512346000 M:1583792128 DEBUG: Running thread 2512346000
18:41:51 T:2512346000 M:1583792128 DEBUG: thread start, auto delete: 0
18:41:51 T:2512346000 M:1583792128 DEBUG: staticThread, deleting thread graphic context
18:41:51 T:2512346000 M:1583792128 DEBUG: Thread 2512346000 terminating
18:41:51 T:3061286752 M:1583824896 DEBUG: CGUIMediaWindow::GetDirectory ()
18:41:51 T:3061286752 M:1583824896 DEBUG: ParentPath = []


it's just happens over and over, about twice per second. And on top of the causing of stuttering it's also filling up the logs all the time. I'm using a Feb 07 build so I'm going to go ahead and update now, but I doubt this is going to go away we'll see i guess.

[bripeace]

Once library mode is enabled it starts dropping frames about 3-8 per second. Which becomings irritatingly noticable on pans and some other shots. The cpu usage overall and most of the stats seems to be extremely similar. CPU around 5/7 on each core. This happens with all codecs and containers.. xvid/h264/mpeg mkv/avi/dvd. The only way to stop it is to disable library mode and reset then to not use library mode at all.

I can say that whenever your in a directory whch contains actual files while NOT in library mode the thing that repeats in my above posts stops. It does show it on lists such as the source selction screen and even in screens showing acutal shares - but not once your in an actual directory. Once library mode is initiated it's always happening regardless of where you are or what your doing.


As a test I destroyed my video library allt ogether and just scanned in 1 tv show for testing and I get the exact same results.. it does seem less noticable and is only dropping at max 2 frames a second, but it's definately there.

There's definately something wrong with Library mode and it's impacting performance after it's loaded.

[bripeace]

Sorry for so many posts in a row - but I've found a temporary work around till someone goes in and fixes this.

If you play things from the Now Playing... playlist screen then the problem stops. Probably becuase refreshing the playlist screen in the background doesn't interupt movie playing for whatever reason. In any case it doesnt' hit the DB refreshing the Episode List so lighter i guess..

In any case thats a work around.

I've been digging around trying to figure out exactly how to fix this but I don't know how the directory code works and can't seem to figure it out. All someone has to do is go in and tell it the library to stop refreshing the Episode List screen or whatever virtual directory Navigation screen while a Video is playing - unless obviusly your in mode where you can see both.