Very fragile with large database under heavy load

Post Reply
dimaip
Posts: 63
Joined: 12 Aug 07 11:39
Location: Russia, Moscow
Contact:

Very fragile with large database under heavy load

Post by dimaip »

Hey Hert!
I can't post this one as a ticket, as it's too broad and unspecific, but I still need your opinion on this problem.

I have a decent PC: AMD eight-core, 8gb of RAM, Win7.
I have converted database with 60k images from IDI Pro, and now added another 70k, so now I have 130k images in the compacted database.

I experience a lot of trouble with bulk operations on loads of images: Select 60k (btw, why such limit?), building missing thumbs, etc...
In general, PSU is very unstable under heavy load. For example to rebuild all thumbs, I have to manually select chunks of 60k images, CTRL-A then CTRL-ALT-T.
Must I split database into smaller parts to keep the performance (I really don't want to do it!!)? Have you been testing PSU on the amount of images it can handle well?

IDI Pro was much worse than that, but I still dream to have more stability.
For example, it's quite hard to hang Adobe Bridge, but it takes just a few clicks to kill PSU. Sometimes it drops with an error message ("Access violation", something about available space, other errors already reported) or just with a hourglass and blank screen or Windows error message.

I understand it's very hard to fix such unspecific issue, and maybe I'll try to report the exact issues, but I want to raise the question of overall stability of PSU.

Or maybe adding an SSD drive (or more RAM?) will mitigate this problem?
Any one understands what I'm talking about? :)

Regards,
Dmitri.

PS: PSU seems to be much more optimized, than IDI. I'm building thumbs now, and all of my eight cores are loaded 60-70%. That's a heck of optimization!
mphillips
Posts: 240
Joined: 31 May 07 11:02
Location: Parkwood,Johannesburg,South Africa

Re: Very fragile with large database under heavy load

Post by mphillips »

Hi Dmitri

I also experience this with PSU.

It is only 32 bit and seems to "run out" of RAM when dealing with a large number of images.

Especially when trying to Rebuild Thumbs or Tools - Build Missing Thumbs and Previews.

Some of this has been reported in mantis (1085,1065,352,851)

Regards

MikeP
Mike Phillips
http://www.mikeandmorag.co.za
D850, NX Studio, Supreme, Lightroom
dimaip
Posts: 63
Joined: 12 Aug 07 11:39
Location: Russia, Moscow
Contact:

Re: Very fragile with large database under heavy load

Post by dimaip »

Hey Mike, thanks for the explanation. At least I'm not the only one...
So does it mean that PSU is not able to use more than 2gb or ram?

Whatever the limitation is, it would be great to detect it, and help PSU not grow over it and crash.
It's like linux always crashing on extra load which it can't handle, where as Windows seems just to slow down, but not crash the whole system. The robustness of application is what makes it a pleasure to work with.

I also like how NetBeans IDE detects a slowness in UI, and automatically reports it. With a help of that, they've managed to build a very responsive UI.

Dmitri
Post Reply