600 NEFs And Only 1/2 Thumbnailed in 3 Hours ..

Post Reply
NassauBoy
Posts: 39
Joined: 24 Jan 16 19:20

600 NEFs And Only 1/2 Thumbnailed in 3 Hours ..

Post by NassauBoy » 19 Mar 16 20:53

Im now at 75K+ Photos in PSu and running the Postgres Server version.

The thumb nailing process for me has seemed to be slowing as I have built up the DB. I run 1600px at 85% for the thumbnails and the NEFs are D810 Raw photos.

I am importing a 660 photo shoot, and Im 4 hours into it and the thumb nailing is about 1/2 way through.

I have restarted the entire computer, compacted the DB and all that sort of know stuff, but if I select the images and ask to re-genterate the thumbnails the process just starts off running at the same slow speed.

Any suggestions?
Late 2012 27" iMac 3.4Ghz i7: 32GB Ram: Internal SSD: External Promise R4 Thunderbolt 16TB Raid 5 (all Data)

weidmic
moderator
Posts: 2856
Joined: 04 Dec 06 22:21

Re: 600 NEFs And Only 1/2 Thumbnailed in 3 Hours ..

Post by weidmic » 19 Mar 16 22:51

NassauBoy,

This sounds odd...
I have a D810 and import larg amounts of pictures quite often, but it does not take very long
Not sure but 600 images maybe not any longer than 20 minutes...

OK, my computer is fast and all is on SSD (transfer from CF card via USB 3)

Not sure, you may want to check tranfser speed of your usb card reader.

OT: Read you came back from Nassau.
Any insidertip what to do there other than going to the zoo which we enjoyed last time?
Unfortunately we are only there for a couple of hours...
PSUServer 4.x, PostgreSQL 10.x
My homepage http://www.michaelweidner.com
PSU Tips and Tricks http://www.michaelweidner.com/WP/psu/

NassauBoy
Posts: 39
Joined: 24 Jan 16 19:20

Re: 600 NEFs And Only 1/2 Thumbnailed in 3 Hours ..

Post by NassauBoy » 20 Mar 16 17:56

OT: Read you came back from Nassau.
Any insidertip what to do there other than going to the zoo which we enjoyed last time?
Unfortunately we are only there for a couple of hours...
Hi weidmic,

If you have longer in Nassau I would encourage you to take the Power Boat Adventure tour. Its $210 USD pp but very worth it. You will get wicked off on super fast power boat to Exuma where you can feed the iguanas, then to their private key (many of them in Exuma) where you will feed the sting rays, they will pull sharks up on the beach (waters edge, they come for the food) and then go snorkelling (yep right there with the wildlife). All your food and drink (alcohol as well) included for the day. The food is very decent. It is a FULL DAY.

Another fun trip would be to Harbour Island Eleuthera. You would catch the fast ferry right at the bridge. Buy a ticket that takes you there about $100 or so USD each. Once there you can rent a golf cart and drive it to the back of the island (minutes) and enjoy a day on the pink sands. The sand is still very white but if you look there are a while munch of pink flecks from the corals in the fine sand. Again the fast ferry will pick you back up at the dock in the late afternoon. Another FULL DAY trip.

Eluthra and Exuma are two fantastic out islands to visit, and both doable as day trips. You wont be able to do them off the cruise ship as won't be enough time, but if visiting a couple days they are worth the money.


OK BACK TO my problem ...

I was able to tweak Postgres a bit to speed up the process. Basically I have a very fast Raid 5 Promise drive system via Thunderbolt connected to the iMach (max out ram and with SSD). My photos are already on the Raid5 drive, so Im not moving the photos, just importing them into the DB and they stay where they reside. That part is fairly fast. then PSu says its building the thumbnails ... this goes on for a huge amount of time. Even with the tweaking of the DB the process still took about 45 minutes.

Im going to be importing about 1700 shots from the Bahamas trip today, so we shall see ...
Late 2012 27" iMac 3.4Ghz i7: 32GB Ram: Internal SSD: External Promise R4 Thunderbolt 16TB Raid 5 (all Data)

weidmic
moderator
Posts: 2856
Joined: 04 Dec 06 22:21

Re: 600 NEFs And Only 1/2 Thumbnailed in 3 Hours ..

Post by weidmic » 24 Mar 16 13:45

Was the import / thumbnail creation any faster now?
My setting is 1680px and 90%

Would be interesting to see if the setting would make a difference in speed (though, not what I would expect to see)...

Michael

OT: Thanks for the info!
PSUServer 4.x, PostgreSQL 10.x
My homepage http://www.michaelweidner.com
PSU Tips and Tricks http://www.michaelweidner.com/WP/psu/

NassauBoy
Posts: 39
Joined: 24 Jan 16 19:20

Re: 600 NEFs And Only 1/2 Thumbnailed in 3 Hours ..

Post by NassauBoy » 28 Mar 16 5:39

@weidmic
Was the import / thumbnail creation any faster now?
My setting is 1680px and 90%
It seemed a bit faster with the DB on the SSD internal to the machine. Still tool longer than it takes for say C1 to create its thumbnails.

Another interesting thing, I took a copy of the DB up north this weekend, and when browsing through some of my folders noticed that there were thumbnails missing that I really thought were built. Since disconnected fro the RAW files, you get to know for sure that the thumbnail is not there. Going to search the forum to see if this is a glitch I should be aware of.
Late 2012 27" iMac 3.4Ghz i7: 32GB Ram: Internal SSD: External Promise R4 Thunderbolt 16TB Raid 5 (all Data)

Hert
Posts: 16002
Joined: 13 Sep 03 7:24

Re: 600 NEFs And Only 1/2 Thumbnailed in 3 Hours ..

Post by Hert » 28 Mar 16 8:23

Your NEF files probably have C1 edits? Unless you've disabled c1 support PSU will have to interpret your edits and apply them to the raw image while building thumb/preview.
This is a User-to-User forum which means that users post questions here for other users.
Feature requests, change suggestions, or bugs can be logged in the ticketing system

NassauBoy
Posts: 39
Joined: 24 Jan 16 19:20

Re: 600 NEFs And Only 1/2 Thumbnailed in 3 Hours ..

Post by NassauBoy » 29 Mar 16 1:30

Your NEF files probably have C1 edits? Unless you've disabled c1 support PSU will have to interpret your edits and apply them to the raw image while building thumb/preview.
Hert,

Ahhh Grasshopper ...

Ok this is now making some sense. I have been experimenting and noticing that the import does not ALWAYS take huger mahouts of time. The part about bringing in the interpretations makes a lot of sense.

I know you can't give me the best method for workflow, but ... insight of the above maybe my technique of reading in the NEF's to C1 first as a Session, editing, creating JPG of the ones I really like to the Output folder in the Session, then importing to PSu (Capture Folder, Select Folder and Output Folder) might not be the best way to do things.

Thoughts?
Late 2012 27" iMac 3.4Ghz i7: 32GB Ram: Internal SSD: External Promise R4 Thunderbolt 16TB Raid 5 (all Data)

NassauBoy
Posts: 39
Joined: 24 Jan 16 19:20

Re: 600 NEFs And Only 1/2 Thumbnailed in 3 Hours ..

Post by NassauBoy » 29 Mar 16 1:41

Hert,

Tested just bringing in the NEF's (directly to PSu not from C1) and was much much faster.
Late 2012 27" iMac 3.4Ghz i7: 32GB Ram: Internal SSD: External Promise R4 Thunderbolt 16TB Raid 5 (all Data)

Post Reply