slow sync

[vkfoto]

I'm using build 3286
What is happening behind the scenes that makes the synchronization service so slow?
I imported a new folder with about 33k images over 12 hours ago and it is still only at 16% completed. Total images now is just over 232k. There is lots of CPU activity, about 16% as well as memory usage at over 3,600 MB. Disk and Network activity is just about 0 with only an occasional blip, so it is doing something. Is this normal?
Now Windows is bugging me to reboot in order to install some updates. If the sync service is interrupted, will it pickup where it left of?

[Hert]

I just did a test here by importing a folder on a network share with 21K images to a new catalog on my local SSD.
After 7 minutes the sync process is at 20% already. That is also the performance that is to be expected.

Things you could check;
1. Is the catalog database files on a local drive
2. Is the catalog database files on an SSD (highly recommended)
3. Did you exclude the folder containing the catalog files excluded from *all* virus scanners that you have got installed. Remember to exclude the folder in Windows Defender as well. This one is the most likely cause for slow performance.

A more general tip: after importing 33K files, PSU will load all 33K files to the collection viewer. For some additional speed, open a new tab and close the one that has the 33k files open.

If you close PSU then on startup it won't auto continue. But you can use Tools -> Read Metadata to Catalog for all out-of-sync images to get it started again

[edit 1]After 15 minutes, the progress of the import is at 41%
[edit 2]After 20 minutes, the progress of the import is at 55%
[edit 3]After 25 minutes, the progress of the import is at 69%
[edit 4]After 30 minutes, the progress of the import is at 83%
[edit 5]After 35 minutes, the progress of the import is at 97%
[edit 6]After 36 minutes, the progress of the import is at 100%

Importing sync for 21K images in 36 minutes is already blazingly fast. Keep in mind that these images are stored on a network share. If I had the files on the local SSD then the total timing could easily be a fraction of what I'm reporting here.

Maybe nice for others to report some import sync timings as well.

[vkfoto]

1: yes a local drive
2: not yet but working on it
3: yes, all excluded

It's been 30 minutes so far and only 0.7%. Only 23,272 to go. Sure hope that SSD will make a big difference.

[Hert]

With a HDD instead of an SSD then everything will be a multitude slower.
In the test computer I have a SanDisk Extreme Pro 500GB-M2 installed.

I think your HDD will be overloaded during the import making it a big bottleneck. Check that in the Windows Task Manager. Below is a screenshot of mine during an import with the import sync and the thumb building running together.

If your HDD is overloading then and you also have the thumb build process running then try to stop that. It will make the import sync go faster because the disk gets better accessible. FYI; I kept the thumb build process running in my test.

disk-load.png (115.63 KiB) Viewed 1818 times