Photo editing PC....

Vivek
Offline
• • • •
Upload & Sell: On

p.1 #1 · p.1 #1 · Photo editing PC....

Hi there,

I need some advice on how to fix the slow photo processing speed problem that I have. I mostly do photography (rarely if any videos). My setup is as follows:

The primary processing machine is a 2017 27" iMac (i5 processor I think) with 40GB of DRAM (upgraded from OWC) and 512GB of Flash on board. The RAW files reside on a 8TB RAID1 (HW) external HDD connected over Thunderbolt-3. I use LR Classic for all my DAM management (and this cannot change in my current workflow, in other words, I am wedded to the LR for now). The LR catalog is on SSD in the iMac. I believe it is a 512 GB SSD.

Now that I am shooting the high megapixel cameras (A1), the slowness of my processing speed (culling, editing in Photoshop, doing NR in Topaz etc.) has become very annoying. I believe that this slowness is primarily driven by the (lack of) performance of the HDD based storage for the raw files.

So, the issues that I would love some advice on are:
1

Is anyone here using an all FLASH Raid1 array - what kind of performance are you getting out of it (GB/S)?
Can you recommend any such arrays that you've personally used?
Do you think I should just update my HDD array to Flash array first with the same iMac or replace both given the age?
What do you recommend as a configuration for my next machine? I usually change my PCs every 5 years and it is time.
If I go the Mac Studio route, what configuration would be best bang for the $? Is LR capable of using the multiprocessor M1 Ultra or am I throwing my money away?
If I go the Mac Studio route, what monitor is recommended? I need at least 27" monitor. 5K would be great.

Thanks a lot for your time and advice! I really appreciate it.

May 23, 2023 at 03:57 PM

jcolwell
Online
• • • • • • •
Upload & Sell: On

p.1 #2 · p.1 #2 · Photo editing PC....

I don't know Macs, but the first things I did when I got my 50 MP Canon 5DS in 2017, were (in order of importance for improving Photoshop performance):

(1) convert both my system disk and working disk to SSD,

(2) upgrade my video board, for more Graphics Processing Units (GPU), and

(3) upgrade the motherboard to max RAM (32 MB).

My i7 3.4GHz desktop PC was made in 2012, and the upgrades were applied in 2017. It still works fine. I've used it for commercial composite images that required the PSB (PhotoShop Big) file format, because they exceed the maximum PSD file size. It has 12 TB of mounted disk space (1 TB in SSD for system & PP drives, others single HDD).

I'll probably soon upgrade my graphics card for more GPU power, as they're being used more efficiently, and by more PP apps, every day.

Edited on May 24, 2023 at 09:28 AM · View previous versions

May 24, 2023 at 09:13 AM

jeffbuzz
Online
• • • •
Upload & Sell: On

p.1 #3 · p.1 #3 · Photo editing PC....

All flash RAID is possible but costly. I considered it on my last NAS upgrade but decided to stick with spinning disks. You'd see noticeable performance improvements in the DAS by going to a disk striping configuration like RAID 5.

May 24, 2023 at 09:25 AM

skid00skid00
Offline
• • •
Upload & Sell: Off

p.1 #4 · p.1 #4 · Photo editing PC....

One of the recent linus tech tip videos mentioned a flash array. Mockery ensued. My completely 'non-experienced with raid' makes me think that SSD's are so reliable that raid isn't useful. Do the usual duplication of files, on separate (and separated) media, instead.

You need more CPU than an i5. And your GPU probably makes a difference, too. I remember that LR had an option to pick the GPU or CPU for certain processing/processes. Don't forget to get the caches on SSD. I went so far as to put Windows OS cache on one SSD, and LR on another.

May 24, 2023 at 03:32 PM

Vivek
Offline
• • • •
Upload & Sell: On

p.1 #5 · p.1 #5 · Photo editing PC....

Thanks folks, I appreciate it. Still researching and will let you know what I eventually end up doing. With external NVMe based SSDs, the max throughput will top out at 1500 MB/s or so which is much better than the measly 150MB/s that I am getting now, but it cannot achieve the max throughput (line speed) available on TB4.

May 24, 2023 at 09:25 PM

Zhuravlik
Offline
•
Upload & Sell: Off

p.1 #6 · p.1 #6 · Photo editing PC....

I'd go away from Mac and just do custom Windows PC. This way you are not locked into hardware limitations and can get the max speed available.

For example, NMVe drives on PCIE 5.0 have 14000MB/s limit, plus you can put them into RAID0, making it superfast. Although NMVe Gen 5 just started to appear and best speed right now is only 10000 MB/s, but it's already much better than anything you can get from any Mac.

I personally have somewhat outdated system - Threadripper 3990X (overclocked) for CPU, two NMVe Gen 4 in RAID0 as a system drive (tops at ~13000 MB/s), four NMVe Gen 4 in RAID0 as a working + cache drive (tops at ~22000 MB/s), plus regular SSDs (8Tb each) for the backup. For Photoshop, Luminar and Topaz plugins speedup I use three RTX 3090 videocards, and that makes even GFX100s files processing a breeze.

Reason for RAID0 is very simple - it gives maximum possible speed. If system drive fails, it's just a few mins to restore the system; if work drive fails, it's even less time, as I have a backup on the SSD. So overall you'd save on number of drives as you need a backup anyway. But so far it was two years, and nothing failed yet.

Of course, full tower PC is not nearly as elegant as any Mac, but if you choose speed versus aesthetics then "this is the way"

May 26, 2023 at 01:47 PM

Vivek
Offline
• • • •
Upload & Sell: On

p.1 #7 · p.1 #7 · Photo editing PC....

Thanks Zhuravlik, I understand and appreciate your suggestions...Some notes below...

Zhuravlik wrote:
I'd go away from Mac and just do custom Windows PC. This way you are not locked into hardware limitations and can get the max speed available.

Great suggestion and this is exactly what I would do (and have done in my younger days) if I had the time. I am basically substituting stable setup for my time which is extremely valuable at this point in time in my life.

For example, NMVe drives on PCIE 5.0 have 14000MB/s limit, plus you can put them into RAID0, making it superfast. Although NMVe Gen 5 just started to appear and best speed right now is only 10000 MB/s, but it's already much better than anything you can get from any Mac.

Yes, I know this extremely well and very intimately. I have these drives running in my lab (E1.S and U.2) at these speeds with my own firmware. So, yes true, but not doable yet commercially.

I personally have somewhat outdated system - Threadripper 3990X (overclocked) for CPU, two NMVe Gen 4 in RAID0 as a system drive (tops at ~13000 MB/s), four NMVe Gen 4 in RAID0 as a working + cache drive (tops at ~22000 MB/s), plus regular SSDs (8Tb each) for the backup. For Photoshop, Luminar and Topaz plugins speedup I use three RTX 3090 videocards, and that makes even GFX100s files processing a breeze.

Reason for RAID0 is very simple - it gives maximum possible speed. If system drive fails, it's just a few mins to restore the system; if work drive fails,...Show more →

Yes, understood, but again too much work for my taste. That said, I don't think the SSDs (especially PRO versions of m.2 ones with good ventilation) are not an issue. I will probably build an 8TB RAID10 array any way.

Of course, full tower PC is not nearly as elegant as any Mac, but if you choose speed versus aesthetics then "this is the way"

.

Yes, true and this is not a primary concern...

May 26, 2023 at 05:34 PM

tsdevine
Online
• • • • •
Upload & Sell: On

p.1 #8 · p.1 #8 · Photo editing PC....

Get an Apple Silicon based Mac first.

May 26, 2023 at 09:47 PM


FM Forums \| General Gear-talk \| Join Upload & Sell

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.