Register · Software · Search · Image Upload · Buy & Sell · Reviews · Hosting

Moderated by: guardian
Username   Password

Visit the FM Store · Image Upload · Buy & Sell
FM Forum Rules
Nikon SLRs, primes, and zooms lenses reviews
FM Forums | Nikon-mount SLRs | Join Image Upload
1
2
3 5 6 end
Go to previous topic Go to next topic
galenapass
Offline
Image Upload: Off
p.2 #1 · D3 v 1Ds3 at ISO 12800


Sounds like an interesting test. It would also be interesting to do a follow-up test with anything new that gets released – in the near future - by either Canon or Nikon. Some of use who use either system to shoot with will be paying close attention to the results. Good luck.

Sep 01, 2008 at 03:00 AM
Avi B
Offline
Image Upload: Off
p.2 #2 · D3 v 1Ds3 at ISO 12800


Man, this could end up as an expensive test...

Anyway, why don't you keep the Canon colours as-is? Or change the Nikon colours instead?

Let me suggest a ISO3200 shot as well so that the 1Ds3 has at least one output at its native ISO range.

Also you should print several different large sizes. I'd honestly be surprised if you could tell any real difference in them. Just my hypothesis

I was also going to suggest a DX shot out of the D3 just for kicks. But then that changes the FL so maybe not so much? Perhaps a centre crop at the DX crop size (for both D3/D700 and 1Ds3) printed large would be interesting


Sep 01, 2008 at 03:13 AM
sjms
Offline
Buy and Sell: On
p.2 #3 · D3 v 1Ds3 at ISO 12800


brainiac wrote:
I should point out that I am well aware that the D3's high ISO settings and in-camera noise reduction are a huge convenience for any photographer in a hurry, especially photojournalists and sports shooters, and that makes the 1Ds3 a much less appealing camera for those photographers.

I simply want to compare best possible high iso output from the two cameras.


just to let you know i use NO in camera noise reduction in my images. all is off on both the D3 and D700. i HATE in camera NR.


Sep 01, 2008 at 03:26 AM
AJ Nadershahi
Online
Image Upload: Off
p.2 #4 · D3 v 1Ds3 at ISO 12800


Part of the problem for me with previous comparisons (and why I haven't really bought into them fully as very valid tests), is due to resizing either the DsIII or the D3 files so they match the same resolution.

Take both files and print them to a standard size, say 16x20 and 24x36 with no post processing or resizing of the files other than allowing the RIP software to handle it as best for the printer. As we all know, viewing on screen doesn't always translate the same as final print. And after all, isn't the concern final print output?





Edited on Sep 01, 2008 at 04:22 AM


Sep 01, 2008 at 04:21 AM
tennclay
Online
Buy and Sell: On
p.2 #5 · D3 v 1Ds3 at ISO 12800


jmcfadden wrote:

you are being disingenuous tho if you are claiming "neutrality" in your thread, that really is the crux of it for me.

J



You have highlihgted the key point here - "Brainiac's" level of neutrality, IMO, rivals his "scientific" approach. I doubt there will be much of value produced here - other than his entertainment!

Edited on Sep 01, 2008 at 04:15 PM


Sep 01, 2008 at 04:14 PM
brainiac
Online
Image Upload: On
p.2 #6 · D3 v 1Ds3 at ISO 12800


You can say what you like about my scientific approach, but it's unlikely ever to be as unscientific as comparing crops for per pixel noise at different magnifications. That is scientifically wrong, and guaranteed to lead to the wrong conclusion. Luminous Landscape does it, DPR does it, and I seem to be the only person who has noticed that a great many people are being misled by the unscientific method of these reviewers.

Sep 01, 2008 at 04:34 PM
SoundHound
Offline
Buy and Sell: On
p.2 #7 · D3 v 1Ds3 at ISO 12800


I have done the most unscientific test of all. I bought both cameras (D3,1Ds Mk III and the MK III too) and exchange them while shooting 500/1000 images per evening in dim stage lighting. Then I spend a minimum of 2 hours per image in PS and often print (Z3100 HP) to 24x36" glossy paper.

There are many, MANY variables which bear on each camera's utility. Presently I am setting my D3 for ISO 6400 and the 1Ds Mk III to ISO 3200. I use the Nikkor F2.8 24-70 zoom and a F2.0 or faster prime on my Mk IIIs (I sold my 24-70 Canon which suffers a bit verses the Nikkor). I process the images side by side.

I have to deal with underexposed black costumes and so I have not found it useful to advance the ISO past 6400/3200. I really don't know what will happen when both cameras are pushed another stop. I don't use a lot of NR but I do make a whole lost of processing adjustments to get what I want.

The 1Ds Mk III images can have more detail "enlarge/crop-ability." The NEFs yield a semi poetic filmlike texture which allows, seemingly, unlimited enlargement but, obviously no more detail. Were I to have the 4' carriage Z3100 I'm sure, with genuine fractals, that I would be successful in making 4x5' prints which could be viewed from way too close up.

Don't misunderstand me the 1Ds Mk III doesn't suffer in IQ, indeed at it's best, there's a certain sophisticated quality and grace which I hesitate to describe with numbers but more difficult to obtain. That's because the FPS is much slower, the buffer is smaller, the AF boxes are too far inside the frame,

If you want the extra resolution the 1Ds offers over its brother Mk III you will want an L prime which precisely places the (thin) plane of focus. Otherwise you can wind up with a double size file that has no more resolution than 10/12 Mp files from the D3 or Mk III. Your mileage will certainly vary.


Sep 01, 2008 at 05:37 PM
Rodolfo Paiz
Offline
Image Upload: On
p.2 #8 · D3 v 1Ds3 at ISO 12800


brainiac wrote:
You can say what you like about my scientific approach, but it's unlikely ever to be as unscientific as comparing crops for per pixel noise at different magnifications. That is scientifically wrong, and guaranteed to lead to the wrong conclusion. Luminous Landscape does it, DPR does it, and I seem to be the only person who has noticed that a great many people are being misled by the unscientific method of these reviewers.


I have no dog in this fight. And I like my Nikons so much more than the Canons I've used, for so many reasons, that I have no reason to care about the results of the test either. But, I love the science and the art of photography.

So I'm very curious: why do you believe it's wrong to compare 100% pixel-by-pixel images from two cameras with different resolutions?

Sep 01, 2008 at 05:44 PM
andrewd01
Offline
Image Upload: On
p.2 #9 · D3 v 1Ds3 at ISO 12800


I agree that it makes sense to compare the noise for images at the same magnification (pixel dimensions), as this replicates what is happening when the image is printed. You should be able to get a good idea of the difference without actually printing. Just resample the 1Ds3 image to D3 resolution and compare. Interested in seeing the results, I suspect they will be very similar.

I would like to see the difference between the following two tests:
D3 up-ressed to 21Mp vs native 1Ds3 image
D3 native image vs 1Ds3 downsampled to 12 Mp
In other words, does the 21Mp resolution actually get you anything or is the benefit offset by the higher per-pixel noise.

I would also see comparisons of the two cameras shot at f22 and f16 where diffraction noise becomes an issue for cameras with a small pixel pitch such as 1Ds3. Can the diffraction noise issue be overcome by downsampling to lower resolution or is it an inherent problem with capture on a high-res sensor?

good luck






Sep 01, 2008 at 05:51 PM
Rodolfo Paiz
Offline
Image Upload: On
p.2 #10 · D3 v 1Ds3 at ISO 12800


Andrew, with so much magnification and reduction of images going on, in the end the software is becoming almost as important as the camera, no? How can one claim to really be testing the camera, when image sizes are changed so dramatically that almost none of the original pixels remain?

Sep 01, 2008 at 06:01 PM
brainiac
Online
Image Upload: On
p.2 #11 · D3 v 1Ds3 at ISO 12800


andrewd01 wrote:
I agree that it makes sense to compare the noise for images at the same magnification (pixel dimensions), as this replicates what is happening when the image is printed.


Yes - exactly, and hence not resizing is like cutting a square inch out of a 24x36" print from one camera, and a square inch out of a 24x16" print from the other camera, looking at the two square inches and declaring that one has less noise than the other. It is a total failure to compare visible noise in an image. There is no point comparing noise from different cameras in this way. It is wholly misleading.

> I would like to see the difference between the following two tests:
D3 up-ressed to 21Mp vs native 1Ds3 image
D3 native image vs 1Ds3 downsampled to 12 Mp
In other words, does the 21Mp resolution actually get you anything or is the benefit offset by the higher per-pixel noise.


Yes - both comparisons should be done to satisfy the skeptics, although IMO the upsizing one is the more instructive since you are not throwing away any extra detail that may exist in the higher rez file. Extra detail is very rare though, due to resolution limits at wide aperture, camera shake, and the detail destroying effects of high iso. However, it does make sense to apply any NR before downrezzing, regardless of how much detail there is, since NR is not the same as just averaging, so NR at full rez may be more successful than NR at diminished rez.

> I would also see comparisons of the two cameras shot at f22 and f16 where diffraction noise becomes an issue for cameras with a small pixel pitch such as 1Ds3. Can the diffraction noise issue be overcome by downsampling to lower resolution or is it an inherent problem with capture on a high-res sensor?

The short answer is that diffraction is a lens effect. It sets a ceiling on resolution. It can not under any circumstances afflict a higher rez file more than a lower rez file. It simply levels the playing field so that the higher rez camera loses its advantage.

Sep 01, 2008 at 06:25 PM
brainiac
Online
Image Upload: On
p.2 #12 · D3 v 1Ds3 at ISO 12800


Rodolfo Paiz wrote:
Andrew, with so much magnification and reduction of images going on, in the end the software is becoming almost as important as the camera, no? How can one claim to really be testing the camera, when image sizes are changed so dramatically that almost none of the original pixels remain?


Interpolation is a statistically reliable process. Downrezzing does not affect the quality of the information, only the quantity. It is like standing further away.

Sep 01, 2008 at 06:28 PM
brainiac
Online
Image Upload: On
p.2 #13 · D3 v 1Ds3 at ISO 12800


Rodolfo Paiz wrote:
So I'm very curious: why do you believe it's wrong to compare 100% pixel-by-pixel images from two cameras with different resolutions?


Some people can see why this is true, and others can't. Imagine you print a picture at 16x24 and at 24x36. You then cut out a square inch of print from each, and hand the two crops to a judge. She will say that the cropped square inch from the more enlarged print has worse (more visually intrusive) noise than the crop from the smaller enlargement. The noise will be bigger. The less enlarged crop will clearly be the noise winner. But it's the same file. Get me now? This is precisely how Luminous Landscape and DPReview compare noise samples. Go and look at their sites if you don't believe me. The Queen's head on the postage stamp is more enlarged whenever the number of megapixels is higher. As a result, their noise tests are skewed in favour of the lower rez cameras.

Meanwhile, I am criticised for being unscientific, or biased. I really have no loyalty to any brand, and when I do my test I will do it fairly, not least because I wish to know the facts of this matter as much or more than anyone else.

Edited on Sep 01, 2008 at 06:39 PM


Sep 01, 2008 at 06:34 PM
firewireguy
Offline
Image Upload: Off
p.2 #14 · D3 v 1Ds3 at ISO 12800


I think DPReview are right on this one. They're testing at a given DPI, so two cameras with a different number of pixels will produce different print sizes at a given DPI. What you want to test is noise on a per pixel basis so you need to have a 100% crop.

Otherwise resizing an image becomes totally reliant on whatever interpolation software you choose to use, which has nothing to do with the camera.

At the end of the day I see this as being a totally pointless and worthless test. The 1Ds3 is not competing with the D3 and nor is the D3 competing with it.

Sep 01, 2008 at 06:50 PM
andrewd01
Offline
Image Upload: On
p.2 #15 · D3 v 1Ds3 at ISO 12800




The short answer is that diffraction is a lens effect. It sets a ceiling on resolution. It can not under any circumstances afflict a higher rez file more than a lower rez file. It simply levels the playing field so that the higher rez camera loses its advantage.



I agree it's a lens effect, but I am interested to know what the ceiling on resolution is. I have heard that the ceiling at f16 to f22 is around 12MP but I have not seen this proven in any scientific test. For the discussion let's assume we are dealing with "best possible" lenses here, eg Canon L, Zeiss ZF Nikon Pro lenses etc. Hope you can address this issue in your tests.

Sep 01, 2008 at 07:00 PM
andrewd01
Offline
Image Upload: On
p.2 #16 · D3 v 1Ds3 at ISO 12800


Just found a great web site to explain the diffraction issue. http://www.cambridgeincolour.com/tutorials/diffraction-photography.htm
It has a calculator so you can work out the aperture at which the sensor becomes diffraction limited (assuming perfect lens). It is clear why 11-12MP is a sweet spot for full frame cameras (1Ds, 5D, D3), these can shoot down to f11 without being diffraction limited.

The 1Ds3 can only shoot down to f8 before becoming diffraction limited. This explains why it is a great camera for studio work, but less than perfect if you like to shoot landscapes with the hyperfocal technique, like this excellent image: http://www.fredmiranda.com/forum/topic/675528


For a laugh put in the specs of the new 50D with 1.6 crop sensor. Can't even shoot f8! I won't be getting one of those!





Edited on Sep 01, 2008 at 08:35 PM


Sep 01, 2008 at 08:29 PM
msauk
Offline
Image Upload: On
p.2 #17 · D3 v 1Ds3 at ISO 12800


maybe it's me but I like the look of raw files then jpeg files when using my super high ISO on my D3.

There seems to be not as much noise in a raw file?

Sep 01, 2008 at 11:06 PM
Tim Ashton
Online
Image Upload: On
p.2 #18 · D3 v 1Ds3 at ISO 12800


Hey Richard,
I will watch with intersest for your results, but seriously their are many who have seen your previous comments in Nikon v Canon discussions who have every right to be suspicious of your motives; so people like J MacF have every right to question your bone fides.
As I said, we will all watch with interest. may be we have misjudged you.
Tim

Sep 01, 2008 at 11:39 PM
brainiac
Online
Image Upload: On
p.2 #19 · D3 v 1Ds3 at ISO 12800


firewireguy wrote:
I think DPReview are right on this one...
What you want to test is noise on a per pixel basis so you need to have a 100% crop.


Like I said, some people understand this issue, and some just don't. Per pixel noise does not give you an indication of image noise. To compare image noise you need to take into account the number of pixels. It's the amount of noise in your image that matters, not the amount of noise per pixel.

Sep 01, 2008 at 11:58 PM
brainiac
Online
Image Upload: On
p.2 #20 · D3 v 1Ds3 at ISO 12800


andrewd01 wrote:
Just found a great web site to explain the diffraction issue. http://www.cambridgeincolour.com/tutorials/diffraction-photography.htm
It has a calculator so you can work out the aperture at which the sensor becomes diffraction limited (assuming perfect lens). It is clear why 11-12MP is a sweet spot for full frame cameras (1Ds, 5D, D3), these can shoot down to f11 without being diffraction limited.

The 1Ds3 can only shoot down to f8 before becoming diffraction limited. This explains why it is a great camera for studio work, but less than perfect if you like to shoot landscapes with the hyperfocal technique, like this excellent image: http://www.fredmiranda.com/forum/topic/675528

For a laugh put in the specs of the new 50D with 1.6 crop sensor. Can't even shoot f8! I won't be getting one of those!


Once again, confusion reigns. You can shoot f8, and if you do, your results will be no less sharp than with a lower megapixel camera. In fact, if the other camera sees no diffraction limit at f8 by some margin, then your results will probably be slightly sharper.

In other words, for a sparse and dense sensor of the same size using a particular lens near the diffraction limit, the dense one will always produce at least as much detail as the sparse sensor, and often more.

So there are three possibilities:
a) the diffraction limit is limiting sharpness on both the sparse sensor and the dense one, in which case the two images will be equally sharp.
b) the diffraction limit is limiting sharpness on the dense sensor, but not the sparse one, in which case the dense one is sharper than the sparse one, but not as much sharper as it could be.
c) the diffraction limit is limiting sharpness on neither sensor, in which case the dense sensor will give its maximum detail advantage over the sparse one.

You could regard the boundaries between these three cases as two more special cases, but they fit the scheme.

Edited on Sep 02, 2008 at 12:09 AM


Sep 02, 2008 at 12:08 AM
brainiac
Online
Image Upload: On
p.2 #21 · D3 v 1Ds3 at ISO 12800


firewireguy wrote:
Otherwise resizing an image becomes totally reliant on whatever interpolation software you choose to use, which has nothing to do with the camera.


Yes, I uprezzed a picture of a unicorn using bicubic, and the result was a picture of a pantomime dromedary!

Sep 02, 2008 at 12:15 AM
Rodolfo Paiz
Offline
Image Upload: On
p.2 #22 · D3 v 1Ds3 at ISO 12800


brainiac wrote:
Some people can see why this is true, and others can't.


Absent clear evidence of obtuse behavior, it is best to assume that all reasonable people can see something if it's true. Statements like the one above give me the impression that anyone who disagrees will be brushed off as being "one of those who can't." Emperor's new clothes, and all that.

brainiac wrote:
Imagine you print a picture at 16x24 and at 24x36. You then cut out a square inch of print from each, and hand the two crops to a judge. She will say that the cropped square inch from the more enlarged print has worse (more visually intrusive) noise than the crop from the smaller enlargement. The noise will be bigger. The less enlarged crop will clearly be the noise winner. But it's the same file.


If you're trying to make any kind of scientific and fact-based analysis, numbers become essential. Don't just bandy about generalities, it confuses the issue. So in order to understand you better, and to ensure that I am looking at the same "facts" as you are, let me see if I can put numbers to this example of yours.

For ease of use, I'm going to use round numbers. So I'll assume that your picture above is actually 4800x7200 pixels in size, so that the 16x24 print is at 300 dpi and the 24x36 print is at 200 dpi. No interpolation or software manipulation involved. If that is indeed what you meant to say, then of course the smaller print is going to look better, since it's got better resolution (defined as number of pixels per unit of distance, in this case PPI). Any noise will be reduced in size, and every line, curve, and detail captured will seem to be of higher quality as well, because for that print it really is.

If, however, you make prints of similar images from two different cameras, and print both at 300 dpi without any image manipulation, then I think cutting that one-square-inch piece from each print is entirely fair. The camera with more MP has the ability to make larger prints without image resizing, and that is an advantage in and of itself. But it is separate from the camera's noise signature, which is inherently pixel-based.

At this point, I am of the opinion that either your theory is wrong, or your explanation is woefully inadequate. A picture of "the Queen's head on a postage stamp", as you put it, will favor the camera with the most MP (not the least, as you said) because the Queen's head was photographed with more pixels and is thus printed at higher resolution if it's printed at the same size. And, the laws of physics still say that a larger photosite will more accurately capture light, which is why the D3 has better noise performance than the D300: equal number of pixels (roughly), but each pixel is bigger and fatter and therefore does better.

brainiac wrote:
Meanwhile, I am criticised for being unscientific, or biased.

The good thing is that you're looking to validate your views based on empirical evidence and facts. Honestly, though, the bad thing is that it soulds like you're way too convinced that your method is correct and valid... and sometimes the problem is not in the answer, but in how we asked the question. Do some constructive self-examination... can all those people really be totally wrong, and you're the only guy who sees the light? Or is there a flaw in your paradigm somewhere, and there really is something to criticize in your methodology or philosophy? Note that I'm not saying "maybe you're wrong," because this is not that simple. It's almost impossible to be 100% wrong or 100% right, which makes ego-less self-evaluation all the more critical.

Please feel free to continue the discussion and explain your reasoning further... I'm listening. At this point, what you've said gives me the impression that your reasoning is not valid and your conclusions are therefore incorrect. But I'm only telling you what I think now; again, if you feel that I have misunderstood or that there is more to say, I'm listening.

Sep 02, 2008 at 12:22 AM
Rodolfo Paiz
Offline
Image Upload: On
p.2 #23 · D3 v 1Ds3 at ISO 12800


firewireguy wrote:
I think DPReview are right on this one...
What you want to test is noise on a per pixel basis so you need to have a 100% crop.


brainiac wrote:
Like I said, some people understand this issue, and some just don't. Per pixel noise does not give you an indication of image noise. To compare image noise you need to take into account the number of pixels. It's the amount of noise in your image that matters, not the amount of noise per pixel.


See my above comment on the damage it does to your credibility when people who disagree with you are shrugged off as those who "just don't get it."

You have not even attempted to argue, discuss, or dialogue about WHY you think noise-per-image is the correct metric over noise-per-pixel or noise-per-inch. You have simply stated it, and repeated it, and added that you're right but some people don't understand it. That line of argument has zero... repeat, zero... validity.

Now, let's try this again: why do you believe that the total amount of noise in the image is the most significant metric, as opposed to noise-per-pixel or noise-per-square-inch or some other equal measure of area? And please provide details: are you assuming equal resolution in the print? Or native resolution? Or what?

You're never going to convince people by smugly repeating that you hold the Truth in your hand and are unarguably right. If you don't care to convince anyone, and just want to feel secure in your "knowledge", then fine... you're entitled to do that if you wish. But if you are actually having a conversation intended to communicate your beliefs, you're doing a very poor job of it.

If this conversation is to be productive, please leave the righteous superiority out of it, and argue your views concretely and clearly.

Sep 02, 2008 at 12:29 AM
nikt
Offline
Image Upload: Off
p.2 #24 · D3 v 1Ds3 at ISO 12800


What's the real benefit of doing the 'tests'? It's a pissing competition. Is there supposed to be a clear 'winner'. What is a 'winner' anyway. A picture you have to stare at for 5 minutes to see which one is better. Objectively test and subjectively judge!

How do we know the lenses are the best in that group for each camera? The 16-9 website says the 24mm lens from Canon is great. I've not found one that gives the same results he gets.

Maybe hold off a bit and see what Sony does with the A900 24MP camera they keep talk about release some day. Then we can weight the criteria.... such as cost.

Sep 02, 2008 at 12:58 AM
crewshin
Offline
Image Upload: Off
p.2 #25 · D3 v 1Ds3 at ISO 12800


I hate how people in this forum literally jump on someone for asking a question like this. Relax guys.

I'd love to see results from a simple test like this... just for the sake of curiosity. Not fanboyism.


edit: Whoops. Sorry guys I didn't see the second page

Edited on Sep 02, 2008 at 01:01 AM


Sep 02, 2008 at 01:00 AM

FM Forums | Nikon-mount SLRs | Join Image Upload
1
2
3 5 6 end
  Go to previous topic Go to next topic

You are not logged in. Login or Register

  Username   Password  
Lost password?