fredmiranda.com
Login

Moderated by: Fred Miranda
  New fredmiranda.com Mobile Site
  New Feature: SMS Notification alert
  New Feature: Buy & Sell Watchlist
  

FM Forums | Canon Forum | Join Upload & Sell

1       2       3              10              12       13       14       end
  

Archive 2007 · 1D3 14bit sample

  
 
DrPablo
Offline
• • •
Upload & Sell: Off
p.11 #1 · 1D3 14bit sample


I think it would be useful, Pondria, to do that DR test of yours using a lp/mm target instead of a white wall. If your sole output measure is a spike on the histogram, that doesn't tell you very much about the ability to discriminate detail at that exposure level.

It may well be that you have an overall 9 stop dynamic range according to spikes on the histogram. But it may be that you can only discriminate 30 lp/mm over 6 stops, and you can only discriminate 60 lp/mm over 4 stops.



Jun 25, 2007 at 01:19 AM
Jeff
Offline
• • • • • •
Upload & Sell: On
p.11 #2 · 1D3 14bit sample


OK, here goes:

30D dynamic range is 7 stops
1D MkIII dynamic range is 9 1/3 to 9 2/3 (depending upon your tolerance for noise).

Interestingly, the MkIII's increased dynamic range is all in the shadows. Tested both with the same lens in the same light, at the same f/stop.

30D EC=0 (1/10th @2.8) 1.0s = +3 1/3 stops, 1/125th = -3 2/3 stops
Mk3 EC=0 (1/6th @2.8) 1.6s = +3 1/3 stops, 1/400th = -6 stops

I admit it was a bit hard to choose where the noise 'quit' and where it was pure signal for the 'dark side' of the MkIII.

DPP seems to give quite a different set of ways to view the data; Pondria, have you tried to do this with v.3 of DPP? In some ways, the RAW data presentation makes much more sense for looking at the data in this way. It's admittedly different than the ACR presentation, but looking at both the RAW data in relation to the tone curve, and at the resultant RGB channel data is enlightening.

For example, the raw data for the data point (1/500th) 'just outside' the one I chose (note that it would appear that the data is actually contained within the area of the tone curve):

Edited by Jeff on Jun 25, 2007 at 08:38 AM GMT (Reason: poor late-night performance fixed)



Jun 25, 2007 at 01:35 AM
Jeff
Offline
• • • • • •
Upload & Sell: On
p.11 #3 · 1D3 14bit sample


And the RGB data for the same:


Jun 25, 2007 at 01:36 AM
Jeff
Offline
• • • • • •
Upload & Sell: On
p.11 #4 · 1D3 14bit sample


DrPablo wrote:
I think it would be useful, Pondria, to do that DR test of yours using a lp/mm target instead of a white wall. If your sole output measure is a spike on the histogram, that doesn't tell you very much about the ability to discriminate detail at that exposure level.

It may well be that you have an overall 9 stop dynamic range according to spikes on the histogram. But it may be that you can only discriminate 30 lp/mm over 6 stops, and you can only discriminate 60 lp/mm over 4 stops.


Would that detail you are looking to discriminate be black vs. white (i.e. the highest contrast possible)? And for determining acceptable shadow detail, for example, how do you pick 30 lp/mm? Isn't that just a sort of random number?

For grins, after I did the above test, I then shot a test target at my 'minimum' chosen exposure (1/400th), just to see what kind of detail would actually be there:



Jun 25, 2007 at 01:41 AM
Pondria
Offline
• • • • • •
Upload & Sell: Off
p.11 #5 · 1D3 14bit sample


Jeff,
Thank you ! I'll try DPP 3.x ( latest ). And your sample of target shows that my methods is rather "conservative".

Pablo,
I am sure there are better ways to measure DR. I designed this method with the following goal;
1. Anyone can do it without any chart or equipments
2. Consistent - more objective than subjective.



Jun 25, 2007 at 08:16 AM
Pondria
Offline
• • • • • •
Upload & Sell: Off
p.11 #6 · 1D3 14bit sample


Updated FM DR data-base with Jeff's new data.
http://www.sesee.com/Photo/Exports/DR-2007-06-25.gif



Jun 25, 2007 at 08:26 AM
DrPablo
Offline
• • •
Upload & Sell: Off
p.11 #7 · 1D3 14bit sample


Pondria wrote:
Pablo,
I am sure there are better ways to measure DR. I designed this method with the following goal;
1. Anyone can do it without any chart or equipments
2. Consistent - more objective than subjective.


You've certainly succeeded at those two goals. Nonetheless I think it might add to our understanding of DR if at least a minority of people could do this test using lp/mm targets, though. Based on pixel density, we can assume that under the best conditions (good lighting, good lens) the 5D will resolve up to 61 lp/mm and the 1DsII up to 69 lp/mm. Whether that is possible over the entire 8 or 9 or whatever DR is a different question that is worth exploring. I'd be interested in seeing what is the DR in which maybe 20, 40, and 60 lp/mm can be resolved.

As far as I know you can download and print resolution targets from the web.



Jun 25, 2007 at 09:39 AM
DrPablo
Offline
• • •
Upload & Sell: Off
p.11 #8 · 1D3 14bit sample


Jeff wrote:
Would that detail you are looking to discriminate be black vs. white (i.e. the highest contrast possible)? And for determining acceptable shadow detail, for example, how do you pick 30 lp/mm? Isn't that just a sort of random number?


I would suggest doing the test with black vs white. On regular printer paper there would probably be a 3 or 4 stop difference in reflectivity between jet black and paper white; on glossy photo paper it would be larger.

The point is that at the fringes of DR you may still have a significant spike on the histogram, but you lose the ability to discriminate the black from the white. This would obviously occur when the black is on the fringe of complete overexposure or when the white is on the fringe of complete underexposure.

Why 30 lp/mm? Well, I didn't say 30 alone. I suggested 30 and 60. But why not do whatever is on the chart? Given that the 5D has 61 pixel pairs per mm, you can only expect a maximum resolution of 61 lp/mm under the best conditions, though in practice I'd imagine it's a bit less. If I recall correctly the 1DsII has 69 pixel pairs per mm, and the D2x has 89 pixel pairs per mm. Obviously it takes two pixels to resolve two details from one another, i.e. a pixel pair, so the density of pixel pairs would correspond to a theoretical maximum resolution.

So 30 lp/mm would be reasonable, because it would require around half the resolving power of full resolution. I'd imagine that when you're operating around the noise floor, or when you're operating at the upper fringe of highlights, resolution of the finest details is lost (by over or underexposure) before resolution of coarser details.

I just have some doubts that the presence of a spike on the histogram (even when "rescued" in RAW) is a meaningful correlate of detail discrimination -- so what's the point of that spike in the highlights if you can no longer discern cloud textures? What's the point of that spike in the shadows if you can no longer discern shadow detail?

Make sense?


Paul



Jun 25, 2007 at 09:49 AM
Jeff
Offline
• • • • • •
Upload & Sell: On
p.11 #9 · 1D3 14bit sample


Pondria, you might want to delete that 30D data point until further notice. Upon further inspection this morning (I am awake now), I noticed that I counted wrong, and I'm coming up with 7 stops even this morning The red channel blows very rapidly with the 30D, so it's a fine line.

I really wonder whether the color temperature of the light will affect these results. Also, I was simply leaving things set as they are in the camera, i.e. not changing the contrast from 0. Would it be improper to use the least contrast setting when doing this? Would it even change the results...?

Anyway, I edited the post above to reflect the correct numbers.

-Jeff



Jun 25, 2007 at 10:36 AM
Jeff
Offline
• • • • • •
Upload & Sell: On
p.11 #10 · 1D3 14bit sample


BTW Pondria, note that I did the 30D and used ACR first, similar to your previous tests (and other people's, presumably). I then did the MkIII in DPP, and compared the endpopints I'd chosen with the 30D's endpoints (chosen in ACR) as viewed in DPP, to make sure that the relationship was the same. Without CS3, there's no way for me to do 'apples vs. apples', but I'm confident in the methodology, nonetheless.


Jun 25, 2007 at 10:42 AM
Pondria
Offline
• • • • • •
Upload & Sell: Off
p.11 #11 · 1D3 14bit sample


Jeff,
I think the lighting source is important. I recommended natural Sun lighting or similar broad band sources. As you rightly suspected, blue channel is light starving. And those warmer in-door lighting will punish blue channel harshly.
I'll correct the numbers when I get back to home.



Jun 25, 2007 at 10:43 AM
Jeff
Offline
• • • • • •
Upload & Sell: On
p.11 #12 · 1D3 14bit sample


DrPablo wrote:
The point is that at the fringes of DR you may still have a significant spike on the histogram, but you lose the ability to discriminate the black from the white. This would obviously occur when the black is on the fringe of complete overexposure or when the white is on the fringe of complete underexposure.


I totally agree with this, however, you'd clearly have a complex set of data, i.e. you'd be able to differentiate 'detail' (in your case black vs. white) of different resolutions at different DRs. That's a lot of work!

DrPablo wrote:
So 30 lp/mm would be reasonable, because it would require around half the resolving power of full resolution. I'd imagine that when you're operating around the noise floor, or when you're operating at the upper fringe of highlights, resolution of the finest details is lost (by over or underexposure) before resolution of coarser details.


Exactly.

DrPablo wrote:
I just have some doubts that the presence of a spike on the histogram (even when "rescued" in RAW) is a meaningful correlate of detail discrimination -- so what's the point of that spike in the highlights if you can no longer discern cloud textures? What's the point of that spike in the shadows if you can no longer discern shadow detail?

Make sense?


It does make sense, and before actually spending several hours conducting these tests on two bodies, I had precisely the same question. Now that I've done it, I can see why he designed the test as he did.

Think about it this way (and this is admittedly only what I got from it): If a channel is not blowing, you'll get some kind of 'curve' from it; if the channel is blown, you'll get a single line 'spike' in the histogram, as the RAW converter has been able to bring it back, but there is no detail contained in it. As you slide the white- or black-point slider, it immediately saturates the channel. If there is resolvable detail, as you slide it, you should get some sort of continuum across several levels of data before it saturates, indirectly indicating the ability to contain some sort of detail.

The hard part (and the part which you question) is: Is that detail rendered correctly, i.e. is it actually advantageous to the image, or at what point does advantage become disadvantage? Very difficult to answer, as all this rapidly becomes quite subjective to the viewer. For example, many people assert that you can blow one channel, and yet still have image detail from the other two. While this is absolutely true, is that detail that is left accurate, does it help the image (it probably depends upon which channels aren't blown).

Anyway, I completely understand your line of questioning, however after conducting the simple version of the test, I can see it's simplicity and objectivity is its inherent strength. Anything along the lines of conducting multiple tests at different resolutions would rapidly become incredibly tedious and complex. For example, with the 'test' image of the focusing target that I did, see that the RAW data now goes all the way down to the -11.0 stop limit of the chart. Defining where that data becomes garbage would not be fun using this method, lots time I don't have. Paul, you should try conducting the test yourself, it is actually quite enlightening, especially when it gets down to trying to choose what's 'acceptable'.

What I'm going to do at this point is now do a real-world test of my defined underexposure value, and see if that 'level' contributes to the image detail in the shadows (when opened up a bit), or if it is merely digital 'garbage'.

Regards,

Jeff

Edited by Jeff on Jun 25, 2007 at 09:21 AM GMT



Jun 25, 2007 at 11:12 AM
Jeff
Offline
• • • • • •
Upload & Sell: On
p.11 #13 · 1D3 14bit sample


Pondria wrote:
Jeff,
I think the lighting source is important. I recommended natural Sun lighting or similar broad band sources. As you rightly suspected, blue channel is light starving. And those warmer in-door lighting will punish blue channel harshly.
I'll correct the numbers when I get back to home.


I'd guess that using such light would only serve to decrease the 'measured' DR, but what is a hindrance on one end (shadows) is an 'advantage' on the other end (highlights), so I don't know. I do know that the 30D's red channel clips very, very rapidly, in an odd sort of way (I'd guess from my experience with the 1Ds that it does so, as well).

The problem with using any sort of natural light is that the least bit of change in thin cloud cover (or high-altitude atmospheric haze or moisture content) could change the base exposure, rendering any subsequent results inconsistent. I think it has to be a consistent man-made source, preferably one that is cooler (i.e. bluer, not less-hot) than my office lights. That may have been the worst-case scenario, but I'm not sure if it would affect the results or not.



Jun 25, 2007 at 11:19 AM
Tom_W
Offline
• • • • •
Upload & Sell: Off
p.11 #14 · 1D3 14bit sample


Pondria wrote:
Updated FM DR data-base with Jeff's new data.
http://www.sesee.com/Photo/Exports/DR-2007-06-25.gif


Thanks to Jeff for getting the first 1D3 in there. I'd like to see a couple more to get some solid evidence. Canon claims that the 1D3 has similar DR to the 1D2n, but perhaps it's a bit wider.

Hard to tell. This test, while not definitive in terms of actual measured DR, does serve as a good comparison tool. The more samples, the more statistically supportable the results, at least as far as the relative differences between bodies is concerned.



Jun 25, 2007 at 09:02 PM
Pondria
Offline
• • • • • •
Upload & Sell: Off
p.11 #15 · 1D3 14bit sample


I again corrected Jeff's 30D value per his request. I replaced the file with the same link.


Jun 25, 2007 at 09:41 PM
Pondria
Offline
• • • • • •
Upload & Sell: Off
p.11 #16 · 1D3 14bit sample


Folks,
I think I have figured out the problem.
First, let's review my very original data of the raw values again.
http://www.sesee.com/Photo/Exports/1D3-raw.gif
We saw two problems (1) Obviously, not entire range of DR is utilized (2) The raw data doesn't seem to be linear as a function of exposure.
Looking into the data, I realized that the raw data has "offset". Let's say the sensor output is 1V. The offset is about 0.02 V ( 100/4096 ) and 0.06 V ( 1000/16383 ) respectively for 1Ds2 and 1D3. Although the offset is small, it takes up large range in log scale ( 100 is about 6.5 stops ). Once you take out the offset, then the data would be spread over the entire range and also it becomes linear to the exposure. The linearization process that I was puzzled about is to do this more precisely ( the offset seems to be recorded in the RAW file itself ). Bingo !




Jun 25, 2007 at 10:05 PM
Pondria
Offline
• • • • • •
Upload & Sell: Off
p.11 #17 · 1D3 14bit sample


Playing with DPP ( again per Jeff's suggestion ), I found something interesting. Below is the DPP histogram of a shot that Jeff sent me. The other one shows the same behavior. Look at the triangular peak @ -10 stop position. And see how it moves with +1, +2 stop compensation. Unlike other peaks, this peak maintains the clearly defined triagular shape. I cannot explain this.
http://www.sesee.com/Photo/Exports/DPP-Histo-1D3.gif



Jun 25, 2007 at 11:13 PM
Jeff
Offline
• • • • • •
Upload & Sell: On
p.11 #18 · 1D3 14bit sample


That seems to somewhat correspond to the data that the black point slider does not affect. First of all note the RGB histogram, it is completely ignoring everything left of the toe of the curve (including that peak).

Now try sliding the black point slider (in the RAW histogram) to the right, and note that it immediately jumps from -11.0 to approximately -8.0 stops, completely bypassing that peak (i.e. leaving it where it is, not pushing it right), with no change in the image brightness or black point. Continue to move it, and it now slowly affects the BP and/or gamma of the image.

This data appears not to be accessible, and I've seen that peak's characteristic shape on other underexposed images, in the same place. Are they showing your 'noise' on this RAW histogram, and showing that it is not being included in the image?



Jun 26, 2007 at 12:27 AM
rico
Offline
• • • • •
Upload & Sell: Off
p.11 #19 · 1D3 14bit sample


The original Canon 1Ds has a dynamic range of about 10 bits. This claim is based on test conditions and personal interpretation which are explained in this report.

In the first step, I confirmed that RAW data was linear. This involved a series of exposures with fixed aperture and shutter speed (1/250s), with light adjusted from a digital studio pack. Temperature was 78°F, ISO was 100.

Data for one of the Bayer green channels was extracted using the `dcraw' utility by Dave Coffin. The distribution is shown below, including lowest value, deciles, and highest value. Energy was increased in 1-stop increments:

34144164175184190195199202206235
82284311330344354363368374381428
160511560596622641656666675686757
309979107111361185122312531274129113071432
5591988227224232563266827492816285228843097
10383626362836293629363036303631363136313631
000000122412

Last line refers to the dark frame taken at same exposure time with lens covered. Besides the linear aspect of this data, notice that the sensor is saturated at value 3631, which is only 89% of the advertised 2^12. This saturation occurs about 1 stop beyond the "blinkies" during LCD review. The dark-frame data shows remarkably little leakage current at this short exposure time: such leakage does not reduce dynamic range by 1 f-stop until it hits a value of 3631/2, or 1815.

Statistical analysis of the dark frame gives a mean value of 1.1618, and SD (standard deviation) of 1.57661. These figures are effective in comparison of different sensors, of different taking conditions (e.g. temperature), and of different camera settings (e.g. ISO). Taken alone, the figures can give guidance about image quality and image-processing options.

I think the logarithmic difference between the high sensor value and 2x the SD is a good measure of tolerable dynamic range. That calculates to 1152, or 10 bits. The following image shows my justification:


Panel #1 shows 1x-scale crop of the dark frame with a levels boost to show low-order noise, #2 shows the effect of zeroing the lowest bit (while normalized to the mean), #3 shows the same with two bits zeroed, and #4 shows three bits zeroed. #5 is #1 with a large-radius Gaussian blur. There are certainly other ways to process the low-order noisy bits.

For your amusement, here is the entire dark frame with that Gaussian blur. Banding and other non-uniform patterns on a large scale are always visible in these bits - bits only a marketing department could love!


Be aware that RAW data can be processed in the camera to reduce SD and thereby improve dynamic range. The cost is loss of detail as neighboring sensor sites are averaged. Noise, by definition, can be reduced by averaging only.

For a comparative study using the 1D3, I need two RAW frames. PM if you can supply them.

Ref:
http://en.wikipedia.org/wiki/Noise



Jun 26, 2007 at 05:48 AM
greenfields
Offline

Upload & Sell: Off
p.11 #20 · 1D3 14bit sample


Pondria wrote:

"Look at the triangular peak @ -10 stop position. And see how it moves with +1, +2 stop compensation. Unlike other peaks, this peak maintains the clearly defined triagular shape. I cannot explain this."

I think that you are seeing quantization of the lowest values - and as long as the quantization is visible the peaks do retain their basic shape [subject to the limited resolution of the display] even though they are "squashed together" as the exposure increases.

Its is possible to neatly explain the horizontal scale on the DPP raw histogram. Neatly means that the explanation fits the observations - not that it is correct !

The following notes refer to the 5D with raw files having 12 bits per channel

If you examine a raw image with deep shadows, and move the brightness slider to the left to push the shadows down to -9 on the histogram you can observe quantization. The lowest peaks and troughs of the histogram can only take certain discrete values. These are -8.4, -7.4, -6.8, -6.4, 6.1, 5.8. The values get closer together because the luminance scale is logarithmic.

Assume that bin 1 of the histogram corresponds to -8.4 on the luminance scale, then Bin 2 would be -7.4 and so on:

Bin Exposure
Number Value

0 -9 or below
1 -8.4
2 -7.4
3 -6.8
4 -6.4

The bins are only listed at one stop intervals from now
8 -5.4
16 -4.4
32 -3.4
64 -2.4
128 -1.4
256 -0.4
512 0.4
1024 1.4
2056 2.4
4095 3.4

Which is pretty much a perfect fit - because if the raw file contained 12 bits of
data it should have 4096 possible levels. I've numbered them 0 to 4095 just to fit the fact that the first bin does appear to correspond to a value below -9.




Jun 26, 2007 at 07:12 AM
1       2       3              10              12       13       14       end




FM Forums | Canon Forum | Join Upload & Sell

1       2       3              10              12       13       14       end
    
 

Welcome back
Log in to your account