New Patent Brings Movie Mode to DSLRs

Moderated by: Fred Miranda

Visit the FM Store · Image Upload · Buy & Sell
FM Forum Rules

FM Forums | Forum & miscellaneous | Join Image Upload
end

IronDad
Offline
Image Upload: Off

p.1 #1 · New Patent Brings Movie Mode to DSLRs

The one feature point-and-shoots still have over DSLRs is the ability to shoot video clips. DSLRs are optimized in the other direction—the mirror setup, specialized auto-focus systems, etc. Hiroshi Terada's patent for a movie mode on DSLRs has one big innovation—a semi-transparent mirror—and then pulls a PS2-on-PS3 emulation trick, cramming in the components necessary to shoot solid video alongside the DSLR's regular components.

In order to shoot at 30FPS, Photography Bay notes that a DSLR's mirror would have jump up and down at least three times faster than Canon's EOS-1D Mark III. Terada's semi-transparent mirror doesn't move, but lets 70 percent of the light through to the image sensor, enough for video. The reflected 30 percent takes care of your continuous phase-detection autofocus.

The patent actually uses two different autofocus systems—one for still image shooting, and then another for clips, which has a wider AF threshold (DSLRs tend to have a very narrow one) and a slower, smoother AF speed (vs. the light speed you want for still images). A cropping function would take care of field of view changes that happen during AF shifts.

After Live View, this was the only place left to go—the question is when we'll see these first Zapruder-capable DSLRs, though the next generation doesn't sound like an unreasonable time frame. [USPTO via Photography and Gizmodo]

Feb 18, 2008 at 02:48 PM

fizzy
Offline
Image Upload: Off

p.1 #2 · New Patent Brings Movie Mode to DSLRs

OK, but for markets like photojournalism that increasingly are shooting video alongside still, it seems the still frame grab capabilities of video cameras are sufficient quality for say, newspapers, and getting better, so I don't see the advantage of this besides marketing to amateurs moving up from P&S.

Feb 18, 2008 at 02:59 PM

IronDad
Offline
Image Upload: Off

p.1 #3 · New Patent Brings Movie Mode to DSLRs

fizzy wrote:
...so I don't see the advantage of this besides marketing to amateurs moving up from P&S.

And they said the same thing about live view ;-)

Feb 18, 2008 at 03:04 PM

PierreB
Offline
Image Upload: On

p.1 #4 · New Patent Brings Movie Mode to DSLRs

I agree with A.Y. Whilst it may seem like a gimmick to many, the ability to capture HD video with a DSLR would be great for travel.
Pierre.

Feb 18, 2008 at 04:07 PM

BenV
Online
Buy and Sell: On

p.1 #5 · New Patent Brings Movie Mode to DSLRs

sounds promising, lets see what happens

Feb 18, 2008 at 04:09 PM

floris
Offline
Buy and Sell: On

p.1 #6 · New Patent Brings Movie Mode to DSLRs

The idea of a semi-transparent mirror is, of course, quite old... it offers many more useful features than just allowing for HD video. ie. continuous autofocus without blackouts, less noise, less vibration, faster response, etc. It would be neat if canon were to reintroduce the pellicle mirror of the EOS RT and 1N RS in a 1D.. especially with the superb high iso these days to counteract the loss of light. I don't care too much for the video, but there are so many useful applications of using such a mirror.

Feb 18, 2008 at 04:23 PM

panos.v
Offline
Image Upload: Off

p.1 #7 · New Patent Brings Movie Mode to DSLRs

Feb 18, 2008 at 05:38 PM

AJ Nadershahi
Offline
Image Upload: Off

p.1 #8 · New Patent Brings Movie Mode to DSLRs

Why not just forgo the mirror and use an extremely high resolution LCD panel as the viewfinder that pulls its image from the image sensor. AKA P+S camera design, from which "live view" has been borrowed from in the first place.

Feb 18, 2008 at 06:00 PM

Gochugogi
Offline
Image Upload: Off

p.1 #9 · New Patent Brings Movie Mode to DSLRs

fizzy wrote:
...so I don't see the advantage of this besides marketing to amateurs moving up from P&S.

And they said the same thing about live view ;-)

I've played with LV on my 40D for a couple months off and on. Thought I might find some use for it. The camera LCD screen is just too tiny and dim to see what the hell is going on--the normal VF is so much better. Well, LV was somewhat useful tethered to my Mac but beyond the odd still life studio shoot, it's just another hardly used feature like the direct print button.

Feb 18, 2008 at 06:19 PM

Ben Horne
Offline
Image Upload: On

p.1 #10 · New Patent Brings Movie Mode to DSLRs

It sound stupid and consumerish, but if I had a camera with it, and the quality was very high.... I'd likely use it for small things here and there.

Feb 18, 2008 at 06:27 PM

RT v Genugten
Offline
Image Upload: On

p.1 #11 · New Patent Brings Movie Mode to DSLRs

My phone takes pictures too. It doesn't make it a camera though.

Feb 18, 2008 at 06:30 PM

floris
Offline
Buy and Sell: On

p.1 #12 · New Patent Brings Movie Mode to DSLRs

panos.v wrote:

And it also introduces the need to have a clean and damage free mirror.

A good point.. the mirror does seem to catch a lot of dust that would otherwise land on the sensor.

Feb 18, 2008 at 06:44 PM

cineski
Offline
Buy and Sell: On

p.1 #13 · New Patent Brings Movie Mode to DSLRs

I agree with Ben, however, if I sure hope it doesn't take away from the still operation at all.

Feb 18, 2008 at 06:49 PM

floris
Offline
Buy and Sell: On

p.1 #14 · New Patent Brings Movie Mode to DSLRs

What would actually be pretty sweet is if they implemented one of those systems where it stores say the last 5 sec in a buffer, and then you press the button to save the buffer - that way you would never miss an exciting moment, without burning through too much memory. Of course, that would give you way more (still) frames than you could possibly want from a photographic point of view, but I'm sure it could be useful.

Feb 18, 2008 at 08:09 PM

claudermilk
Offline
Image Upload: Off

p.1 #15 · New Patent Brings Movie Mode to DSLRs

If I want video, I'll buy a video camera. I have a DSLR because I want to take stills. To me it's just more bells & whistles to add to the sales brochure list. Meh.

Feb 19, 2008 at 12:23 AM

dirb9
Offline
Image Upload: Off

p.1 #16 · New Patent Brings Movie Mode to DSLRs

floris wrote:
The idea of a semi-transparent mirror is, of course, quite old... it offers many more useful features than just allowing for HD video. ie. continuous autofocus without blackouts, less noise, less vibration, faster response, etc. It would be neat if canon were to reintroduce the pellicle mirror of the EOS RT and 1N RS in a 1D.. especially with the superb high iso these days to counteract the loss of light. I don't care too much for the video, but there are so many useful applications of using such a mirror.

I've been bringing up the idea of a pellicle mirror (that is what Canon and Nikon have referred to it as) for years now for DSLRs. Since DSLRs don't have to advance film, there isn't any reason why they can't shoot at higher frame rates. It really puts a sock in those rangefinder people's aguments when they talk about not being able to see the image at the time of exposure, and I bring up pellicle mirrors.

The idea of using it for high speed is actually very old, the Canon F1 and F1n high speed (10 and 14 FPS, respectively), and the Nikon F2 and F3 high speed (9 and 11 FPS I believe). Canon also made consumer pellicle cameras during the 70s as well, the Pellix and the Pellix QL. Very nice cameras.

Feb 19, 2008 at 01:51 AM

invalid2
Offline
Image Upload: Off

p.1 #17 · New Patent Brings Movie Mode to DSLRs

dirb9 wrote:
Since DSLRs don't have to advance film, there isn't any reason why they can't shoot at higher frame rates.

Data throughput is a simple reason, if ignoring that, maybe heat, storage, and power could all limit the effective speed.

If you get a system that deal with all of those problems, you might have something that looks like the red one camera. It sometimes has issues with fast movement because it uses a rolling shutter (rather than a global shutter).

Edited on Feb 19, 2008 at 05:12 AM

Feb 19, 2008 at 05:10 AM

Tentacle
Offline
Image Upload: Off

p.1 #18 · New Patent Brings Movie Mode to DSLRs

invalid2 wrote:
dirb9 wrote:
Since DSLRs don't have to advance film, there isn't any reason why they can't shoot at higher frame rates.

Data throughput is a simple reason, if ignoring that, maybe heat, storage, and power could all limit the effective speed.

If you get a system that deal with all of those problems, you might have something that looks like the red one camera. It sometimes has issues with fast movement because it uses a rolling shutter (rather than a global shutter).

1920x1080 full HD means 2 Mpixel per image. Now do 30 frames per second. The 1D(s) Mk II series could do about the same pixels-per-second throughput. So that's not the bottleneck.

Storage? Full HD will do up to 24 Mbps, compressed output at highest quality, which means just under 3 megabyte per second. With the biggest Pretec CF card of 48 GB (Samsung announced a CF card of 60 GB) you're looking at more than 4 hours of recording time.

... Now, moving to Quad HDTV (3840×2160 or 2160p at 8.3 Mpixel per frame) would be a challenge for dSLR and CF storage. For that we'd need HD storage.

Feb 19, 2008 at 03:39 PM

invalid2
Offline
Image Upload: Off

p.1 #19 · New Patent Brings Movie Mode to DSLRs

dirb9 wrote:
Since DSLRs don't have to advance film, there isn't any reason why they can't shoot at higher frame rates.

invalid2 wrote:
Data throughput is a simple reason, if ignoring that, maybe heat, storage, and power could all limit the effective speed.

If you get a system that deal with all of those problems, you might have something that looks like the red one camera. It sometimes has issues with fast movement because it uses a rolling shutter (rather than a global shutter).

Tentacle wrote:
1920x1080 full HD means 2 Mpixel per image. Now do 30 frames per second. The 1D(s) Mk II series could do about the same pixels-per-second throughput. So that's not the bottleneck.

Storage? Full HD will do up to 24 Mbps, compressed output at highest quality, which means just under 3 megabyte per second. With the biggest Pretec CF card of 48 GB (Samsung announced a CF card of 60 GB) you're looking at more than 4 hours of recording time.

... Now, moving to Quad HDTV (3840×2160 or 2160p at 8.3 Mpixel per frame) would be a challenge for dSLR and CF storage. For that we'd need HD storage.

Sorry for not stating more clearly that I was listing limitations for a ~10MP, 30+fps camera - and expecting that the same limitations would hold for 21MP at similar frame rates.
If you want raw output (like with a dslr), you would need 10MP*12bpp*30fps=540MB/s (which would run to 1.8TB in an hour). Now if you can compress the data, you can get a lower bitrate, but then you need to make sure you can compress it fast enough. To pick a real world example, the "redcode raw" codec can run at 4k resolution up to 30fps with a compressed data rate of about 27.5MB/s (ref, CineForm ref). It is not able to handle faster frame rates at that resolution (I do not know why).

If you want to consider just HD resolutions, eg 1080p - please do look at SDI data rates (ref).

Edited on Feb 19, 2008 at 11:04 PM

Feb 19, 2008 at 11:01 PM

Tentacle
Offline
Image Upload: Off

p.1 #20 · New Patent Brings Movie Mode to DSLRs

invalid2 wrote:

[...]

If you want raw output (like with a dslr), you would need 10MP*12bpp*30fps=540MB/s (which would run to 1.8TB in an hour). Now if you can compress the data, you can get a lower bitrate, but then you need to make sure you can compress it fast enough. To pick a real world example, the "redcode raw" codec can run at 4k resolution up to 30fps with a compressed data rate of about 27.5MB/s (ref, CineForm ref). It is not able to handle faster frame rates at that resolution (I do not know why).

[...]

Ah, but it is. The RedOne will do 2540p at 30 fps RAW if you record to external RAID. The package of two laptop HDs in RAID 0 isn't fast enough to take more than 4K with lossy codec, but that doesn't mean it can't be done.

The company decided to discontinue the option for RAW 2540p output for now because it was technically difficult and the external HD array solution made it cumbersome, but that doesn't mean it couldn't be done in the first place.

If we assume lossless RAW compression of about 1 Mpixel to 1.2 Mbyte (seems fair, Canon RAW is comparable) then 30 fps at 12 Mpixel will mean around 400 to 450 MB/sec output. Group 4 high-end hard disks together in RAID 0 and you'll easily push this much data onto hard disk. Two 3 Gbit SAS links should do the trick.

Feb 20, 2008 at 06:14 AM

invalid2
Offline
Image Upload: Off

p.1 #21 · New Patent Brings Movie Mode to DSLRs

Tentacle wrote:
invalid2 wrote:
[...]
If you want raw output (like with a dslr), you would need 10MP*12bpp*30fps=540MB/s (which would run to 1.8TB in an hour). Now if you can compress the data, you can get a lower bitrate, but then you need to make sure you can compress it fast enough. To pick a real world example, the "redcode raw" codec can run at 4k resolution up to 30fps with a compressed data rate of about 27.5MB/s (ref, CineForm ref). It is not able to handle faster frame rates at that resolution (I do not know why).
[...]

Ah, but it is. The RedOne will do 2540p at 30 fps RAW if you record to external RAID. The package of two laptop HDs in RAID 0 isn't fast enough to take more than 4K with lossy codec, but that doesn't mean it can't be done.

The company decided to discontinue the option for RAW 2540p output for now because it was technically difficult and the external HD array solution made it cumbersome, but that doesn't mean it couldn't be done in the first place.

If we assume lossless RAW compression of about 1 Mpixel to 1.2 Mbyte (seems fair, Canon RAW is comparable) then 30 fps at 12 Mpixel will mean around 400 to 450 MB/sec output. Group 4 high-end hard disks together in RAID 0 and you'll easily push this much data onto hard disk. Two 3 Gbit SAS links should do the trick.

Would you mind providing a reference for the maximum fps at full resolution - I have not found anything other than 30fps. And while I am feeling lazy, would you mind listing the hard drives that can write at >100MBps sustained - though I don't think it really matters, since you can just use 10-15 slower disks and handwave the rest.

Now that you have a 10lb camera (no lens) and a large pile of hard disks - who do you expect to use this in situations calling for a dslr?

Edited on Feb 20, 2008 at 08:12 AM

Feb 20, 2008 at 08:09 AM

Tentacle
Offline
Image Upload: Off

p.1 #22 · New Patent Brings Movie Mode to DSLRs

invalid2 wrote:

[...]

Would you mind providing a reference for the maximum fps at full resolution - I have not found anything other than 30fps. And while I am feeling lazy, would you mind listing the hard drives that can write at >100MBps sustained - though I don't think it really matters, since you can just use 10-15 slower disks and handwave the rest.

Now that you have a 10lb camera (no lens) and a large pile of hard disks - who do you expect to use this in situations calling for a dslr?

Sorry, can't find a reference to the RAW fps numbers that the camera puts out, but it's what was mentioned when news about RedOne came out.

The sensor can spew out 60 fps RAW at native 2540p resolution, according to the RedOne specification: http://www.red.com/store/product_detail/31

Disk-wise, a single Seagate Cheetah 15K.5 146GB will push, depending on controller, a sustained sequential throughput of at least 80 MB/sec, up to 120+ MB/sec, on SAS link. 4 WD Raptors in RAID 0 will hit sustained data transfer rates, for sequential operations, of more than 200 MB/sec.

Refs here: site is in dutch, sorry:
Single disk Seagate Cheetah 15k.5: http://tweakers.net/benchdb/testcombo/1279
2-disk RAID 0 setup with WD Raptor WD740ADFD, 74 GB: http://tweakers.net/benchdb/testcombo/1608
4-disk RAID 0 with WD Raptor WD740ADFD, 74 GB: http://tweakers.net/benchdb/testcombo/1602

Edited on Feb 20, 2008 at 04:59 PM

Feb 20, 2008 at 11:41 AM

invalid2
Offline
Image Upload: Off

p.1 #23 · New Patent Brings Movie Mode to DSLRs

Tentacle wrote:
[...]
The sensor can spew out 60 fps RAW at native 2540p resolution, according to the RedOne specification: http://www.red.com/store/product_detail/31

Disk-wise, a single Seagate Cheetah 15K.5 146GB will push, depending on controller, a sustained sequential throughput of at least 80 MB/sec, up to 120+ MB/sec, on SAS link. 4 WD Raptors in RAID 0 will hit sustained data transfer rates, for sequential operations, of more than 200 MB/sec.

Refs here: site is in dutch, sorry:
Single disk Seagate Cheetah 15k.5: http://tweakers.net/benchdb/testcombo/1279
2-disk RAID 0 setup with WD Raptor WD740ADFD, 74 GB: http://tweakers.net/benchdb/testcombo/1608
4-disk RAID 0 with WD Raptor WD740ADFD, 74 GB: http://tweakers.net/benchdb/testcombo/1602

Thanks for the pointer - the only spec I found on their website was 30fps at full resolution, 72fps at 2k.

I am not sure the tweakers.net tests are relevant to large transfers - the description of the write test seems to talk about burst writing more than sustained (max of 32MB per test), but I am sure that if you get enough disks and high performance controller, you can stream 500MB/s. I will still claim that this is very different from a dlsr.

Feb 21, 2008 at 12:24 AM

Tentacle
Offline
Image Upload: Off

p.1 #24 · New Patent Brings Movie Mode to DSLRs

invalid2 wrote:

[...]

I am not sure the tweakers.net tests are relevant to large transfers - the description of the write test seems to talk about burst writing more than sustained (max of 32MB per test), but I am sure that if you get enough disks and high performance controller, you can stream 500MB/s. I will still claim that this is very different from a dlsr.

The ATTO benchmark numbers are for max 32 MB, so that will partially test HD cache and/or controller cache. However, the Winbench99 and IOmeter numbers get closer to sustained transfer rates. (And you'll find that transfer rates of more than 600 MB/sec are possible with just 6 HDs.)

Feb 21, 2008 at 09:19 AM


FM Forums \| Forum & miscellaneous \| Join Image Upload end