Rolling shutter
Encyclopedia
Rolling shutter is a method of image acquisition in which each frame is recorded not from a snapshot of a single point in time, but rather by scanning across the frame either vertically or horizontally. In other words, not all parts of the image are recorded at exactly the same time, even though the whole frame is displayed at the same time during playback. This is in contrast with global shutter in which the entire frame is exposed for the same time window. This produces predictable distortions of fast-moving objects or when the sensor captures rapid flashes of light.
This method is implemented by rolling (moving) the shutter across the exposable image area instead of exposing the image area all at the same time. The shutter could be either mechanical or electronic. The advantage of this method is that the image sensor
can continue to gather photons during the acquisition process, thus increasing sensitivity. It is found on some film cameras (such as the Graflex Speed Graphic
), as well as digital still and video cameras using CMOS
(Complementary Metal Oxide Semiconductor) sensors, and is most noticeable when imaging extreme conditions of motion or the fast flashing of light. While some CMOS sensors use a global shutter, the majority found in the consumer market utilize a rolling shutter.
Rolling shutters can cause such effects as:
CCD
s (Charge-Coupled Devices) are alternatives to CMOS sensors. CCDs use what is referred to as global shutters which take a snapshot representing a single point of time and do not suffer from these motion artifacts.
The effects of a rolling shutter can prove difficult for visual effects filming. The process of matchmoving establishes perspective in a scene based on a single point in time, however this is difficult with a rolling shutter that provides multiple points in time within the same frame. Final results depend on the readout speed of the sensor and the nature of the scene being filmed; as a rule of thumb, higher end cinema cameras will have faster readout speeds and therefore milder rolling shutter artifacts than low end cameras.
This method is implemented by rolling (moving) the shutter across the exposable image area instead of exposing the image area all at the same time. The shutter could be either mechanical or electronic. The advantage of this method is that the image sensor
Image sensor
An image sensor is a device that converts an optical image into an electronic signal. It is used mostly in digital cameras and other imaging devices...
can continue to gather photons during the acquisition process, thus increasing sensitivity. It is found on some film cameras (such as the Graflex Speed Graphic
Speed Graphic
Produced by Graflex in Rochester, New York, the Speed Graphic is commonly called the most famous press camera. Although the first Speed Graphic cameras were produced in 1912, production of later versions continued until 1973; with the most significant improvements occurring in 1947 with the...
), as well as digital still and video cameras using CMOS
CMOS
Complementary metal–oxide–semiconductor is a technology for constructing integrated circuits. CMOS technology is used in microprocessors, microcontrollers, static RAM, and other digital logic circuits...
(Complementary Metal Oxide Semiconductor) sensors, and is most noticeable when imaging extreme conditions of motion or the fast flashing of light. While some CMOS sensors use a global shutter, the majority found in the consumer market utilize a rolling shutter.
Rolling shutters can cause such effects as:
- Wobble. This phenomenon (also known as the jello effect) is most common in hand-held shots at telephoto settings, and most extreme in cases when the camera is vibrating, possibly due to being attached to a moving vehicle, for instance. The rolling shutter causes the image to wobble unnaturally and bizarrely.
- Skew. The image bends diagonally in one direction or another as the camera or subject moves from one side to another, exposing different parts of the image at different times. Essentially, skew is a very minor manifestation of the wobble phenomenon described above.
- Smear. This effect can be easily viewed with a cell phone camera and a fan/propeller. The smear of each blade is caused by the propeller rotating at the same or near the same speed that the frame is read by the camera. Viewed perpendicular to a fan spinning clockwise, the blades on the left side appear thinner than usual while the blades on the right side appear thicker and can even appear as if they aren't connected at the center.
- Partial Exposure. If a camera flash goes off in the shot, the quick nature of the flash may only be present for some of the rows of pixels in a given frame. So as an example, the top 1/3 of the picture may be brightly lit by a flash, while the bottom 2/3 of the picture is dark and unlit as the time it took for the flash to occur was only sequenced in a short amount of time as the CMOS imager sequences a frame. The difference between the two distinct parts of the frame can look odd. Similar problems can arise with emergency vehicle lights, some fluorescent lighting, or any extreme situation where very fast motion or very fast bursts of light are seen in the time between when the CMOS chip sequentially records a frame.
- Spatial and temporal aliasingAliasingIn signal processing and related disciplines, aliasing refers to an effect that causes different signals to become indistinguishable when sampled...
.
CCD
Charge-coupled device
A charge-coupled device is a device for the movement of electrical charge, usually from within the device to an area where the charge can be manipulated, for example conversion into a digital value. This is achieved by "shifting" the signals between stages within the device one at a time...
s (Charge-Coupled Devices) are alternatives to CMOS sensors. CCDs use what is referred to as global shutters which take a snapshot representing a single point of time and do not suffer from these motion artifacts.
The effects of a rolling shutter can prove difficult for visual effects filming. The process of matchmoving establishes perspective in a scene based on a single point in time, however this is difficult with a rolling shutter that provides multiple points in time within the same frame. Final results depend on the readout speed of the sensor and the nature of the scene being filmed; as a rule of thumb, higher end cinema cameras will have faster readout speeds and therefore milder rolling shutter artifacts than low end cameras.
External links
- Airplane blades - rolling shutter effect (youtube)
- Bass strings - rolling shutter effect (vimeo)
- Excellent 3D rendering explaining how a rolling shutter produces the strange propeller airplane effect.
- Good discussion with other pictures and explanations for rolling shutters
- Video tape showing the rolling shutter problem in action.
- Another picture of rolling shutter camera taping a propeller of a plane
- A third picture of rolling shutter camera taping a propeller of a plane
- View from the propeller's perspective