The Blur/Noise Trade-Off

The Problem

Motion blur and noise are strictly related by the exposure time: photographers, before acquiring pictures of moving objects or dim scenes, always consider whether motion blur may occur (for example, due to scene or camera motion), and carefully set the exposure time.

The trade-off is between long exposures that reduce the noise at the cost of increasing the blur, and short exposures that reduce the blur at the cost of increasing the noise. Often there is no satisfactory compromise, and the captured image is inevitably too blurry or too noisy (see Figure 1).

Blur/noise trade-off on Lena image


Blur/noise trade-off on Lena image

Figure 1: An illustration of the blur/noise trade-off in image acquisition under uniform motion (top) and camera shake (bottom): for each of the two scenarios, the raw-data observations were acquired using different exposure times along the same motion trajectory (an estimate of the corresponding point-spread function is shown at the lower left of each image). Short exposures are corrupted by overwhelming noise, while long exposures are dominated by blur. The image intensities have been normalized for the sake of visualization. Further details concerning the image acquisition settings can be found here.


Possible Remedies

Under many circumstances, blur and noise can be compensated exclusively by means of digital image restoration. Typically, the effectiveness of any restoration algorithm depends on the blur and noise amounts, as shown in Figure 2.

A desirable feature for a digital camera would be to determine -- before shooting a picture -- which is the exposure time that balances at best the blur and noise, in order to ease the restoration task. Our results go in this direction, as we investigate the blur/noise trade-off to determine the optimal exposure time when images are affected by motion blur.

Blur/noise trade-off


Blur/noise trade-off

Figure 2: The results of the Anisotropic LPA-ICI Deconvolution [Foi et al., 2005] applied to the blurred/noisy observations in Figure 1: uniform motion (top) and camera shake (bottom). As a reference, we report the PSFs used in the restoration as in Figure 1. In case of uniform-motion blur (top) the restoration errors show a clear minimum, which corresponds to the optimal exposure time: beyond such optimal value, the error increases. In case of camera shake (bottom) the restoration error practically stabilizes after reaching its point of minimum, thus long exposure time can be allowed. Therefore, different scenarios require different acquisition strategies to maximize the quality of the restored image.


The Optimal Exposure Time

For the special case of uniform-motion blur, we propose a simple mathematical formulation based on the signal-to-noise ratio in Fourier domain. This allows us to study how the performance of any image deconvolution algorithm varies with respect to the exposure time and demonstrates the existence and finiteness of an optimal exposure timethat maximizes the restoration performance, balancing the amount of blur and noise in the observation.

To investigate more general classes of motion blur, such as the blur due to camera shake, we developed a methodology for deriving a statistical model of the restoration error for a given deblurring algorithm in case of arbitrary motions, including random motion.

More specifically, each restoration-error model describes how the expected restoration error of a particular image-deblurring algorithm varies as the blur due to camera motion develops over time along with the PSF trajectory. Each model simultaneously takes into account the exposure time, its interplay with the sensor noise, and the motion randomness.

Restoration-error models allow to design customized image acquisition strategies to maximize the performance of the deblurring algorithm that will be used on the acquired pictures. In particular, in controlled imaging scenarios where the evolution of the PSF trajectory along with the exposure time can be statistically studied or analytically formulated, the restoration-error model can tell whether there exists an optimal exposure, i.e. an exposure time that minimizes the restoration error achievable by the corresponding deblurring algorithm. Then, whenever it exists, the optimal exposure time can be determined from the restoration-error model. Figure 3 illustrates the restoration-error model for the Anisotropic LPA-ICI Deconvolution [Foi et al., 2005]

Restoration-Error Model for the Anisotropic LPA-ICI Deconvolution

Figure 3 A view of the restoration-error model computed for the Anisotropic LPA-ICI Deconvolution [Foi et al., 2005]. The red and green curves represent the temporal evolution of the RMSE of images restored from rectilinear uniform motion and from camera shake, respectively. The trends of these curves well interpret the restoration performance achieved in the images of Figure 2.

Resources

References

[Boracchi and Foi, 2012] Modeling the Performance of Image Restoration from Motion Blur
Giacomo Boracchi and Alessandro Foi,
Image Processing, IEEE Transactions on. vol.21, no.8, pp. 3502 - 3517, Aug. 2012, doi:10.1109/TIP.2012.2192126
(Preprint), (BibTeX), (Original)

[Boracchi and Foi, 2011] Uniform motion blur in Poissonian noise: blur/noise trade-off
Giacomo Boracchi and Alessandro Foi,
Image Processing, IEEE Transactions on. vol. 20, no. 2, pp. 592-598, Feb. 2011 doi: 10.1109/TIP.2010.2062196
(Preprint), (BibTeX), (Original), (Raw Images)

[Foi et al., 2005] A Spatially Adaptive Poissonian Image Deblurring
Alessandro Foi, Sakari Alenius, Mejdi Trimeche, Vladimir Katkovnik, and Karen Egiazarian
IEEE Int. Conf. Image Process. , Genova, Italy, September 2005, pp. 925-928. doi: 10.1109/ICIP.2005.1529903
(Preprint), (Original)