Project
Home  >  Project  >  Details

Advanced Image Sensing

Outline

Image sensors (cameras) are used in many applications, such as still cameras, video cameras, as well as in recent years, monitoring systems, automobiles, medical care, and factory automation. However, even for the latest-type digital cameras, the basic structure?optics and projective geometry?has been completely the same for film cameras invented about two centuries ago; the only difference is that the file is replaced by electric images from CCD or CMOS sensors. We propose a novel camera system that uses dynamic optical elements and new image sensing techniques utilizing a camera in this advanced image sensing project. Figure 1 illustrates the concept of the proposed camera system.

Detail

n this study, we propose a new imaging technique that actively controls optical characteristics for capturing an image. It is completely different from conventional cameras, since the optics of the conventional camera is usually fixed.

In advanced image sensing, we aim to solve many problems, which are difficult to eliminate with traditional images, by reviewing the camera optics and hardware in order to reconsider the best way to sensing input images for applications. Traditional cameras use passive optical elements, such as a lens and filter, which do not change the refraction index, transmittance, or polarization property. The proposed camera is realized by using special active optical devices: LCDs, LCoS, and tunable filters that change the characteristics with electrical signals. The camera can also use auto-focus and auto-iris mechanisms already part of modern cameras. The combination of these mechanisms enables us to quickly change the optical characteristics while shooting images, which allows information about scene depth, resolution, and movement to be coded and images to be multiplexed. Based on this concept, we implemented focus-sweep and programmable aperture cameras and then realized many applications, such as image deblurring, extending or controlling the depth of field, scene depth estimation, and acquisition of light-field images. We believe that this study not only proposes an image acquisition technique for particular applications, but also has the potential to greatly extend the traditional frameworks and any applications of image processing and computer vision, which can handle only images shot with normal cameras.

Research Promotion

This work was supported by
KAKENHI Grant-in-Aid for Young Scientists (A) (21680018) and Grant-in-Aid for challenging Exploratory Research (20650023)
Microsoft Research Core 8 project

Publications

Journals

  • Shuhei Matsui, Hajime Nagahara, Rin-ichiro Taniguchi
    Half-sweep imaging for depth from defocus
    Image and Vision Computing, Vol.32, No.11, pp.954–964, 2014.11
    (Keyword: camera)
    BibTeX, ScienceDirect
  • Toshiki Sonoda, Hajime Nagahara, Rin-ichiro Taniguchi
    Motion-invariant Coding Using a Programmable Aperture Camera
    IPSJ Transactions on Computer Vision and Applications, Vol.6, pp.25-33, 2014.06
    (Keyword: camera)
    BibTeX, Link
  • Hajime Nagahara, Changyin Zhou, Takuya Watanabe, Hiroshi Ishiguro, Shree K. Nayar
    Programmable Aperture Camera Using LCoS
    IPSJ Transactions on Computer Vision and Applications, Vol.4, pp.1-11, 2012.03
    (Keyword: camera)
    BibTeX
  • Sujit Kuthirummal, Hajime Nagahara, Changyin Zhou, Shree K. Nayar
    Flexible Depth of Field Photography
    IEEE Transactions on Pattern Recognition and Machine Intelligence, Vol.33, No.1, pp.58 - 71, 2011.01
    (Keyword: camera)
    BibTeX

International Conferences

  • Toshiki Sonoda, Hajime Nagahara, Rin-ichiro Taniguchi
    Motion-Invariant Coding Using a Programmable Aperture Camera
    The 11th Asian Conference on Computer Vision (ACCV2012), 2012.11
    (Keyword: camera)
    BibTeX
  • Shuhei Matsui, Hajime Nagahara, Rin-ichiro Taniguchi
    Half-Sweep Imaging for Depth from Defocus
    Proc. 5th Pacific Rim Symposium on Advanced in Image and Video Technology, No.LNCS7087, pp.335-347, 2011.11
    (Keyword: camera)
    BibTeX
  • Hajime Nagahara, Changyin Zhou, Takuya Watanabe, Hiroshi Ishiguro, Shree Nayar
    Programmable Aperture Camera Using LCoS
    Proc. European Conf. Computer Vision, No.LNCS6316, pp.337-350, 2010.09
    (Keyword: camera)
    BibTeX
  • Hajime Nagahara, Sujit Kuthirummal, Changyin Zhou, Shree K. Nayar
    Flexible Depth of Field Photography
    Proc. European Conf. Computer Vision, No.LNCS 5305, pp.60-73, 2008.10
    (Keyword: camera)
    BibTeX