Optics Express
Published by The Optical Society of America

3-D computer graphics based on integral photography

Takeshi Naemura, T. Yoshida, and H. Harashima
Optics Express, Vol. 8, Issue 4, pp. 255-262

Keywords (OCIS):
(100.6890) Image processing : Three-dimensional image processing
(110.4190) Imaging systems : Multiple imaging

Abstract
Integral photography (IP), which is one of the ideal 3-D photographic technologies, can be regarded as a method of capturing and displaying light rays passing through a plane. The NHK Science and Technical Research Laboratories have developed a real-time IP system using an HDTV camera and an optical fiber array. In this paper, the authors propose a method of synthesizing arbitrary views from IP images captured by the HDTV camera. This is a kind of image-based rendering system, founded on the 4-D data space Representation of light rays. Experimental results show the potential to improve the quality of images rendered by computer graphics techniques.

© Optical Society of America [Optical Society of America ]

» View Full Text: PDF (945 KB)
» View Multimedia File: MOV (631 KB)
» View Multimedia File: MOV (336 KB)
» View Multimedia File: MOV (298 KB)
» View Multimedia File: MOV (276 KB)
» View Multimedia File: MOV (368 KB)
» View Multimedia File: MOV (182 KB)
» View Multimedia File: MOV (260 KB)

History
Original Manuscript: December 22, 2000
Published: February 12, 2001

Citation
T. Naemura, T. Yoshida, and H. Harashima, "3-D computer graphics based on integral photography," Opt. Express 8, 255-262 (2001)
http://www.opticsinfobase.org/abstract.cfm?URI=oe-8-4-255

Click for help


Click for help

References
1.  S. E. Chen, "QuickTime VR: an image-based approach to virtual environment navigation," in SIGGRAPH'95, (Association for Computing Machinery, Los Angeles, 1995), 29-38, http://www.acm.org/pubs/articles/proceedings/graph/218380/p29-chen/p29-chen.pdf .
2.  L. McMillan and G. Bishop, "Plenoptic modeling: an image-based rendering system," in SIG-GRAPH'95, (Association for Computing Machinery, Los Angeles, 1995), 39-46, http://www.acm.org/pubs/articles/proceedings/graph/218380/p39-mcmillan/p39-mcmillan.pdf.
3.  T. Naemura, M. Kaneko and H. Harashima, "Orthographic approach to representing 3-D images and interpolating light rays for 3-D image communication and virtual environment," Signal Processing: Image Communication, 14, 21-37 (1998), http://www.elsevier.nl/gej-ng/10/22/18/35/17/18/article.pdf .
4.  T. Naemura and H. Harashima, "Ray-based approach to the integrated 3D visual communication," in Three-Dimensional Video and Display: Devices and Systems, B. Javidi and F. Okano, eds., Proc. SPIE CR76, (to be published).
5.  F. Okano, H. Hoshino, J. Arai and I. Yuyama, "Real-time pickup method for a three-dimensional image based on Integral Photography," Appl. Opt. 36, 1598-1603 (1997), http://www.opticsinfobase.org/ViewMedia.cfm?id=42907&seq=0.
6.  J. Arai, F. Okano, H. Hoshino and I. Yuyama, "Gradient-index lens-array method based on real-time integral photography for three-dimensional images," Appl. Opt. 37, 2034-2045 (1998), http://www.opticsinfobase.org/ViewMedia.cfm?id=43189&seq=0.
7.  H. Hoshino, F. Okano, H. Isono and I. Yuyama, "Analysis of resolution limitation of integral photography," J. Opt. Soc. Am. A 15, 2058-2065 (1998), http://www.opticsinfobase.org/ViewMedia.cfm?id=1567&seq=0.
8.  T. Yoshida, T. Naemura and H. Harashima, "3-D computer graphics based on integral photography," in 3-D Image Conference 2000, (Tokyo, 2000), 39-42, in Japanese http://www.3d-conf.org/00/abstracts/1-9.html#English.
9.  T. Yanagisawa, T. Naemura, M. Kaneko and H. Harashima, "Handling of 3-dimensional objects in ray space," in 1995 Information and System Society Conference, (Institute of Electronics, Information and Communication Engineers, Tokyo, 1995), D-169, in Japanese.
10.  M. Levoy and P. Hanrahan, "Light field rendering," in SIGGRAPH'96, (Association for Computing Machinery, New Orleans, 1996), 31-42, http://www.acm.org/pubs/articles/proceedings/graph/237170/p31-levoy/p31-levoy.pdf .
11.  S. Gortler, R. Grzeszczuk, R. Szeliski and M. Cohen, "The Lumigraph," in SIGGRAPH'96, (Association for Computing Machinery, New Orleans, 1996), 43-54, http://www.acm.org/pubs/articles/proceedings/graph/237170/p43-gortler/p43-gortler.pdf
12.  T. Naemura and H. Harashima, "Real-time video-based rendering for augmented spatial communication," in Visual Communication and Image Processing '99, K. Aizawa, R. Stevenson and Y. Zhang, eds., Proc. SPIE 3653, 620-631 (1999), http://bookstore.spie.org/cgi-bin/abstract.pl?bibcode=1998SPIE%2e3653%2e%2e620N&page=1&qs=spie.

Forward References
Viewing-angle-enhanced integral three-dimensional imaging along all directions without mechanical movement
   Optics Express Vol. 11 Iss. 12, (2003)
3-D computational synthetic aperture integral imaging (COMPSAII)
   Optics Express Vol. 11 Iss. 19, (2003)
Integral Imaging with Improved Depth of Field by Use of Amplitude-Modulated Microlens Arrays
   Applied Optics Vol. 43 Iss. 31, (2004)
Three-dimensional display scheme based on integral imaging with three-dimensional information processing
   Optics Express Vol. 12 Iss. 24, (2004)
Resolution-enhanced three-dimension / two-dimension convertible display based on integral imaging
   Optics Express Vol. 13 Iss. 6, (2005)
Improved analysis on the viewing angle of integral imaging
   Applied Optics Vol. 44 Iss. 12, (2005)
Layered-panel integral imaging without the translucent problem
   Optics Express Vol. 13 Iss. 15, (2005)
Wide-viewing-angle 3D/2D convertible display system using two display devices and a lens array
   Optics Express Vol. 13 Iss. 21, (2005)
Calculation of holograms from elemental images captured by integral photography
   Applied Optics Vol. 45 Iss. 17, (2006)
A thin 3D-2D convertible integral imaging system using a pinhole array on a polarizer
   Optics Express Vol. 14 Iss. 12, (2006)
Facet braiding: a fundamental problem in integral imaging
   Optics Letters Vol. 32 Iss. 9, (2007)


OSA is a member of CrossRef.