Creating high fidelity 360° virtual reality with high dynamic range spherical panorama images | Intellect Skip to content
1981
  1. Home
  2. A-Z Publications
  3. Virtual Creativity
  4. Volume 9, Issue 1
  5. Article
Volume 9, Issue 1-2
  • ISSN: 2397-9704
  • E-ISSN: 2397-9712

Abstract

Abstract

This research explores the development of a novel method and apparatus for creating spherical panoramas enhanced with high dynamic range (HDR) for high fidelity Virtual Reality 360 degree (VR360) user experiences. A VR360 interactive panorama presentation using spherical panoramas can provide virtual interactivity and wider viewing coverage; with three degrees of freedom, users can look around in multiple directions within the VR360 experiences, gaining the sense of being in control of their own engagement. This degree of freedom is facilitated by the use of mobile displays or head-mount-devices. However, in terms of image reproduction, the exposure range can be a major difficulty in reproducing a high contrast real-world scene. Imaging variables caused by difficulties and obstacles can occur during the production process of spherical panorama facilitated with HDR. This may result in inaccurate image reproduction for location-based subjects, which will in turn result in a poor VR360 user experience. In this article we describe a HDR spherical panorama reproduction approach (workflow and best practice) which can shorten the production processes, and reduce imaging variables, and technical obstacles and issues to a minimum. This leads to improved photographic image reproduction with fewer visual abnormalities for VR360 experiences, which can be adaptable into a wide range of interactive design applications. We describe the process in detail and also report on a user study that shows the proposed approach creates images which viewers prefer, on the whole, to those created using more complicated HDR methods, or to those created without the use of HDR at all.

© Intellect Ltd
Loading

Article metrics loading...

/content/journals/10.1386/vcr_00006_1
2019-12-01
2024-04-19
Loading full text...

Full text loading...

References

  1. Adams, A.. (1983), Examples: The Making of 40 Photographs, Boston:: Little, Brown & Co.;
     [Google Scholar]
  2. Adobe (2019);, 'Digital Negative (DNG)'. , Adobe, 14 May, https://helpx.adobe.com/photoshop/digital-negative.html. Accessed 25 March 2019 .
     [Google Scholar]
  3. Awang Rambli, D. R.,, Sulaiman, S.,, Nayan, M. Y., and Asoruddin, A. R.. (2009);, 'A step-wise zoom technique for exploring image-based virtual reality applications'. , World Academy of Science, Engineering and Technology, Open Science Index 26, pp. 259-62, http://doi.org/10.5281/zenodo.1073197. Accessed 19 November 2019 .
     [Google Scholar]
  4. Banterle, F.,, Artusi, A.,, Debattista, K., and Chalmers, A.. (2018), Advanced High Dynamic Range Imaging, Milton Park:: CRC Press and Taylors & Francis Group;.
     [Google Scholar]
  5. Benosman, R., and Kang, S. B.. (2001), Panoramic Vision: Sensors, Theory, and Applications, New York:: Springer-Verlag New York;.
     [Google Scholar]
  6. Brown, M., and Lowe, D. G.. (2006);, 'Automatic panoramic image stitching using invariant features'. , International Journal of Computer Vision, 74:1, pp. 59-73.
     [Google Scholar]
  7. Capture One (2017);, 'Capture One'. , https://www.phaseone.com/en/Products/Software/Capture-One-Pro. Accessed 19 December 2017 .
  8. Candy, L.. (2006), Practice-Based Research: A Guide: CCS Report: 2006-V1.0 November, Sydney:: University of Technology Sydney;.
     [Google Scholar]
  9. Chen, E.. (1995);, 'QuickTime VR – an image-based approach to virtual environment navigation'. , SIGGRAPH '95, Los Angeles, USA:, 6-11 August .
     [Google Scholar]
  10. Debevec, P. E., and Malik, J.. (1997);, 'Recovering high dynamic range radiance maps from photographs'. , SIGGRAPH, Los Angeles:: Association Association for Computing Machinery;, pp. 369-78.
     [Google Scholar]
  11. DiVerdi, S.,, Wither, J., and Höllerer, T.. (2009);, 'All around the map: Online spherical panorama construction'. , Computers & Graphics, 33:1, pp. 73-84.
     [Google Scholar]
  12. Fairchild, M. D.. (2007);, 'The HDR photographic survey'. , IS&T/SID 15th Color Imaging Conference, Albuquerque:: Society for Imaging Science and Technology (IS&T);, pp. 233-38.
     [Google Scholar]
  13. Fangi, G.,, Pierdicca, R.,, Sturari, M., and Malinverni, E. S.. (2018);, 'Improving spherical photogrammetry using 360° omni-cameras: Use cases and new applications'. , Remote Sensing and Spatial Information Sciences, The International Archives of the Photogrammetry, vol. XLII-2, Riva del Garda:, 4-7 June .
     [Google Scholar]
  14. Felinto, D.,, Zang, A. R., and Velho, L.. (2012);, 'Production framework for full panoramic scenes with photorealistic augmented reality'. , XXXVIII Latin American Conference of Informatics (CLEI), Medellín, Colombia:, 1-5 October.
     [Google Scholar]
  15. Fisher, E. C.,, Akkaynak, D.,, Harris, J.,, Herries, A. I. R.,, Jacobs, Z.,, Karkanas, P.,, Marean, C. W., and McGrath, J.. (2015);, 'Technical considerations and methodology for creating high-resolution, color-corrected, and georectified photomosaics of stratigraphic sections at archaeological sites'. , Journal of Archaeological Science, 57, pp. 380-94.
     [Google Scholar]
  16. Gakken Co. (2008), Mastering in RAW, Singapore:: Canon Singapore;.
     [Google Scholar]
  17. Gawthrop, P.. (2007);, 'Creating spherical panoramas with the Canon 5D and 15mm Fisheye Lens'. , lightspacewater.net, 27 September, http://www.lightspacewater.net/Tutorials/PhotoPano2/paper/. Accessed 16 September 2012 .
     [Google Scholar]
  18. Gledhill, D.,, Tian, G. Y.,, Taylor, D., and Clarke, D.. (2003);, 'Panoramic imaging – a review'. , Computers & Graphics, 27:3, pp. 435-45.
     [Google Scholar]
  19. Gray, C., and Malins, J. (2004), Visualizing Research: A Guide to the Research Process in Art and Design, Aldershot:: Ashgate Publishing Limited;.
     [Google Scholar]
  20. Guo, Y.,, Zhao, R.,, Wu, S., and Wang, C.. (2018);, 'Image capture pattern optimization for panoramic photography'. , Multimedia Tools and Applications, 77:17, pp. 22299-318.
     [Google Scholar]
  21. Hasinoff, S. W.,, Sharlet, D.,, Geiss, R.,, Adams, A.,, Barron, J. T.,, Kainz, F.,, Chen, J., and Levoy, M.. (2016);, 'Burst photography for high dynamic range and low-light imaging on mobile cameras'. , ACM Transactions on Graphics, 35:6, pp. 12.
     [Google Scholar]
  22. Hill, R.. (2010), Photographer's Guide to RAW in Photoshop, London:: Future Publishing;.
     [Google Scholar]
  23. Jung, J.,, Lee, J.,, Kim, B., and Lee, S.. (2017);, 'Upright adjustment of 360 spherical panoramas'. , Virtual Reality 2017, IEEE, Los Angeles, California;, 18-22 March.
    [Google Scholar]
  24. Karađuzović -Hadžiabdić, K.,, Telalović, J. H., and Mantiuk, R. K.. (2017);, 'Assessment of multi-exposure HDR image deghosting methods'. , Computers & Graphics, 63, pp. 1-17.
     [Google Scholar]
  25. Kent, B. R.. (2017);, 'Spherical panoramas for astrophysical data visualization'. , Publications of the Astronomical Society of the Pacific, 129:975, https://doi.org/10.1088/1538-3873/aa5543. Accessed 19 November 2019 .
     [Google Scholar]
  26. Koeva, M.,, Luleva, M., and Maldjanski, P.. (2017);, 'Integrating spherical panoramas and maps for visualization of cultural heritage objects using virtual reality technology'. , Sensors 2017, IEEE, Glasgow, Scotland:, 30 October-1 November .
     [Google Scholar]
  27. Ma, K.,, Duanmu, Z.,, Yeganeh, H., and Wang, Z.. (2018);, 'Multi-exposure image fusion by optimizing a structural similarity index'. , IEEE Transactions on Computational Imaging, 4:1, pp. 60-72.
     [Google Scholar]
  28. Manfrotto (2017);, 'Multi-row Panoramic Head'. , https://www.manfrotto.co.uk/multi-row-panoramic-head. Accessed 29 March 2017 .
  29. Mantiuk, R. K.,, Myszkowski, K., and Seidel, H.. (2015);, 'High dynamic range imaging'. , in Wiley Encyclopedia of Electrical and Electronics Engineering, New Jersey:: John Wiley & Sons;.
     [Google Scholar]
  30. Nightingale, D.. (2012), Practical HDR, Second Edition: A Complete Guide to Creating High Dynamic Range Images with your Digital SLR, Focal Press, Waltham, MA:: Focal Press;.
     [Google Scholar]
  31. Okura, F., and Kanbara, M.. (2014);, 'Aerial full spherical HDR imaging and display'. , Virtual Reality, 18:4, pp. 255-69.
     [Google Scholar]
  32. Popovic, V.,, Seyid, K.,, Pignat, E.,, Çogal, Ö., and Leblebici, Y.. (2014);, 'Multi-camera platform for panoramic real-time HDR video construction and rendering'. , Journal of Real-Time Image Processing, 12:4, December, pp. 697-708.
     [Google Scholar]
  33. PTGui (2018);, 'Features of PTGui and PTGui Pro'. , https://www.ptgui.com/features.html. Accessed 30 November 2018 .
  34. Rafi, A.,, Tinauli, M., and Izani, M.. (2007);, 'High dynamic range images: Evolution, applications and suggested processes'. , Information Visualization, 2007 (IV '07): 11th International Conference, Zurich, Switzerland:, 4-7 July .
     [Google Scholar]
  35. Rehm, L.. (2009);, 'D3x in depth review'. , 19 February http://www.dpreview.com/reviews/nikond3x. Accessed 1 December 2010 .
  36. Reinhard, E.,, Heidrich, W.,, Debevec, P.,, Pattanaik, S.,, Ward, G., and Myszkowski, K.. (2010), High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting, , 2nd. ed., Amsterdam:: Elsevier;.
     [Google Scholar]
  37. Silk, S.. (2011);, 'High dynamic range panoramic imaging with scene motion'. , MA.Sc. thesis, Ottawa:: University of Ottawa;.
     [Google Scholar]
  38. Steinmuller, E., and Gulbins, J.. (2010), The Digital Photography Workflow Handbook – From Import to Output, Heidelberg:: Steinmuller Photo;.
     [Google Scholar]
  39. Ueberheide, M.,, Muehlhausen, M., and Magnor, M.. (2018);, 'Low cost setup for high resolution multiview panorama recording and registration'. , 26th European Signal Processing Conference (EUSIPCO), Rome, Italy:, 3-7 September .
     [Google Scholar]
  40. Yue, G.,, Hou, C.,, Gu, K.,, Mao, S., and Zhang, W.. (2018);, 'Biologically inspired blind quality assessment of tone-mapped images'. , IEEE Transactions on Industrial Electronics, 65:3, pp. 2525-36.
     [Google Scholar]
  41. See, Zi Siang,, Goodman, Lizbeth,, Hight, Craig,, Sunar, Mohd Shahrizal,, Dey, Arindam,, Ng, Yen Kaow, and Billinghurst, Mark. (2019);, 'Creating high fidelity 360° virtual reality with high dynamic range spherical panorama images'. , Virtual Creativity, 9:1+2, pp. 73-109, doi: https://doi.org/10.1386/vcr_00006_1
     [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.1386/vcr_00006_1
Loading
Creating high fidelity 360° virtual reality with high dynamic range spherical panorama images
Virtual Creativity 9, 73 (2019); https://doi.org/10.1386/vcr_00006_1
/content/journals/10.1386/vcr_00006_1
/content/journals/10.1386/vcr_00006_1
Loading

Data & Media loading...

  • Article Type: Article
Keyword(s): computational photography; extended reality; high dynamic range; interaction design; spherical panorama; user experience study; virtual reality

Most Cited Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a success
Invalid data
An error occurred
Approval was partially successful, following selected items could not be processed due to error