Journal of Multimedia, Vol 7, No 2 (2012), 132-144, Apr 2012
doi:10.4304/jmm.7.2.132-144

From the Digitization of Cultural Artifacts to the Web Publishing of Digital 3D Collections: an Automatic Pipeline for Knowledge Sharing

Frédéric Larue, Marco Di Benedetto, Matteo Dellepiane, Roberto Scopigno

Abstract


In this paper, we introduce a novel approach intended to simplify the production of multimedia content from real objects for the purpose of knowledge sharing, which is particularly appropriate to the cultural heritage field. It consists in a pipeline that covers all steps from the digitization of the objects up to the Web publishing of the resulting digital copies. During a first stage, the digitization is performed by a high speed 3D scanner that recovers the object's geometry. A second stage then extracts from the recovered data a color texture as well as a texture of details, in order to enrich the acquired geometry in a more realistic way. Finally, a third stage converts these data so that they are compatible with the recent WebGL paradigm, then providing 3D multimedia content directly exploitable by end-users by means of standard Internet browsers. The pipeline design is centered on automation and speed, so that it can be used by non expert users to produce multimedia content from potentially large object's collections, like it may be the case in cultural heritage. The choice of a high speed scanner is particularly adapted for such a design, since this kind of devices has the advantage of being fast and intuitive. Processing stages that follow the digitization are both completely automatic and ``seamless'', in the sense that it is not incumbent upon the user to perform tasks manually, nor to use external softwares that generally need additional operations to solve compatibility issues.


Keywords


3d scanning; web publishing; cultural heritage; color texturing; in-hand scanning

References


 

[1] O. Hall-Holt and S. Rusinkiewicz, Stripe boundary codes for real-time structured-light range scanning of moving objects, in ICCV 2001, 2001, pp. 359–366 vol.2.

[2] S. Rusinkiewicz, O. Hall-Holt, and M. Levoy, Real-time 3d model acquisition, ACM Trans. Graph., vol. 21, pp. 438–446, July 2002.
http://dx.doi.org/10.1145/566570.566600

[3] T. Weise, T. Wismer, B. Leibe, and L. V. Gool, In-hand scanning with online loop closure, in 3DIM09, October 2009.

[4] L. Zhang, B. Curless, and S. Seitz, Spacetime stereo: shape recovery for dynamic scenes, in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, june 2003, pp. II – 367–74 vol.2.

[5] T. Weise, B. Leibe, and L. V. Gool, Fast 3d scanning with automatic motion compensation, in IEEE CVPR’07, June 2007.

[6] F. Larue and J.-M. Dischler, Automatic registration and calibration for efficient surface light field acquisition, in 7th VAST International Symposium on Virtual Reality, Archeology and Cultural Heritage. Eurographics, 2006, pp. 171–178.

[7] R. Gal, Y. Wexler, E. Ofek, H. Hoppe, and D. Cohen-Or, Seamless montage for texturing models, Comput. Graph. Forum, vol. 29, no. 2, pp. 479–486, 2010.
http://dx.doi.org/10.1111/j.1467-8659.2009.01617.x

[8] K. Ikeuchi, T. Oishi, J. Takamatsu, R. Sagawa, A. Nakazawa, R. Kurazume, K. Nishino, M. Kamakura, and Y. Okamoto, The great buddha project: digitally archiving, restoring, and analyzing cultural heritage objects, Int. J. Comput. Vision, vol. 75, no. 1, pp. 189–208, 2007.
http://dx.doi.org/10.1007/s11263-007-0039-y

[9] I. Stamos, L. Liu, C. Chen, G. Wolberg, G. Yu, and S. Zokai, Integrating automated range registration with multiview geometry for the photorealistic modeling of large-scale scenes, Int. J. Comput. Vision, vol. 78, pp. 237–260, July 2008.
http://dx.doi.org/10.1007/s11263-007-0089-1

[10] M. Corsini, M. Dellepiane, F. Ponchio, and R. Scopigno, Image-to-geometry registration: a mutual information method exploiting illumination-related geometric properties, Computer Graphics Forum, vol. 28, no. 7, pp. 1755–1764, 2009.
http://dx.doi.org/10.1111/j.1467-8659.2009.01552.x

[11] T. Franken, M. Dellepiane, F. Ganovelli, P. Cignoni, C. Montani, and R. Scopigno, Minimizing user intervention in registering 2D images to 3D models, The Visual Computer, vol. 21, no. 8-10, pp. 619–628, sep 2005.
http://dx.doi.org/10.1007/s00371-005-0309-z

[12] J. Dorsey, H. Rushmeier, and F. Sillion, Digital modeling of material appearance. Morgan Kauf./Elsevier, 2007.

[13] M. Callieri, P. Cignoni, and R. Scopigno, Reconstructing textured meshes from multiple range rgb maps, in 7th Int.l Fall Workshop on Vision, Modeling, and Visualization 2002, Erlangen (D), Nov. 20 - 22 2002, pp. 419--426.

[14] N. Bannai, A. Agathos, and R. Fisher, Fusing multiple color images for texturing models, in 3DPVT04, 2004, pp. 558–565.

[15] M. Chuang, L. Luo, B. Brown, S. Rusinkiewicz, and M. Kazhdan, Estimating the laplace-beltrami operator by restricting 3d functions, in Proceedings of the Symposium on Geometry Processing, July 2009, pp. 1475–1484.

[16] K. Pulli, H. Abi-Rached, T. Duchamp, L. Shapiro, and W. Stuetzle, Acquisition and visualization of colored 3d objects, in Proc. of ICPR 98, 1998, pp. 11--15.

[17] F. Bernardini, I. Martin, and H. Rushmeier, High-quality texture reconstruction from multiple scans, IEEE Tr. on Visual. and Comp. Graph., vol. 7, no. 4, pp. 318–332, 2001.

[18] A. Baumberg, Blending images for texturing 3d models, in BMVC 2002. Canon Research Center Europe, 2002.

[19] V. Rankov, R. Locke, R. Edens, P. Barber, and B. Vojnovic, An algorithm for image stitching and blending, in SPIE, vol. 5701, 2005, pp. 190–199.

[20] M. Callieri, P. Cignoni, M. Corsini, and R. Scopigno, Masked photo blending: mapping dense photographic dataset on high-resolution 3d models, Computer & Graphics, vol. 32, no. 4, pp. 464–473, Aug 2008.
http://dx.doi.org/10.1016/j.cag.2008.05.004

[21] M. Eisemann, B. D. Decker, M. Magnor, P. Bekaert, E. de Aguiar, N. Ahmed, C. Theobalt, and A. Sellent, Floating textures, Computer Graphics Forum (Proc. Eurographics EG’08), vol. 27, no. 2, pp. 409–418, 4 2008.

[22] M. Dellepiane, M. Callieri, R. Marroquim, P. Cignoni, and R. Scopigno, Flow-based local optimization for image-to-geometry projection, IEEE Transaction on Visualization and Computer Graphics, vol. (in press), 2011.

[23] J. Unger, A. Wenger, T. Hawkins, A. Gardner, and P. Debevec, Capturing and rendering with incident light fields, in EGRW ’03, 2003, pp. 141–149.

[24] M. Dellepiane, M. Callieri, M. Corsini, P. Cignoni, and R. Scopigno, Improved color acquisition and mapping on 3d models via flash-based photography, ACM Journ. on Computers and Cultural heritage, vol. 2, no. 4, pp. 1–20, Feb. 2010.

[25] Microsoft ActiveX Controls, http://msdn.microsoft.com/en-us/library/aa751968(VS.85).aspx.

[26] D. Raggett, Extending WWW to support platform independent virtual reality, Technical Report, 1995. [Online]. Available: http://vrml.wired.com/concepts/ragett.html

[27] L. D. Don Brutzmann, X3D: Extensible 3D Graphics for Web Authors. Morgan Kaufmann, 2007.

[28] Khronos Group, WebGL - OpenGL ES 2.0 for the Web, http://www.khronos.org/webgl/, 2009.

[29] Khronos Group, Khronos: Open Standards for Media Authoring and Acceleration, http://http://www.khronos.org, 2009.

[30] Khronos Group, OpenGL ES - The Standard for Embedded Accelerated 3D Graphics, http://www.khronos.org/opengles/, 2009.

[31] L. Kay, SceneJS, http://www.scenejs.com, 2009.

[32] P. Brunt, GLGE: WebGL for the lazy, http://www.glge.org/, 2010.

[33] Di Benedetto, Marco and Ponchio, Federico and Ganovelli, Fabio and Scopigno, Roberto, SpiderGL: A JavaScript 3D Graphics Library for Next-Generation WWW, in Web3D 2010. 15th Conference on 3D Web Technology. Web3D Consortium, 2010. [Online]. Available: http://vcg.isti.cnr.it/Publications/2010/DPGS10

[34] B. DeLillo, WebGLU: A utility library for working with WebGL, http://webglu.sourceforge.org/, 2009.

[35] 3d scans of cuneiform tablets, More info on: http://www.cognitiones.de/doku.php/3d scans of cuneiform tablets.

[36] B. J. Brown, C. Toler-Franklin, D. Nehab, M. Burns, D. Dobkin, A. Vlachopoulos, C. Doumas, S. Rusinkiewicz, and T. Weyrich, A system for high-volume acquisition and matching of fresco fragments: Reassembling Theran wall paintings, ACM Transactions on Graphics (Proc.SIGGRAPH), vol. 27, no. 3, Aug. 2008.

[37] H. E. Rushmeier, G. Taubin, and A. Gu’eziec, Appying shape from lighting variation to bump map capture, in Proc. of the Eurographics Workshop on Rendering Techniques ’97, London, UK, 1997, pp. 35–44.

[38] V. Nozick, Pyramidal normal map integration for realtime photometric stereo, in EAM Mechatronics 2010, Japon, 2010, pp. 128–132.

[39] T. Malzbender, B. Wilburn, D. Gelb, and B. Ambrisco, Surface enhancement using real-time photometric stereo and reflectance transformation, in Eurographics Symposium on Rendering/Eurographics Workshop on Rendering Techniques, 2006, pp. 245–250.

[40] J. Lim, J. Ho, M.-H. Yang, and D. Kriegman, Passive photometric stereo from motion, in Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2, ser. ICCV ’05. Washington, DC, USA: IEEE Computer Society, 2005, pp. 1635–1642.

[41] T. Higo, Y. Matsushita, N. Joshi, and K. Ikeuchi, A hand-held photometric stereo camera for 3-d modeling. in ICCV. IEEE, 2009, pp. 1234–1241.

[42] H. Hoppe, Optimization of mesh locality for transparent vertex caching, in Proceedings of the 26th annual conference on Computer graphics and interactive techniques, ser. SIGGRAPH ’99. New York, NY, USA: ACM Press/Addison-Wesley Publishing Co., 1999, pp. 269–276. [Online]. Available:http://dx.doi.org/10.1145/311535.311565

[43] G. Lin and T. P. Y. Yu, An improved vertex caching scheme for 3d mesh rendering, IEEE Transactions on Visualization and Computer Graphics, vol. 12, pp. 640–648, July 2006. [Online]. Available: http://dl.acm.org/citation.cfm?id=1137246.1137516

[44] P. V. Sander, D. Nehab, and J. Barczak, Fast triangle reordering for vertex locality and reduced overdraw, ACM Trans. Graph., vol. 26, July 2007. [Online]. Available: http://doi.acm.org/10.1145/1276377.1276489

[45] F. Larue, M. Dellepiane, H. Hamer, and R. Scopigno, Automatic texturing without illumination artifacts from in-hand scanning data flow, in Int. Workshop on Multimedia for Cultural Heritage (MM4CH). Springer, April 2011.

[46] N. Snavely, S. M. Seitz, and R. Szeliski, Modeling the world from Internet photo collections, International Journal of Computer Vision, vol. 80, no. 2, pp.189–210, November 2008. [Online]. Available: http://phototour.cs.washington.edu/
http://dx.doi.org/10.1007/s11263-007-0107-3


Full Text: PDF


Journal of Multimedia (JMM, ISSN 1796-2048)

Copyright @ 2006-2013 by ACADEMY PUBLISHER – All rights reserved.