Creating Realistic Human Avatars for Social Virtual Environments Using Photographic Inputs

Authors

  • Raymond Leonardo Chandra RWTH Aachen University, Germany
  • Koen Castermans RWTH Aachen University, Germany
  • Djamel Berkaoui RWTH Aachen University, Germany
  • Patrick Querl RWTH Aachen University, Germany
  • Nacken Heribert RWTH Aachen University, Germany
Pages Icon

DOI:

https://doi.org/10.51519/journalisi.v6i3.842

Keywords:

virtual reality, Education, Open-Source Software, Photogrammetry, Avatar

Abstract

This paper presents the development and evaluation of realistic virtual reality avatars created with a Blender add-on called Facebuilder. In this process, a person's head is photographed from different angles. These photographs are used in subsequent steps to generate a realistic avatar face. To investigate the user experience of interacting with these avatars, a study was conducted in VR using the MyScore application. The study involved 22 participants who met in a virtual environment to discuss a topic of their choice. Statistical analyses including descriptive statistics, Wilcoxon Signed-Rank Test, and Friedman Test showed significant differences supporting all three hypotheses: users preferred communicating with realistic avatars, were more focused and engaged when interacting with them. The results indicate a significant preference for realistic avatars in educational use cases, primarily due to the perceived seriousness of the interactions and the resulting higher level of participant engagement. The suitability of realistic versus non-realistic avatars was found to be use-case dependent. Participants suggested that realistic avatars would be more appropriate for educational scenarios and non-realistic avatars for entertainment.

Downloads

Download data is not yet available.

References

D. Hamilton, J. McKechnie, E. Edgerton, and C. Wilson, “Immersive virtual reality as a pedagogical tool in education: a systematic literature review of quantitative learning outcomes and experimental design,” J. Comput. Educ., vol. 8, no. 1, pp. 1–32, Mar. 2021, doi: 10.1007/s40692-020-00169-2.

D. Jo et al., “The impact of avatar-owner visual similarity on body ownership in immersive virtual reality,” in Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, Gothenburg Sweden: ACM, Nov. 2017, pp. 1–2. doi: 10.1145/3139131.3141214.

E. Molina, A. R. Jerez, and N. P. Gomez, “Avatars rendering and its effect on perceived realism in Virtual Reality,” in 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), Utrecht, Netherlands: IEEE, Dec. 2020, pp. 222–225. doi: 10.1109/AIVR50618.2020.00046.

M. C. Fysh, I. V. Trifonova, J. Allen, C. McCall, A. M. Burton, and M. Bindemann, “Avatars with faces of real people: A construction method for scientific experiments in virtual reality,” Behav. Res. Methods, vol. 54, no. 3, pp. 1461–1475, Jun. 2022, doi: 10.3758/s13428-021-01676-5.

D. Hepperle, C. F. Purps, J. Deuchler, and M. Wölfel, “Aspects of visual avatar appearance: self-representation, display type, and uncanny valley,” Vis. Comput., vol. 38, no. 4, pp. 1227–1244, Apr. 2022, doi: 10.1007/s00371-021-02151-0.

M. E. Latoschik, D. Roth, D. Gall, J. Achenbach, T. Waltemate, and M. Botsch, “The effect of avatar realism in immersive social virtual realities,” in Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, Gothenburg Sweden: ACM, Nov. 2017, pp. 1–10. doi: 10.1145/3139131.3139156.

Z. Li et al., “3D Human Avatar Digitization from a Single Image,” in Proceedings of the 17th International Conference on Virtual-Reality Continuum and its Applications in Industry, Brisbane QLD Australia: ACM, Nov. 2019, pp. 1–8. doi: 10.1145/3359997.3365707.

A. Mao, H. Zhang, Y. Liu, Y. Zheng, G. Li, and G. Han, “Easy and Fast Reconstruction of a 3D Avatar with an RGB-D Sensor,” Sensors, vol. 17, no. 5, p. 1113, May 2017, doi: 10.3390/s17051113.

F. Bogo, M. J. Black, M. Loper, and J. Romero, “Detailed Full-Body Reconstructions of Moving People from Monocular RGB-D Sequences,” in 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile: IEEE, Dec. 2015, pp. 2300–2308. doi: 10.1109/ICCV.2015.265.

C. Pirch, O. Kausch, A. Klepser, and S. Morlock, “One Avatar, Two Level of Detail, One Result? - Analyzing the Effect of Low and High Detailed Avatars on Fitting Simulations,” in Proceedings of 3DBODY.TECH 2021 - 12th International Conference and Exhibition on 3D Body Scanning and Processing Technologies, Lugano, Switzerland, 19-20 October 2021, Lugano, Switzerland: Hometrica Consulting - Dr. Nicola D’Apuzzo, Oct. 2021. doi: 10.15221/21.46.

A. Bönsch, A. Feng, P. Patel, and A. Shapiro, “Volumetric Video Capture using Unsynchronized, Low-cost Cameras:,” in Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Prague, Czech Republic: SCITEPRESS - Science and Technology Publications, 2019, pp. 255–261. doi: 10.5220/0007373202550261.

n. d KeenTools, “FaceBuilder for Blender.” Accessed: Jan. 01, 2024. [Online]. Available: https://keentools.io/products/facebuilder-for-blender

T. Boe and C. Carter, “Human Photogrammetry: Foundational Techniques for Creative Practitioners,” Int. J. Comput. Graph. Animat., vol. 10, no. 1, pp. 1–20, Jan. 2020, doi: 10.5121/ijcga.2020.10101.

O. C. Quispe-Enriquez, J. J. Valero-Lanzuela, and J. L. Lerma, “Craniofacial 3D Morphometric Analysis with Smartphone-Based Photogrammetry,” Sensors, vol. 24, no. 1, p. 230, Dec. 2023, doi: 10.3390/s24010230.

S. Nebel, M. Beege, S. Schneider, and G. D. Rey, “A Review of Photogrammetry and Photorealistic 3D Models in Education from a Psychological Perspective,” Front. Educ., vol. 5, p. 144, Aug. 2020, doi: 10.3389/feduc.2020.00144.

T. Roosendaal, The Essential Blender: Guide to 3D Creation with the Open-Source Suite Blender, Blender Foundation, 2007.

D. Berkaoui, R. Chandra, and K. Castermans, “MyScore – Avatar-Based Teaching and Learning,” 2022, doi: 10.18420/VRAR2022_7790.

K. L. Nowak, J. Fox, and The Ohio State University, “Avatars and computer-mediated communication: A review of the definitions, uses, and effects of digital representations on communication,” Rev. Commun. Res., vol. 6, pp. 30–53, 2018, doi: 10.12840/issn.2255-4165.2018.06.01.015.

C. M. Grewe, T. Liu, C. Kahl, A. Hildebrandt, and S. Zachow, “Statistical Learning of Facial Expressions Improves Realism of Animated Avatar Faces,” Front. Virtual Real., vol. 2, p. 619811, Apr. 2021, doi: 10.3389/frvir.2021.619811.

R. H. Riffenburgh, “Tests on Ranked Data,” in Statistics in Medicine, Elsevier, 2012, pp. 221–248. doi: 10.1016/B978-0-12-384864-2.00011-1.

Jing Tong, Jin Zhou, Ligang Liu, Zhigeng Pan, and Hao Yan, “Scanning 3D Full Human Bodies Using Kinects,” IEEE Trans. Vis. Comput. Graph., vol. 18, no. 4, pp. 643–650, Apr. 2012, doi: 10.1109/TVCG.2012.56.

Downloads

Published

2024-09-30

Issue

Vol. 6 No. 3 (2024): September

Section

Articles

License

Authors Declaration

  1. The Authors certify that they have read, understood, and agreed to the Journal of Information Systems and Informatics (JournalISI) submission guidelines, policies, and submission declaration. The submission has been prepared using the provided template.
  2. The Authors certify that all authors have approved the publication of this manuscript and that there is no conflict of interest.
  3. The Authors confirm that the manuscript is their original work, has not received prior publication, is not under consideration for publication elsewhere, and has not been previously published.
  4. The Authors confirm that all authors listed on the title page have contributed significantly to the work, have read the manuscript, attest to the validity and legitimacy of the data and its interpretation, and agree to its submission.
  5. The Authors confirm that the manuscript is not copied from or plagiarized from any other published work.
  6. The Authors declare that the manuscript will not be submitted for publication in any other journal or magazine until a decision is made by the journal editors.
  7. If the manuscript is finally accepted for publication, the Authors confirm that they will either proceed with publication immediately or withdraw the manuscript in accordance with the journal’s withdrawal policies.
  8. The Authors agree that, upon publication of the manuscript in this journal, they transfer copyright or assign exclusive rights to the publisher, including commercial rights

How to Cite

[1]
R. L. Chandra, K. Castermans, D. Berkaoui, P. Querl, and N. Heribert, “Creating Realistic Human Avatars for Social Virtual Environments Using Photographic Inputs”, journalisi, vol. 6, no. 3, pp. 2110–2129, Sep. 2024, doi: 10.51519/journalisi.v6i3.842.