Video: G. Papagiannakis, Gamification, Presence and Interaction in Mixed Reality using Geometric Algebra …, Kogakuin Univ., Tokyo, 06 Nov. 2015

Title: Gamification, Presence and Interaction in Mixed Reality using Geometric Algebra and open frameworks for interactive, procedurally animated and physically-based rendered virtual characters

Speaker: Dr. George Papagiannakis (short CV below)
Date & Time: Friday, 06 November 2015, 13:15 – 14:15
Venue: Room A-473, 4th floor of Shinjuku Campus of Kogakuin University

Abstract: With the recent advent of low-cost, novel Augmented Reality (AR) h/w glasses and Head Mounted Displays, complete methodologies for robust authoring of rich AR scenes with interactive, procedural virtual characters powered from a versatile character animation framework using only mobile devices is nowadays more relevant than ever. We present an overview of previous and latest techniques to author, fully augment with life-size, animated, geometrically accurately registered virtual characters into any open space in less than 1 minute with only modern smartphones or tablets. Then we present technologies to automatically revive this augmentation for subsequent activations from the same spot, in under a few seconds. We handle efficiently scene authoring rotations of the AR objects using Geometric Algebra rotors in order to extract higher quality visual results. Moreover, we illustrate how to employ a mobile version of the global illumination for real-time Precomputed Radiance Transfer algorithm for diffuse shadowed characters in real-time, using High Dynamic Range (HDR) environment maps integrated in open-source frameworks. Effective character interaction plays a fundamental role in attaining high level of believability and thus we illustrate examples on how to enable such novel AR applications with enhanced attractive virtual characters with lip-sync, body and facial animation as well as high-level control for enhanced gestures based on open methodologies.

A Brief Speaker CV: George Papagiannakis is a computer scientist specialized in computer graphics and virtual-augmented reality. He obtained his PhD in Computer Science at the University of Geneva in Switzerland in 2006, his M.Sc. (Hons) in Advanced Computing at the University of Bristol in UK and his B.Eng. (Hons) in Computer Systems Engineering, at the University of Manchester, UK. Since 2011 he is assistant professor at the Computer Science department of the University of Crete, Greece and Affiliated Research Fellow at the Computer Vision and Robotics Laboratory in the Institute of Computer Science of the Foundation for Research and Technology Hellas, Heraklion, Greece.

Prior to this post, he had worked as a senior researcher and research assistant at MIRALab, University of Geneva. He has also been employed as consultant and lead graphics programmer in the industrial sector. His research and development interests are confined in the areas of mixed reality presence, illumination models and real-time rendering, virtual heritage, GPU programming, Geometric Algebra and real-time frameworks-engines for integrated VR/AR character simulation. He has actively been involved in the specification, contribution and co-management of several European funded research projects in these areas. Currently he is working on high-fidelity presence, rendering, interaction and gamification with virtual characters in mixed reality and related research fields. He has more than 45 publications in these topics and he is a member of IEEE, Eurographics, ACM and SIGGRAPH professional societies. In 2011 he was awarded a Marie-Curie Intra-European Fellowship for Career Development from the European Commission’s Research Executive Agency.

Source: Email from G. Papagiannakis ( 07 Sep. 2015, Email from K. Tachibana ( 07 Sep. 2015,


Leave a comment

Filed under lectures

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s