R&D Projects I’ve been involved with
Below you can find a list of R&D project I have been involved with over the years in varying capacities, ranging from academic research and management to product design, development and implementation.
Artanim R&D Projects
- Real Virtuality
- Real Virtuality is a project which combines modern VR headsets with the full-body freedom provided by a high-quality motion capture system. Having multiple users share the same space in real time allows for large scale collaborative virtual environments. Real Virtuality has been featured in such publications as Wired UK, Engadget and Tested (Youtube Link), and was one of 3 selected finalists of the Immersive Realities contest at ACM SIGGRAPH 2015.
- Taylormatic is a real-time platform for the virtual configuration of fashion and designer products. Based on a database of configurable products and configuration options, clients can design products to their own liking, while obtaining a realistic preview before purchase. Based on Unity3D, Taylormatic can be deployed on a wide variety of platforms, ranging from in-store shopping solutions to web-based e-commerce and mobile apps. Development activities concerned both the front and backend of the platform, as well as a variety of asset management and creation tools.
- Real-time simulation of muscle elongation
- In order to evaluate the muscle elongation in the shoulders of patients, I implemented a position-based dynamics simulator of muscle action lines, including the collision handling against bone meshes driven by motion capture data. While non-physical, given that the only value of interest is length/elongation, a postion-based dynamics approach allowed for a much faster evaluation of the data of interest in comparison to simulation methods usually employed. Results of this work have been published in 2 papers which can be found on the publications page.
- Téo et Léonie
- As part of the “Téo et Léonie” book series, an accompanying animated audio book was made in Unity3D. The narrated page include an animated view of the 2D designs in the book, as well as various (interactive) augmented reality scenes using Vuforia. The app is available in French-speaking countries for Android and iOS.
- Motion Controlled Interactive Display
- The MCID is an interactive display which allows user to browse through a collection of multimedia content using a gesture-based interface. Audio-visual content can be selected and played on demand. The MCID was installed at the 2015 Montreux Jazz Festival to provide an interactive Jukebox of past performances.
- Faites comme chez nous
- The FCCN exhibit at the Natural History Museum (MHN) in Geneva educates visitors about dinosaurs of the Kem Kem region in Morocco with the aid of displays and touch-screen based quizzes. For this exhibit we developed a series of games, child-friendly web-stations and back-end integration from ticket printing to score keeping. The exhibit is open until the end of June 2017 and can be visited for free.
MIRALab Research Projects
While being a research assistant at MIRALab, I (among others) primarily worked the following EU funded projects:
- 3D Life
- I was one of the 3 MIRALab members of the Network Steering Board. The board consists of senior members of the network from the seven core partners, discussing issues like financial planning, integration planning and updated joint project activities. As a researcher I’m actively involved in Activity 4.3: “Virtual Humans, Rendering and Animation”.
- For the duration of the project I have been responsible for the development of the Virtual Try On as a web service. The Virtual Try On is an application that lets you try on and customize (for style and fit) 3D physically simulated garments on a 3D representation of your own body. Within SERVIVE, MIRALab – University of Geneva provided this application as a web service, for which a web-application has been developed by Digital Humans.
- As part of Leapfrog I have been responsible for the software integration of all components that made up the Virtual Try On. The Virtual TryOn is a web-enabled interactive 3D platform which enables consumers to virtually evaluate physically simulated 3D garments on a 3D digital representation of their own body.
- Epoch Characterise
- As part of the Epoch Characterise project I have been involved in releasing vhdPLUS as Open Source. The vhdPLUS Development Framework is a modern, fully component oriented simulation engine and software middleware solution created by and reflecting many years of the R&D experience of both the MIRALab, University of Geneva and VRlab, EPFL labs in the domain of VR/AR and virtual character simulation.
As part of my studies in Computer Science at the University of Twente, besides regular coursework, I have been involved in several interesting projects. From time to time biting of more than we could chew and spending more time on them then what could be considered healthy, we at least had great fun and got some nice results:
- A Rigid Body Dynamics simulator, developed together with Ebor Folkertsma. It was a nice project and it taught us a lot. You can still download some very old demos here.
- 3DWebcam was a project in which Ingo Wassink and I created a stereo vision application using two webcams in Java from scratch. Yeah, we liked a challenge and devoured the great Hartley and Zisserman book.
- Noffel is the name of our dear robot. We built a robot, using Lego and their RCX controller (for which we wrote our own control software) + servos, that could raise and lower the eyebrows, blink and move its mouth. This all combined with an emotional model as well as speech generation and recognition. A photo made it onto the promotional brochures of HMI.
- During my Imaging minor we developed traffic light tracking software for the blind, which determined whether or not pedestrian traffic lights were red or green. All this based on Fourrier Descriptors and preprocessing filters written in Matlab, which at the time was still horrendously slow for anything involving loops. Yes, I’m that old.