Open Source Sensory Substitution Device
The “Unfolding Space” project deals with sensory substitution: A phenomenon by which the function of one missing or dysfunctional sensory modality is replaced (substituted) by stimulating another one. The outcome is a prototype that projects a 3D picture, generated by a special camera, as vibration patterns on the back of the hand.
The blind can therefore use their tactile modality of the hand to actually see.
A 3D generated picture from a depth camera is haptically projected on the back of the hand by using vibration patterns. The location of a vibration depicts an object’s relative position in space, the strength of the vibration represents its distance.
The theoretical background of this project is called Sensory Substitution. A phenomenon by which the function of one missing or faulty sensory modality is replaced (substituted) by stimulating another one – in this case the tactile modality. At the beginning of the substitution process, this new stimulation has to be actively interpreted by analysing the tactile stimulus. But after some training the new visual-like Input becomes implicit and gets processed subconsciously. Users begin to see the space in front of them.
These scientific efforts started more than 50 years ago, but even today there are almost no blind people using substitution processes to handle the absence of their visual system. All attempts to develop a device for the broad market failed.
Many projects failed on a practical implementation. An analysis revealed that despite the elaborate technology used by them, design and usability issues were often not taken into place. Therefore I followed an open and iterative rapid-prototyping approach to quickly work out strengths and potentials and to identify limitations of the hardware and algorithms. Even though my theoretical work about Sensory Plasiticity had already predicted many aspects, it was this process of prototyping that lead me to a functioning device that quick.
Awards and Nominations
Winner of the "Kölner Design Preis / Toby E. Rodes Award"
In 2018 the „Kölner Design Preis“ was awarded for the 11th time. For the first time it was commended by the Neumann-Hug SA – the preserver of the Toby E. Rodes estate. The awards go to final papers of the cologne design schools and are very much desired under the gradates.
Only in German – Sorry
„Mit ‚Unfolding Space‘ zeichnet die Jury ein Projekt aus, das hinsichtlich Idee, Entwurf und Umsetzung vorbildlich und bestechend ist. Jakob Kilian präsentiert mit dem Handschuh nicht nur einen voll funktionsfähigen Prototypen, sondern zeigt auch auf, wie die Kosten für ein solches Produkt zukünftig um ein Vielfaches reduziert werden können“
"Special Recognition" at the Lucky Strike Junior Designer Award 2018
“With the Lucky Strike Junior Designer Award the Raymond Loewy Foundation is fostering the new generation of designers in Germany since 1992. With this award that comes with 10,000 Euros, the Foundation significantly contributes to design training. The Foundation’s continuous efforts contribute to raising the performance and quality levels at German design universities, support transparency of design training and develop guidelines for university design courses that bring results. Business and industry alike consider receiving an award as part of the Lucky Strike Junior Designer Award a ticket to the design profession. The award provides the new generation of designers a public forum to build networks in the design industry. This ensures the recognition of the broad as well as the industry-specific public.
The award cerenomy took place at saturday, the 24th of November 2018 at “stilwerk”, Hamburg. Together with 20 other young Designers I received a “special recognition” for the project. More information on the Lucky Strike Awards website.
- (german) 26.10.18 – Deutschlandfunk: Kölner Design Preis | Auszeichung für „sehenden“ Handschuh
- (german) 26.10.18 – Informationsdienst Wissenschaft: Kölner Design Preis 2018: Erster und dritter Platz für KISD-Absolventen
- (german) 25.10.18 – MeineSüdstadt: Kölner Design Preis geht in die Südstadt
- (german) 26.10.18 – WDR Kultur: Kölner Designpreis für Sehhilfe
- (german) 05.11.18 – barrierefrei bauen:Kölner Designpreis geht an “Unfolding Space”
- (german) 17.11.18 – Koelncampus: Ein Handschuh für mehr Inklusion
- (german) 01.12.18 – handicap.life: Mit den Händen sehen – das Projekt Unfolding Space
The whole project is published under CC-BY license (attribution) in order to inspire other designers, developers or commercial providers to work within this field and to make Sensory Substitution available to as many people as possible. In this section you will find an overview over the materials. Feel free to contact me, if you need anything else or if you have any questions regarding my work!