Multigesture.net

Techsparked

Seth Sandler a good friend of mine, released his new website techsparked.com which is a website that he describes as “a social platform for people that are sparked (inspired) by creative and emergent technology”.

Personally I like the way how he organized the site. Basically he created a portal that allows you to rapidly find (multitouch) applications, open source programming frameworks, and community projects that are out there, all in one single place!

Check it out and don’t forget to add your own projects as well!

Interactive Tabletops and Surfaces 2010

If you’re doing research on interactive tabletops and surfaces, you might want to check out this years ITS 2010 conference. This year it will be hosted in Saarbrücken, Germany!

Check out the details below (more information after the break).

CALL FOR PARTICIPATION

5th Annual ACM Conference on Interactive Tabletops and Surfaces 2010

ITS 2010
November 7-10, 2010
Saarbrücken, Germany

http://www.its2010.org
————————————————————————-

The Interactive Tabletops and Surfaces 2010 Conference (ITS) is a
premiere venue for presenting research in the design and use of new
and emerging tabletop and interactive surface technologies. As a new
community, we embrace the growth of the discipline in a wide variety
of areas, including innovations in ITS hardware, software, design, and
projects expanding our understanding of design considerations of ITS
technologies and of their applications.

Building on their success in previous years, ITS again features Papers
and Notes presentations, as well as tutorials, posters, and
demonstrations tracks. For the first time, ITS 2010 will also include
a doctoral symposium.

ITS 2010 will bring together top researchers and practitioners who are
interested in both the technical and human aspects of ITS technology.
On behalf of the conference organizing committee, we invite you to
begin planning your submissions and participation for this year’s
conference!

CALL FOR PARTICIPATION: PAPERS AND NOTES

The use of interactive surfaces is an exciting and emerging research
area. Display technologies, such as projectors, LCD and OLED flat
panels, and even flexible display substrates, coupled with input
sensors capable of enabling direct interaction, make it reasonable to
envision a not-so-distant future in which many of the common surfaces
in our environment will function as digital interactive displays. ITS
brings together researchers and practitioners from a variety of
backgrounds and interests, such as camera and projector based systems,
new display technologies, multi-touch sensing, user interface
technologies, augmented reality, computer vision, multimodal
interaction, novel input and sensing technologies, computer supported
cooperative work (CSCW), and information visualization.

The intimate size of this single-track symposium provides an ideal
venue for leading researchers and practitioners to exchange research
results and experiences. We encourage submissions on (but not limited
to) the following topic areas as they relate to interactive tabletops
and surfaces:

* Applications
* Gesture-based interfaces
* Multi-modal interfaces
* Tangible interfaces
* Novel interaction techniques
* Data handling/exchange on large interactive surfaces
* Data presentation on large interactive surfaces
* User-interface technology
* Computer supported collaborative systems
* Middleware and network support
* Augmented reality
* Social protocols
* Information visualizations
* Interactive surface hardware, including sensing and input
technologies with novel capabilities
* Human-centered design & methodologies

Read the rest of this entry »

The NEMO Science Center in Amsterdam is the largest science center in the Netherlands and is also the place where my previous thesis work is displayed to the general public. My work now forms a permanent exhibition located at “Bits & Co“.

I haven’t visited the NEMO for a while (since I’m still in the USA) but my dad visited the science center last month and took these nice pictures:

Thanks dad!

A few weeks ago I attended TEI’10 hosted at the MIT Medialab.

“TEI, the conference on tangible, embedded, and embodied interaction, is about HCI, design, interactive art, user experience, tools and technologies, with a strong focus on how computing can bridge atoms and bits into cohesive interactive systems.”

To keep it simple, I decided to just posted a lot of media instead of a summary of the TEI ’10 conference… enjoy !

Inspiring projects

Unlike most conferences I have been, this conference was not only a place where scientific work was presented but also where artists could show their work (art meets science).

The following two projects are clearly an example for this:

• SMSlingshot (link contains cool video!) by Patrick Tobias Fischer, Christian Zöllner and Thilo Hoffmann.
• Electronic Popables: exploring paper-based computing through an interactive pop-up book by Jie Qi and Leah Buechley.

Some of my pictures shot at the conference

12345►

More pictures of the conference

Pictures created by Jean Baptiste Paris on Flickr.

Studio sessions

Pictures created by Seth Hunter of the studio session on surface computing
(I should be in there somewhere…).

Video studio sessions

Nice video compilation of the different studio sessions that took place at the MIT Medialab.

Blog

A blog about the TEI 2010 conference

Keynotes

• John Frazer
• Vik Muniz

Rather than creating another blog, I recently added a ‘blog’ category (kinda weird since this is already a blog huh). This category will focus on some of my personal projects that aren’t related to multi-touch software or hardware.

This years Tabletop 2010 conference took place in Banff, Canada.

Unfortunately I could not attend the conference on interactive tabletop and surfaces, so I missed the great keynotes from: Ken Perlin, Chia Shen and Bill Buxton.
Fortunately a few fellow researchers and friends blogged about the event.

PyMT

PyMT is a python module designed for developing multi-touch enabled applications. The current aim is to provide an environment which allows developers to do quick and easy interaction design, and rapid prototype development.

The projects was initially started by Thomas Hansen but now also contains contributes from: Juan Pablo Hourcade, Sharath Patali, Matiue Virbel, Thiago Serra. Their submitted paper is available in the proceedings from this years conference.

For those who are interested, a nice set of videos demonstrating the toolkits capabilities can be found on Vimeo.

Since it’s open source, everyone can download and contribute to the project. The website can be found here: http://code.google.com/p/pymt/. A nice example of an application created with PyMT by Sharath Patali can be found here: NUIPaint.

TUIO

As one of the designers of the TUIO protocol and the ReacTable, Martin Kaltenbrunner presented his work “reacTIVision and TUIO: A Tangible Tabletop Toolkit” at the conference. For those who are interested, Martin created a nice summary of the conference on his personal blog which can be found here: http://modin.yuri.at/blog/?p=117

More interesting links…

More information about the conference can be found in the topic at the NUI Group forums started by Johannes Schöning (contains some videos and docs), the official youtube channel and on Twitter.

ITS 2010?

Hope to see you next year in Saarbrücken, Germany!

Saying goodbye

Lots happened the past year, the most notable projects I have worked on as a scientific programmer were “Interactive Networks” (a collaboration with the SNE department) and “Twilight” (a graph visualization and exploration tool for multi-touch devices). I am still busy creating some short videos from the HD footage we shot, so expect them in the near future.

I am very glad that I was offered the opportunity to participate in both projects. Therefore I would like the following people who made it possible for me to work for the University of Amsterdam (UvA):

• Dr. Robert Belleman (SCS)
• Prof. Peter Sloot (SCS)
• Dr. Cees de Laat (SNE)

I would also like to thank:

• Paul Melis for his help with constructing the multi-touch table, software support and the pleasant time at the SVVR Lab.
• Dr. Elena Zudilova-Seinstra for her help and advice while I was writing my masters thesis.
• Dr. Jaap Kaandorp and Dr. Alban Ponse for giving me the opportunity to study at the UvA.
• Rudolf Strijkers for the fun time we had in Amsterdam and in Austin/Houston during SC08. And also for the stressful period while writing the paper for ICCS.

Finally I would like to thank Dr. Dick van Albada, Edwin Steffens, Erik Hitipeuw, Alexis Salin, my fellow students at the UvA and everyone I forgot.

A new challenge

After a very brief meeting in Amsterdam during the IEEE Tabletop 2008, I got in touch again with Dr. Chia Shen during the IDC 2009. Shen is a Senior Scientist and Program Manager at the Initiative in Innovative Computing (IIC) at Harvard University. She is well known for her work as Senior Research Scientist at MERL (the Mitsubishi Electric Research Labs).

During the breaks at IDC 2009, we had a talk about the work I was doing at the UvA and my involvement in the NUI Group. After showing some work I have been doing on network visualization (Twilight) for multi-touch devices it seemed that there were some similarities between the work I was doing at the UvA and the research that was going on at Harvard University. While discussing some of the ongoing projects, I was asked whether I was interested to join the SDR Lab as a research fellow. After some consideration, I proudly accepted her job offer.

The next months I will be working on several interesting projects. One of the tasks will be continuing the development of INVOLV, a multi-touch application developed by Michael Horn and Chia Shen in collaboration with the Encyclopedia of Life (EoL), the Tree of life (ToL) and many biology professors and scientists since May 2008. The application visualizes the data of the EoL and the ToL in a unique way using a Voronoi diagram and is used for learning and discovery.

A video of Michael Horn explaining the INVOLV project can be found below:

Living in the USA

It has only been a week since my arrival in the USA, but so far it has been a pleasant experience.

I have not made a lot of photos yet, but this one was made nearby the place where I am staying (safety first?):

More photos will be posted on Flickr @ flickr.com/photos/multigesture/

NUI Book

To help out fellow multi-touch users and developers, the NUI Group community decided to create a book sharing information about multi-touch technologies. Originally we intended to release this book during the IDC2009, unfortunately we were only able to finish a concept version. This concept version was available at the NUI Group booth.

NUI Group press release:

“We are proud to announce the release of the first edition of the NUI Group Community Book – “Multi-Touch Technologies”. This book comprises state of the art articles from our Community Wiki, as well as several chapters written by leading experts in the field specifically for this publication. Detailing basic hardware technologies as well as the process of developing software suited for multi-touch systems, this book provides a technical introduction to the world of multi-touch.

This book aims to provide an introduction to the multi-touch world for all backgrounds of people, and also include sufficient information to serve as a general “handbook” for those acquainted with the field, including code examples, suppliers, and building methodology.

Multi-Touch Technologies is a unique publication in its domain in that it is released at no charge under the Creative Commons 3.0 Attribution Share-Alike license – all content found in this book is free to be re-distributed and modified under a similar license, with attribution.”

View the full press release.
Download your copy here: First_Edition_Community_Release.pdf

Comments and suggestions can be posted in the feedback topic @ NUI Group forums.

* update 15 July *
Mirror of the NUI Book:
English version
Chinese version (special thanks to Kelvin / mt2a for translating the book, feedback can be posted here).

Google Summer of Code 2009

Like last year, the NUI Group will be coaching students to work on open source multi-touch projects. This year, I will be helping out by mentoring a student who will add hand tracking to Community Core Vision (formally known as tBeta).

Project: Recognition, Tracking and Association of Hands, Fingers, and Blobs: A Community Core Upgrade
Student: Thiago de Freitas Oliveira Araújo
Mentor: Laurence Muller

Follow his progress on his blog and his code on nuicode or google code.

Hand/Fingers occlusion testcase

Matching a hand model (using Active Appearance Models)

More videos can be found here.

Watch it in HD on Youtube or Vimeo!

Changelog for v3:

• Fixed compatibility issue with Adobe AIR 1.5 (Fullscreen bug)
• This version should autodetect your screensize to support any screen resolution.
• Added a Google Maps object
• Added support for adding pictures on the fly (for example if you want send a picture from your cellphone with bluetooth, read the readme.txt for the instructions)
• Added a exit-button, reset view-button, canvaslock and displaylock buttons.
• Temporary removed DCIM support due to slowdowns

Want to try it out yourself?
Download it now: Multitouch Media Application Pro v3 (7407) - 2.25 MB

Please read the install instructions in readme.txt (and download the latest Adobe AIR 1.5.x).

note: If you want to try out the bluetooth feature, I recommend installing BlueSoleil to handle the pairing of the devices and file transfers.

It has been a while since my last blog post, so I will try to catch up a bit.

Earlier this year, Chris Moore invited me to join the Interactive Displays Conference 2009 (IDC) in San Jose, CA, USA. The IDC is an event for hardware manufacturers, developers, researchers and end user of interactive display technologies. The event was organized by pira-international and supported with great keynote speakers: Jeff Han from Perceptive Pixels and Andy Wilson & Steven Bathiche from Microsoft Research.

The NUI Group was also present with a booth to demonstrate some of the current activities from the community. Key members (Seth Sandler, Chris Moore, Alex Popovich, Jimmy Hertz and Thomas Hansen (Author of PyMT) ) from the NUI Group community and NUI INC. where present to demonstrate their hardware and software achievements.

Jimmy Hertz presented his amazing and huge H2O AquaTouch Water Screen at the booth. Alex Popovich demonstrated his multi-camera solution based on custom drivers created for the PS3.

Jimmy setting up his touch screen

The NUI Group booth (with free NUI Group T-shirts!)

Alex’s multicamera solution with 3 PS3 cameras

A nice summary of the conference can found on the NUI Group blog. More photos can be found on the Flickr streams from Joan Woodbrey and Thomas Hansen

Seth, Justin and me heading to the car.

Photograph credits: Thomas Hansen

I would like to thank Chris and the other present NUI Group members for this amazing event, I really enjoyed my stay in San Jose and San Francisco.

November last year we presented the Interactive Networks concept at Supercomputing 2008. Recently I got hold of more photo and video content.

Photos and videos

In my previous post on Interactive Networks, I gave a brief explanation of the concept. My colleague Rudolf Strijkers (Project lead) created a page with pictures and videos from the demo we presented. This page also includes a video of Rudolf explaining the Interactive Network concept to Gordon Cook. Only the video with Gordon Cook is in English, but I guess that most of the videos are self explanatory. The videos and photos be found here: Supercomputing 2008 media

COOK Report

After Gordon Cook was given a brief introduction to the Interactive Networks concept, he invited Rudolf Strijkers and Cees de laat for a more in-depth interview. The article (abstract) can be found here: ICT and E-Science as an Innovation Platform in The Netherlands “A National Research and Innovation NetworkWhat Can the US Learn from Dutch Experience?”

Posters

More posters from our booth can be found here: clickme!

Pictures of multitouch systems presented at SC 2008

RENCI Vis Group Multi-Touch

The guys from Renaissance Computing Institute were kind enough to show us their table. We could even take a peek under the black curtain that contained all the *magic*.

More photo and video content can be found on their blog.

EVL | Multi-Touch LCD Table Prototype

EVL showing a rain simulator on their LCD based multitouch table.

Checkout the video of the table here. More pictures of the setup can be found here.

Enthought

A stable, portable and responsive multitouch system using a python backend.

“Me painting like a pro, looks better than Picasso … right?”

MS Surface

This doesn’t really needs an explanation…

“Dear Santa, please send me a MS coffee table this year.”

Read the rest of this entry »