Friday, April 27, 2007

Graphical User Interfaces – Moving to Gesture Recognition

As the user base shifts away from the PC to handheld devices and embedded devices, so the user interface will shift with it. The expert user is no longer the primary user of computational technologies. As non-experts come into the picture, the user interface must accommodate them -- witness the rise of the graphical user interface in the 1980s when computers came into mainstream use in the form of the personal computer.

I’ve maintained for a long time now, that the video game industry is the one to watch. As Edison said, good engineers develop, but great engineers steal. We should be stealing from the video game industry. With their high resolution graphics and use of 3D techniques, it appears to be the place to shop for new technology. But there are other technologies to consider, such as gesture recognition.

Gesture recognition is not new. In fact it goes back to 1964 when ARPA funded the RAND tablet. If you can remember the RAND corporation you’re really dating yourself. Since it’s been around for so long why hasn’t it penetrated further into usage? Like most emerging technologies, it’s not the technology itself that defines its success but rather how well it works with other technologies and how many other technologies it requires to run well.

One application of gesture recognition is demonstrated in a paper from MIT which used the kitchen as the wall space and then overlayed digital information on it for the user to manipulate. They used multiple projectors and actually moved the projection in case the object they projected on moved, such as a table. Also, the image changed based on the task the user was performing. Applications include showing the contents of the refrigerator on the outside of the door noting the items that need to be purchased. A display on the dishwasher shows the state of the contents – dirty or clean. An application called Heatsink measures the temperature of water coming from the tap and then projects a color on the water stream to indicate that to the user.

In the case study from MIT in which they instrumented a kitchen, it’s clear that a whole range of supporting technologies is required to make gesture recognition work including image processing, temperature sensing, proximity sensing, object tracking, and more.

While MIT may be instrumenting kitchens to test out the technology, others are actively installing gesture recognition systems in your local mall. The one in the mall nearest my home is called Reactrix which consists of a ceiling mounted projector that displays vendor brands on the floor of the mall along with games. Kids are enticed to participate with the various games and questionnaires. The projector “reads” the movements of the kid on the projected image and provides a reaction to it. For example, a soccer field is displayed with a ball in the middle. As the kid tries to kick the image of the ball, the Reactrix sends the ball floating across the screen, thus encouraging the kid to pursue the ball. To see this in action for yourself you can click on the Reactrix web site and see a map of the USA with over 160 locations.

As with all emerging technologies there are bugs to work out of the system. For gesture-recognition it comes down to interpreting the gestures the user makes. In this article, a number of companies use heuristics and other algorithms to interpret a user’s movements.

Wouldn’t it be cool to take a LabVIEW front panel and project it on the wall but then enable the user to physically turn the knob or toggle the switch or even tap twice on a VI and have its front panel open up?

Best regards,
Hall T.

5 Comments:

Anonymous Anonymous said...

buy some pills

[url=http://buy.dreamandgrow.com/high-psa-after-ebrt-casodex-eulexin.html]high psa after ebrt casodex eulexin[/url]
[url=http://buy.dreamandgrow.com/discount-price-on-viagra.html]discount price on viagra[/url]
[url=http://buy.dreamandgrow.com/buy-generic-lipitor.html]buy generic lipitor[/url]
[url=http://buy.dreamandgrow.com/viagra-patient.html]viagra patient[/url]
[url=http://buy.dreamandgrow.com/injectable-viagra.html]injectable viagra[/url]
[url=http://buy.dreamandgrow.com/lipitor-problem.html]lipitor problem[/url]
[url=http://buy.dreamandgrow.com/generic-name-for-lipitor.html]generic name for lipitor[/url]
[url=http://buy.dreamandgrow.com/viagra-onlin.html]viagra onlin[/url]
[url=http://buy.dreamandgrow.com/cialis-attorney-ohio.html]cialis attorney ohio[/url]
[url=http://buy.dreamandgrow.com/viagra-tylenol-test.html]viagra tylenol test[/url]
[url=http://buy.dreamandgrow.com/cialis-pdr.html]cialis pdr[/url]
[url=http://buy.dreamandgrow.com/kamagra-potenzmittel.html]kamagra potenzmittel[/url]
[url=http://buy.dreamandgrow.com/avodart-hcl.html]avodart hcl[/url]

Thursday, December 10, 2009 6:10:00 PM  
Anonymous Anonymous said...

ninest123 10.14
burberry handbags, ray ban sunglasses, michael kors outlet online, replica watches, michael kors outlet, louis vuitton, uggs outlet, longchamp outlet, longchamp outlet, polo ralph lauren outlet online, michael kors outlet, uggs on sale, michael kors outlet online, oakley sunglasses wholesale, christian louboutin outlet, longchamp outlet, ugg boots, gucci handbags, uggs outlet, christian louboutin shoes, tory burch outlet, michael kors outlet online, prada handbags, tiffany and co, replica watches, louis vuitton outlet, burberry outlet, ray ban sunglasses, chanel handbags, louis vuitton outlet, louis vuitton outlet, nike air max, nike air max, oakley sunglasses, ugg boots, nike outlet, jordan shoes, oakley sunglasses, prada outlet, cheap oakley sunglasses, louis vuitton, christian louboutin, tiffany jewelry, oakley sunglasses, christian louboutin uk, michael kors outlet store, ray ban sunglasses, polo outlet

Tuesday, October 13, 2015 8:42:00 PM  
Anonymous Anonymous said...

p90x workout, ralph lauren, vans outlet, mont blanc pens, herve leger, soccer jerseys, hermes belt, north face outlet, babyliss, celine handbags, timberland boots, iphone 6 cases, nike air max, gucci, instyler, mac cosmetics, bottega veneta, mcm handbags, baseball bats, abercrombie and fitch, hollister, chi flat iron, louboutin, asics running shoes, wedding dresses, longchamp uk, vans, ghd hair, nike trainers uk, beats by dre, nfl jerseys, giuseppe zanotti outlet, lululemon, converse outlet, converse, nike air max, oakley, new balance shoes, ray ban, hollister, hollister clothing, nike roshe run, insanity workout, ferragamo shoes, valentino shoes, nike huaraches, north face outlet, reebok outlet, soccer shoes, jimmy choo outlet, nike free, kate spade outlet

Tuesday, October 13, 2015 8:53:00 PM  
Anonymous Anonymous said...

canada goose, thomas sabo, canada goose jackets, canada goose, louis vuitton, swarovski crystal, montre pas cher, louis vuitton, toms shoes, ugg,ugg australia,ugg italia, marc jacobs, wedding dresses, lancel, ugg,uggs,uggs canada, hollister, pandora jewelry, michael kors outlet, canada goose, canada goose outlet, louis vuitton, supra shoes, doudoune moncler, pandora charms, moncler outlet, juicy couture outlet, moncler, moncler, canada goose uk, moncler outlet, louis vuitton, replica watches, links of london, doke gabbana, canada goose outlet, ugg pas cher, michael kors handbags, louis vuitton, moncler, michael kors outlet online, swarovski, barbour uk, juicy couture outlet, pandora uk, ugg, karen millen uk, ugg uk, pandora jewelry, coach outlet, moncler, moncler uk, canada goose outlet, barbour
ninest123 10.14

Tuesday, October 13, 2015 8:58:00 PM  
Blogger Unknown said...

uggs outlet
ugg boots
chanel handbags outlet
uggs outlet
fitflops outlet sale
north face outlet
nike free 5
mac cosmetics
hollister canada
wedding dresses uk
north face jackets
ferragamo outlet
christian louboutin shoes
coach outlet
wellensteyn outlet
tods outlet
nike air huarache
swarovski outlet
true religion jeans
ray-ban sunglasses
1211minko

Thursday, December 10, 2015 8:15:00 PM  

Post a Comment

<< Home