10 Applications of the SixthSense Technology

Pranav Mistry, the maker of SixthSense was inspired by futuristic movies like Minority Report and Robocop while creating the device.

Canadian researcher and inventor Steve Mann created the first wearable computer as a neck worn projecting device with camera system known as the Telepointer in 1990 when he was a media lab student. He is thus regarded as the Father of SixthSenseTechnology and also as the Father of Wearable Computing.

The first prototype of the SixthSense technology was larger and heavier in size and hence caused hindrance in daily life usability. Besides it stood steeped in price making it scarcely available for commercial purpose.

Therefore Indian computer scientist and inventor Pranav Mistry felt the need to improve the existing technology and invent a futuristic device that would seamlessly integrate the digital and physical world through gesture identification, image capturing, processing, and manipulation.

Computer scientist and inventor Pranav Mistry hails from Palanpur, Gujarat, India. While as a student he sort inspiration from futuristic sci-fi movies and visions of a computer-free world, he furthered his quest to introduce to the world a technology that would revolutionize the future.

He first tried out the idea of a simple sixth sense prototype on a computer mouse by putting two rollers into one mouse and trying to obtain data by guiding the movements of the mouse.

The venture of two rollers did not work out so he decided to improve the design by using four rollers which eventually gave him the idea to integrate gesture movements through fingers.

While being a PhD student in the Fluid Interfaces Group at the MIT Media Lab, he designed the wearable gestural interface known as the Wear Ur World (WuW) or SixthSense. He is currently positioned as the Head of Think Tank Team and Director of Research of Samsung Research America.

He has been embellished with many awards for his invention including Young Global Leader 2013 Award, by World Economic Forum, 50 Most Creative People of the Year 2010, by CREATIVITY 50, and INVENTION OF THE YEAR 2009 award, by Popular Science.

The prototype which is the blend of a computer and cell phone consists of a pocket projector, a mirror, and a camera. The hardware components are integrated into a pendant-like mobile wearable device connected to the mobile computing device of the user.

Colored magic marker caps (red, blue, green and yellow) worn on the four fingers aide the camera to identify the four fingers and discern the hand gestures through an in-built software.

The webcam acts like a digital eye that captures and distinguishes an object in view and courses the user's hand gestures using computer-vision based techniques to transmit data to the smartphone. The tiny LED projector projects visual information altering surfaces, walls, and physical objects to be used as interfaces.

The usage of the mirror is important as a reflector as the projector swings downwards from the neck. A Web-enabled smartphone processes the video data by interpreting the hand gestures. The movements and arrangements of the colored makers are translated into gestures that act as interaction commands for the projected application interfaces.

The in-built software program analyzes the video data viewed by the camera and also tracks down the positioning of the colored markers by utilizing single computer vision techniques.

The user can command multiple hand gestures and movements as long as they are visually identified and differentiated by the system. This is possible because the 'SixthSense' device supports multi-touch and multi-user interaction.

The software distinguishes 3 kinds of gestures: Multitouch gestures - Gestures that involve pinching and dragging, Freehand gestures - Free hand movements to start the projection, and Iconic gestures - Creating an image in the air.

✏ Highly portable device that can be carried around due to its minuscule pocket-size.

✏ It costs only $350 which is quite cheap considering its technological application.

✏ Its main characteristic is that it acts as a connective instrument between the real and digital world.

✏ The user can gain access to high-speed data from any machine and from any corner of the world with just simple hand movements.

✏ The software that is used to render and analyze the data compiled by the device is made open source. This facility enables other developers to impart additional development to the system.

✏ While capturing images from this small device the user might invade the privacy of others without the person's consent, of course no one likes to be clicked in the pictures of any random person.

✏ A deadly device if it comes in the hands of criminals as it can gain access to any information without being tagged or supervised as suspicious. Criminals can use Open Source Intelligence to use public sources such as 'Facebook Face' to extract personal information about anyone.

✏ Hackers can use it for their potential hacking targets.

✏ Malware and viruses can easily be installed in other systems through this device.

✏ The data projected is never private as it will displayed on a surface for everyone to see. Also it can be viewed with clarity during the nighttime as opposed to the daytime hence causing vision problems.

It allows the user to project the dial pad unto the palm as a virtual keypad to make calls without the presence of an actual mobile device.

An excellent on-the-go feature that allows you to check your flight timings without logging into any of the related travel sites, the device recognizes your boarding pass to project the required information anytime anywhere.

Stuck in traffic or simply exploring uncharted territories and wishing you had a virtual route plan, then don't worry this device allows the feature of navigating through any map of choice with the simple gesture of your thumb and index fingers. Zoom in or out and plan the map along any surface with just the swipe of your fingers.

Architects, graphic designers, and simply art enthusiasts can use this feature for drawing, storing, shuffling, and resurfacing virtual pictures anywhere. This feature allows the user to create pictures by tracking the index fingertip movements.

Check time by gesturing a circle on your wrist and a virtual clock with the current timings will be displayed.

Capture wonderful moments on the go with the device's gestural feature by placing your fingers as a frame to captivate an image. These images can be edited, shared, and stored without the additional use of a camera or any other photo capturing device.

Stay connected with the outside world through this device by creating and reading virtual newspapers by projecting them on any surface, watch streaming videos, and live news updates from anywhere.

Book lovers can enjoy a good read by getting to know the reviews of latest books, analyzing ratings, jumping to any page while reading, and browsing through additional information.

It will be easier to stay in touch with people through this device as the facial recognition technique of this technology allows the user to store data about the people they meet daily, project their relevant information anywhere, creates reminders or appointments with their contacts, and gain additional access on their information.

This feature would be very helpful for business personnel's who meet clients on a daily basis, it would help them to stay organized about their business agendas.

Boon to the shoppers who would love to know a little extra about the products they pick off the shelves. This device recognizes the objects that are being picked and projects its related information onto any screen.

This avant-garde technology attempts to improve itself in the coming years by withdrawing the colored markers, incorporating projector in the mobile device, allowing a flat surface to be used as a multi-touch user interface, applying it for gaming and education purpose, adding 3D gesture tracking, and making it available for disabled people.