Hot Contents: 3D computer vision

3D computer vision

3D computer vision, or human-like computer vision, is the ability of double camera processor powered devices to acquire a real time picture of the world in three dimensions. It was not possible to achieve such instant speeds of 3D info capturing using the traditional technology of stereo cameras due to huge resources required to process and compare/combine images received from two misaligned image sensors.

In 2006 Science Bureau Inc. came up with an idea how to seamlessly transition from 2D to 3D technology in personal computers and other mobile devices to enable them to see the world as humans. The idea behind the invention was quite simple. In order to avoid enormous processing resources for compensation of misalignment of two image sensors said image sensors need to be precisely aligned so that the rows of their sensing elements are parallel to the line connecting their optical centers. Then the rows can be easily compared on the fly. There is no further need in powerful image processors what makes the technology very inexpensive and suitable for its low budget mass implementation.

The idea was introduced to all major companies playing in the market of home electronics and computer games back in 2007 but was not acquired by any of them. In 2010 US Patent 7,729,530 was issued to protect the intellectual rights. The same year all kinds of 3D devices began flooding the market in the North America.

Despite this recent breakthrough in 3D technologies there is still a lack of real time 3D vision computer systems on the market. There are a few high profile products that are close to achieving instant 3D image reconstruction. Nevertheless, they are still far from providing real time image and gesture recognition for computer games and device control. Let’s take a closer look at them.

Microsoft’s Kinect for xBox 360. The product uses the suggested advanced technology in part of having two image sensors with aligned rows of sensing elements. However, Microsoft utilizes a special source of light producing a large pattern on surrounding objects to get captured and recognized by the imaging part. Due to specifics of the pattern the image resolution is very low and the device is only capable of recognizing major body movements. The device uses low resolution image sensors and still not fast enough to process received images.
Fuji’s stereo camera. Precisely aligned sensors with high grade optics. Could provide a great 3D real time image if connected and controlled by computer.
Panasonic’s 3D camcorder. Great idea with mechanically alignable sensors to get 3D video images.
HTC has unveiled the EVO 3D, a follow-up to Sprint Nextel's breakout smartphone. It has a 4.3-inch touchscreen, which can display eye-popping 3D without needing glasses. Users will also be able to capture photos and videos in 3D using a pair of cameras on the back.
LG Electronics has been working for a year and half on a 3D smartphone of its own.The Optimus 3D, as it's been called, will launch on AT&T Mobility's network with the name Thrill 4G. LG developers spent a great deal of time fine-tuning the pair of 5-megapixel cameras to accurately capture 3D media. Calibrating the cameras to produce good-looking stills and video is more difficult than pulling off a glasses-free display.
Nintendo's 3DS also has a pair of cameras for capturing scenes in 3D, and it works quite well. Being the first out of the gate to offer a mainstream glasses-free 3D gadget, Nintendo expected to find competitors, and it soon did when LG announced its phone.
Both LG and HTC are planning to debut tablet computers that should be able, like their phones, capture 3D with a pair of cameras.

It is obvious that all of the above companies are on the right track building their products based on the technology to align two image sensors as precisely as possible. Therefore, if the technology keeps going in the defined direction, we are to soon witness computers recognizing and communicating with their users; robots being everywhere and doing everything from surgeries to driving cars; 3D virtual games with instant Avatar image creation of the players; 3D technologies everywhere from smartphones to TV.