3D gesture control technology: from game consoles to consumer electronics (2)

"Cadillac" in the field of gesture recognition

Like the accuracy value that game enthusiasts may recognize, the game itself is not as important as game development or special effects movie animation. For animation experts, the "Cadillac" in the field of gesture recognition is Xsens Technologies' bodysuits studded with MEMS. The accelerometer and gyroscope on this set can realize real-time animation sequence preview.

Xsens uses ADI's high-precision three-axis accelerometer, gyroscope, and magnetometer for detailed motion tracking. For example, some experts use Xsens technology to develop animation effects for the movie "Iron Man 2" and the PS3 game "Kill Zone 2". The motion capture solution provided by this technology can be used anywhere without complex infrastructure. Finally, Xsens predicts that this technology will reduce costs for consumer applications, support Kinect-like experiences, but provide much higher fidelity, and there is no limit to the number of players.

"Microsoft Kinect is an excellent solution because it does not require any sensors to be installed on the body, but it is slower and sometimes appears to be slower in tracking human gestures." Casper Peeters, CEO of Xsens, said, "Our The technology is much more flexible in terms of where it can be used, and it can achieve higher fidelity in tracking the precise movement of the wearer. But motion-based game controllers and phone interfaces are just beginning to appear. Xsens is another plan , Supporting high-end motion capture for precise feature animations, and more interesting applications will emerge in the future. "

Microsoft has also set its sights on the future, planning to make full use of the 3D tracking technology acquired in 2009 and 2010 when it acquired 3-DV and Canesta. These companies actually monopolized the market in terms of time-of-flight (TOF) gesture recognition patents, especially for mobile devices.

The time-of-flight sensor measures the time it takes for red light to reflect from an object back to a specific CMOS sensor, thereby producing a high-precision 3D depth map at any distance and under any lighting conditions. Time-of-flight depth map technology can also be perfectly combined with the 3D camera gesture recognition algorithm developed by Microsoft through its GestureTek license.

The German company TriDiCam GmbH and some other companies claim to have time-of-flight sensor technology. But so far only Canesta has confirmed the concept. A CMOS image sensor can be used to create an accurate 3D image map of a hand waving just a few inches above the mobile device, even in bright sunlight outdoors.

Companies like Silicon Labs can use inexpensive infrared and ambient light sensors to recognize gestures for special applications, such as turning on the display or adjusting the volume by drawing a line through the air with a finger.

With the support of the OEM algorithm, the Microsoft Surface platform can read "waving" gestures. The redesigned screen can be hung on the wall.

3D gesture control technology: from game consoles to consumer electronics

Changes under Surface

Microsoft showed off the next-generation Surface multi-touch platform at CES. This platform no longer uses the five camera devices in the first generation, but a thinner device that can be installed vertically.

This Surface platform allows users to directly manipulate objects displayed on the screen, using built-in algorithms to interpret various gestures, such as selection, drag, drop, pinch and zoom, and other touch screen-like instructions (OEMs can also develop their own algorithms). The new version "is only 4 inches thick and can be installed horizontally, vertically, or at any other angle," noted Brad Carpenter, general manager of Microsoft's Surface Division.

The key is the PixelSense technology jointly developed by Microsoft and Samsung LCD (the company ’s final display model is SUR40). For visible or infrared light in an alternating checkerboard pattern, PixelSense technology adds a light sensor to each LCD pixel. The visible and infrared light emitters in the backlight allow each corresponding pixel to detect light reflected from the user's hands or other objects. By sampling the sensor at a speed of 60 frames per second, the technology can track the movement of multiple users simultaneously, the number of users is only limited by the available surface area of ​​the screen. The built-in FPGA supports position tracking, and can read special application tags on objects placed on the screen surface, and send data to a Windows 7 smartphone with a camera through infrared transmission.

In terms of applications, the Surface platform integrates an AMD Athlon X2 245e 2.9GHz dual-core processor running Windows 7 and a matching AMD Radeon HD 6750 graphics processor.

"This 40-inch screen will be sold by Samsung's LCD division to the global market for $ 7,600." Microsoft's Carpenter revealed.

3D gesture control technology: from game consoles to consumer electronics

Microsoft's Xbox Kinect is based on the PrimeSense reference design and uses two CMOS imagers (one for infrared light and one for visible light) to detect 3D depth, so the system can easily distinguish gamers and background objects in the room. (Author: Bell Rock)


Related Links:

3D gesture control technology: from game consoles to consumer electronics (1)

Today, consumer product OEMs are adding 3D gesture recognition capabilities to their full line of products. Some companies use technology licenses obtained from GestureTek, while others obtain licenses from Hillcrest Laboratories or Movea. Movea has more than 250 related patents, covering technologies like controlling the cursor with a gyroscope; Hillcrest has more than 100 patents, including the use of accelerometers and gyroscopes to track motion. Both companies provide value-added software development tools for 3D gesture designers. They are ...


Pvc Horse Fence

Pvc Horse Fence,Vinyl Ranch Fence,Black Pvc Horse Fence,3 Rail Vinyl Horse Fence

ZHEJIANG DEQING GONAT FENCE CO.,LTD , https://www.gonatpvcfence.com