Kinect

The devices generally contain RGB cameras, and infrared projectors and detectors that map depth through either structured light or time of flight calculations, which can in turn be used to perform real-time gesture recognition and body skeletal detection, among other capabilities.

The majority of the games developed for Kinect were casual, family-oriented titles, which helped to attract new audiences to Xbox 360, but did not result in wide adoption by the console's existing, overall userbase.

[14] In 2005, PrimeSense was founded by tech-savvy mathematicians and engineers from Israel to develop the "next big thing" for video games, incorporating cameras that were capable of mapping a human body in front of them and sensing hand motions.

Microsoft began discussions with PrimeSense about what would need to be done to make their product more consumer-friendly: not only improvements in the capabilities of depth-sensing cameras, but a reduction in size and cost, and a means to manufacturer the units at scale was required.

[14] Kudo Tsunoda and Darren Bennett joined Microsoft in 2008, and began working with Kipman on a new approach to depth-sensing aided by machine learning to improve skeletal tracking.

[15] Much of the initial work was related to ethnographic research to see how video game players' home environments were laid out, lit, and how those with Wiis used the system to plan how Kinect units would be used.

The Microsoft team discovered from this research that the up-and-down angle of the depth-sensing camera would either need to be adjusted manually, or would require an expensive motor to move automatically.

[14] Nearing the planned release, there was a problem of widespread testing of Kinect in various room types and different bodies accounting for age, gender, and race among other factors, while keeping the details of the unit confidential.

[14][16] Three demos were presented during the conference—Microsoft's Ricochet and Paint Party, and Lionhead Studios' Milo & Kate created by Peter Molyneux—while a Project Natal-enabled version of Criterion Games' Burnout Paradise was shown during the E3 exhibition.

[22][23] Microsoft had not committed to a release date for Project Natal at E3 2009, but affirmed it would be after 2009, and likely in 2010 to stay competitive with the Wii and the PlayStation Move (Sony Interactive Entertainment's own motion-sensing system using hand-held devices).

[20][30] Following the E3 2009 show and through 2010, the Project Natal team members experimentally adapted numerous games to Kinect-based control schemes to help evaluate usability.

[42] Xbox product director Aaron Greenberg stated that Microsoft's marketing campaign for Kinect would carry a similar scale to a console launch;[41] the company was reported to have budgeted $500 million on advertising for the peripheral, such as television and print ads, campaigns with Burger King[43] and Pepsi,[44] and a launch event in New York City's Times Square on November 3 featuring a performance by Ne-Yo.

This raised concerns across the video game media: privacy advocates argued that Kinect sensor data could be used for targeted advertising, and to perform unauthorized surveillance on users.

[64] Adafruit named the winner, Héctor Martín, by November 10, 2010,[65][66] who had produced a Linux driver that allows the use of both the RGB camera and depth sensitivity functions of the device.

[79] Commercial interest in Kinect was still strong, with David Dennis, a product manager at Microsoft, stating "There are hundreds of organizations we are working with to help them determine what's possible with the tech".

[80] Microsoft launched its Kinect for Windows program on October 31, 2011, releasing a new SDK to a small number of companies, including Toyota, Houghton Mifflin, and Razorfish, to explore what was possible.

[85] With Microsoft's waning focus on Kinect, PrimeSense was bought by Apple, Inc. in 2013, which incorporated parts of the technology into its Face ID system for iOS devices.

[160] Other programmers, including Robot Locomotion Group at MIT, are using the drivers to develop a motion-controller user interface similar to the one envisioned in Minority Report.

[164] Alexandre Alahi from EPFL presented a video surveillance system that combines multiple Kinect devices to track groups of people even in complete darkness.

[166] In December 2010, the free public beta of HTPC software KinEmote was launched; it allows navigation of Boxee and XBMC menus using a Kinect sensor.

For instance, in a study, an Unscented Kalman filter (UKF) was used to fuse Kinect 3D position data of shoulder, elbow, and wrist joints to those obtained from two inertial measurement units (IMUs) placed on the upper and lower arm of a person.

[178] Computer and Video Games called the device a technological gem and applauded the gesture and voice controls, while criticizing the launch lineup and Kinect Hub.

[177] CNET's review pointed out how Kinect keeps players active with its full-body motion sensing but criticized the learning curve, the additional power supply needed for older Xbox 360 consoles and the space requirements.

USA Today compared it to the futuristic control scheme seen in Minority Report, stating that "playing games feels great" and giving the device 3.5 out of 4 stars.

Despite calling the motion tracking less precise than Wii's implementation, Pogue concluded that "Kinect’s astonishing technology creates a completely new activity that’s social, age-spanning and even athletic.

Privacy advocates contended that the increased amount of data which could be collected with the new Kinect (such as a person's eye movements, heart rate, and mood) could be used for targeted advertising.

Reports also surfaced regarding recent Microsoft patents involving Kinect, such as a DRM system based on detecting the number of viewers in a room, and tracking viewing habits by awarding achievements for watching television programs and advertising.

In response to the criticism, a Microsoft spokesperson stated that users are "in control of when Kinect sensing is On, Off or Paused", will be provided with key privacy information and settings during the console's initial setup, and that user-generated content such as photos and videos "will not leave your Xbox One without your explicit permission.

[196] Having sold 8 million units in its first 60 days on the market, Kinect claimed the Guinness World Record of being the "fastest selling consumer electronics device".

Examples of seventh-generation motion-controlled games that were released on Wii and PlayStation 3, but had a version for Xbox 360 cancelled or ruled out from the start, due to issues with translating wand controls to the camera-based movement of the Kinect, include Dead Space: Extraction,[205] The Lord of the Rings: Aragorn's Quest[206] and Phineas and Ferb: Across the 2nd Dimension.

Steven Spielberg (right) joining Don Mattrick to present "Project Natal" at E3 2009
A January 2010 promotional banner indicating the expected release of Kinect (then "Project Natal") by holiday 2010
Promotion at E3 2010
Kinect for Xbox 360 . The Xbox 360 E revision has an Xbox logo to the left of the Xbox 360 branding.
The Xbox 360 S and E models have dedicated ports for Kinect, removing the need for an external power supply.
A demonstration of a third-party use of Kinect at Maker Faire . The visualization on the left, provided through Kinect, is of a user with a jacket featuring wearable electronic controls for VJing .