Body Part Recognition for Kinect
Kinect for Xbox 360 makes you the controller, by fusing 3D imaging hardware with human-motion capture software. The software "brain" of Kinect relies on a breakthrough in the combination of machine learning with image processing. This was developed at Microsoft Research Cambridge in collaboration with Xbox Incubation, and draws on their earlier research on visual object recognition.
Images
 Traditional RGB image |
 Image from new depth sensing camera |
 Body parts inferred by our recognition algorithm |
 3D body part position proposals |
People
Mat Cook
Publications
- Ross Girshick, Jamie Shotton, Pushmeet Kohli, Antonio Criminisi, and Andrew Fitzgibbon, Efficient Regression of General-Activity Human Poses from Depth Images, in ICCV, IEEE, October 2011
- Jamie Shotton, Andrew Fitzgibbon, Mat Cook, Toby Sharp, Mark Finocchio, Richard Moore, Alex Kipman, and Andrew Blake, Real-Time Human Pose Recognition in Parts from a Single Depth Image, in CVPR, IEEE, June 2011
- Rose Johnson, Kenton O'Hara, Abigail Sellen, Claire Cousins, and Antonio Criminisi, Exploring the Potential for Touchless Interaction in Image Guided Interventional Radiology, in ACM Conference on Computer-Human Interaction (CHI). Honourable Mention Award, ACM Conference on Computer-Human Interaction, 7 May 2011
- Jamie Shotton, John Winn, Carsten Rother, and Antonio Criminisi, TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context, in Int. Journal of Computer Vision (IJCV), Springer Verlag, January 2009
- Toby Sharp, Implementing Decision Trees and Forests on a GPU, in ECCV (4), Springer, 2008
- Jamie Shotton, Matthew Johnson, and Roberto Cipolla, Semantic Texton Forests for Image Categorization and Segmentation, in Proc. IEEE CVPR, 2008
Quick Links
Related Press
- Binary Body Double: Microsoft Reveals the Science Behind Project Natal for Xbox 360
Scientific American - Kinect for Xbox 360: The inside story of Microsoft's secret 'Project Natal'
WIRED UK - Key Kinect Technology Devised in Cambridge Lab
Wall St Journal Europe
