Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
Computer Vision

Teaching computers to understand the visual world

 

We want to change the way you interact with visual data.   We want to make your photos magical, we want to deeply understand images and videos from cameras everywhere: in your phone, on your Xbox, in your fridge, on robots, in cars, anywhere.   We want you to be able to find your stuff, answer questions, make fantastic new images.  And we do that by inventing new algorithms and thinking of new mathematical models for how images come to be.

 

Image understanding

Understanding images

Image understanding with tens of layers, millions of classes, billions of images.

 

Human motion capture for Kinect

Understanding Humans

So much of computer vision is ultimately for humans, images of humans are an important special case

Image and video editing

Making images better

Pictures are an important part of our lives, and computer vision gives us the tools to enjoy better pictures.

Discrete optimization

Learning and Optimization

Computer vision often requires the solution of especially large or difficult problems in machine learning and nonlinear optimization, and we innovate in these domains.

 

Models for Video

One view of video is "all of the above, but faster".   We also try to explore new representations of video and new modes of interaction

 

Where are we?

Localization problems occur everywhere, from augmented reality to medical imaging to 3D modelling.

 

Recent vision publications

Y. Ioannou, D. Robertson, J. Shotton, R. Cipolla, and A. Criminisi, Training Convolutional Neural Networks with Low-rank Filters for Efficient Image Classification, in arXiv:1511.06744v2 and Int Conf. on Learning Representations (ICLR), May 2016.

A. Ghosh, V. Wottschel, E. Kaden, J. Zhang, H. Zhang, S. N. Sotiropoulos, D. Zikic, T. B. Dyrby, A. Criminisi, and D. C. Alexander, Generalisability of Image Quality Transfer: Can we approximate in-vivo human brains from dead monkey brains?, in Intl Society for Magnetic Resonance in Medicine (ISMRM), May 2016.

M. D'Souza, J. Burggraaff, S. Steinheimer, P. Kontschieder, C. Morrison, J. Dorn, P. Tewarie, K. Miciunaite, A. Sellen, A. Criminisi, C. Kamm, F. Dahlke, B. Uitdehaag, and L. Kappos, Accuracy of depth-sensing recordings in classifying Expanded Disability Status Scale subscores of motor dysfuntion in patients with multiple sclerosis, Microsoft Research, April 2016.

Aamir Anis, Philip A. Chou, and Antonio Ortega, COMPRESSION OF DYNAMIC 3D POINT CLOUDS USING SUBDIVISIONAL MESHES AND GRAPH WAVELET TRANSFORMS, in Int'l Conf. on Acoustics, Speech, and Signal Processing (ICASSP), IEEE – Institute of Electrical and Electronics Engineers, March 2016.

C. Morrison, K. Huckvale, B. Corish, J. Dorn, P. Kontschieder, K. O'Hara, ASSESS MS Team, A. Criminisi, and A. Sellen, Assessing Multiple Sclerosis with Kinect: Designing Computer Vision Systems for Real-World Use, in Human-Computer Interaction, January 2016.

More publications...