Compositionality in Vision and Language

Compositionality can be found almost everywhere one looks. It is manifest in as diverse a range of entities as objects around us, the languages we use, and even our actions and interactions with the world. My work involves exploring and exploiting the general nature of such compositionality, often across multiple modalities, to solve deep and complex problems in perception.

I demonstrate such ability in a variety of domains including part-based structures, board games, and activity recognition. I also show evidence for a particular kind of compositionality in how the brain perceives the world, lending further credence to the ubiquity and utility of compositionality.