ACM Transactions on Graphics, 2017

Understanding and Exploiting Object
Interaction Landscapes

Sören Pirk1       Vojtech Krs2       Kaimo Hu2       Suren Deepak Rajasekaran2
Hao Kang2       Bedrich Benes3       Yusuke Yoshiyasu3       Leonidas J. Guibas1

1Stanford University, USA
2Purdue University, USA


Interactions play a key role in understanding objects and scenes, for both virtual and real world agents. We introduce a new general representation for proximal interactions among physical objects that is agnostic to the type of objects or interaction involved. The representation is based on tracking particles on one of the participating objects and then observing them with sensors appropriately placed in the interaction volume or on the interaction surfaces. We show how to factorize these interaction descriptors and project them into a particular participating object so as to obtain a new functional descriptor for that object, its interaction landscape, capturing its observed use in a spatio-temporal framework. Interaction landscapes are independent of the particular interaction and capture subtle dynamic effects in how objects move and behave when in functional use. Our method relates objects based on their function, establishes correspondences between shapes based on functional key points and regions, and retrieves peer and partner objects with respect to an interaction.





 author     = {Pirk, S\"{o}ren and Krs, Vojtech and Hu, Kaimo and Rajasekaran, 
               Suren Deepak and Kang, Hao and Yoshiyasu, Yusuke and Benes, 
               Bedrich and Guibas, Leonidas J.},
 title      = {Understanding and Exploiting Object Interaction Landscapes},
 journal    = {ACM Trans. Graph.},
 issue_date = {June 2017},
 volume     = {36},
 number     = {3},
 month      = jun,
 year       = {2017},
 issn       = {0730-0301},
 pages      = {31:1--31:14},
 articleno  = {31},
 numpages   = {14},
 url        = {},
 doi        = {10.1145/3083725},
 acmid      = {3083725},
 publisher  = {ACM},
 address    = {New York, NY, USA},
 keywords   = {Object functionality analysis, affordance analysis, 
               geometric modeling, object semantics, 
               physical interactions, shape analysis},