Using object affordances to improve object recognition
Castellini C, Tommasi T, Noceti N, Odone F, Caputo B (2011)
Publication Type: Journal article
Publication year: 2011
Journal
IEEE Transactions on Autonomous Mental Development
Institute of Electrical and Electronics Engineers
Book Volume: 3
Pages Range: 207-215
Article Number: 5699912
Journal Issue: 3
DOI: 10.1109/TAMD.2011.2106782
Abstract
The problem of object recognition has not yet been solved in its general form. The most successful approach to it so far relies on object models obtained by training a statistical method on visual features obtained from camera images. The images must necessarily come from huge visual datasets, in order to circumvent all problems related to changing illumination, point of view, etc. We hereby propose to also consider, in an object model, a simple model of how a human being would grasp that object (its affordance). This knowledge is represented as a function mapping visual features of an object to the kinematic features of a hand while grasping it. The function is practically enforced via regression on a human grasping database. After describing the database (which is publicly available) and the proposed method, we experimentally evaluate it, showing that a standard object classifier working on both sets of features (visual and motor) has a significantly better recognition rate than that of a visual-only classifier. © 2011 IEEE.
Authors with CRIS profile
Involved external institutions
idiap Research Institute
Switzerland (CH)
University of Genova / Università degli Studi di Genova
Italy (IT)
Switzerland (CH)
University of Genova / Università degli Studi di Genova
Italy (IT)
How to cite
APA:
Castellini, C., Tommasi, T., Noceti, N., Odone, F., & Caputo, B. (2011). Using object affordances to improve object recognition. IEEE Transactions on Autonomous Mental Development, 3(3), 207-215. https://dx.doi.org/10.1109/TAMD.2011.2106782
MLA:
Castellini, Claudio, et al. "Using object affordances to improve object recognition." IEEE Transactions on Autonomous Mental Development 3.3 (2011): 207-215.
BibTeX: Download