Learning-based approaches to understanding and manipulating 3D objects can handle a wide variety of objects, but may be unable to generalize all sets of objects. We will study the generalization of deep learning models in two subdomains of 3D objects: grasping and object descriptors.
In the first part of the thesis, we show how objects can be designed to be adversarial to Dex-Net, a neural network based grasping policy. We define an "adversarial grasp object" as an object that is visually similar to an original object but decreases the predicted graspability resulting from a robot grasping policy. We propose a method for synthesizing adversarial grasp objects by removing antipodal face pairs via systematic face rotations. We also explore a method that maintains local convexity and a deep-learning based method. Experiments suggest that all three algorithms consistently reduce graspability. Physical experiments demonstrate that the adversarial objects generated by the convexity preserving analytic algorithm decrease the grasp success rate by at least 87%. In simulation, the analytic rotation algorithm is able to reduce the graspability metric by 66%, 57%, and 63% on intersected cylinders, intersected prisms, and ShapeNet bottles.
In the second part of the thesis, we explore the potential application of dense object descriptors to mechanical search, where we attempt to find a target object in clutter. We find that dense object descriptors can generalize reasonably well and learn a consistent representation for unseen classes of objects. Feature matching methods can be combined with the descriptors to search for target objects in a heap.
Title
Computing and Evaluating Adversarial Grasp Objects with Systematic Face Rotations and Applications of Dense Object Descriptors to Mechanical Search
Published
2019-05-21
Full Collection Name
Electrical Engineering & Computer Sciences Technical Reports
Other Identifiers
EECS-2019-92
Type
Text
Extent
48 p
Archive
The Engineering Library
Usage Statement
Researchers may make free and open use of the UC Berkeley Library’s digitized public domain materials. However, some materials in our online collections may be protected by U.S. copyright law (Title 17, U.S.C.). Use or reproduction of materials protected by copyright beyond that allowed by fair use (Title 17, U.S.C. § 107) requires permission from the copyright owners. The use or reproduction of some materials may also be restricted by terms of University of California gift or purchase agreements, privacy and publicity rights, or trademark law. Responsibility for determining rights status and permissibility of any use or reproduction rests exclusively with the researcher. To learn more or make inquiries, please see our permissions policies (https://www.lib.berkeley.edu/about/permissions-policies).