Robotic bin picking requires using a perception system to estimate the posture of parts in the bin. The selected singulation plan should be robust with respect to perception uncertainties. If the estimated posture is significantly different from the actual posture, then the singulation plan may fail during execution. In such cases, the singulation process will need to be repeated. We are interested in selecting singulation plans that minimize the expected task completion time. In order to estimate the expected task completion time for a proposed singulation plan, we need to estimate the probability of success and the plan execution time. Robotic bin picking needs to be done in real-time. Therefore, candidate singulation plans need to be generated and evaluated in real-time. This paper presents an approach for utilizing computationally efficient simulations for generating singulation plans. Results from physical experiments match well with the predictions obtained from simulations.

References

References
1.
Kumbla
,
N. B.
,
Thakar
,
S.
,
Kaipa
,
K. N.
,
Marvel
,
J. A.
, and
Gupta
,
S. K.
,
2017
, “Simulation Based On-Line Evaluation of Singulation Plans to Handle Perception Uncertainty in Robotic Bin Picking,”
ASME
Paper No. MSEC2017-2955.
2.
Buchholz
,
D.
,
2016
, “
Depth Map Based Pose Estimation
,”
Bin-Picking
,
Springer
,
New York
, pp.
39
56
.
3.
Kuo
,
H. Y.
,
Su
,
H. R.
,
Lai
,
S. H.
, and
Wu
,
C. C.
,
2014
, “
3D Object Detection and Pose Estimation From Depth Image for Robotic Bin Picking
,”
IEEE International Conference on Automation Science and Engineering
(
CASE
), Taipei, Taiwan, Aug. 18–22, pp.
1264
1269
.
4.
Sansoni
,
G.
,
Bellandi
,
P.
,
Leoni
,
F.
, and
Docchio
,
F.
,
2014
, “
Optoranger: A 3D Pattern Matching Method for Bin Picking Applications
,”
Optics and Lasers in Engineering
, Vol.
54
,
Elsevier
,
Amsterdam, The Netherlands
, pp.
222
231
.
5.
Pretto
,
A.
,
Tonello
,
S.
, and
Menegatti
,
E.
,
2013
, “
Flexible 3D Localization of Planar Objects for Industrial Bin-Picking With Monocamera Vision System
,”
IEEE International Conference on Automation Science and Engineering
(
CASE
), Madison, WI, Aug. 17–20, pp.
168
175
.
6.
Rodrigues
,
J. J.
,
Kim
,
J. S.
,
Furukawa
,
M.
,
Xavier
,
J.
,
Aguiar
,
P.
, and
Kanade
,
T.
,
2012
, “
6D Pose Estimation of Textureless Shiny Objects Using Random Ferns for Bin-Picking
,”
IEEE/RSJ International Conference on Intelligent Robots and Systems
(
IROS
), Vilamoura, Portugal, Oct. 7–12, pp.
3334
3341
.
7.
Boughorbel
,
F.
,
Zhang
,
Y.
,
Kang
,
S.
,
Chidambaram
,
U.
,
Abidi
,
B.
,
Koschan
,
A.
, and
Abidi
,
M.
,
2003
, “
Laser Ranging and Video Imaging for Bin Picking
,”
Assem. Autom.
,
23
(
1
), pp.
53
59
.
8.
Horn
,
B.
, and
Ikeuchi
,
K.
,
1983
, “Picking Parts Out of a Bin,” Artificial Intelligence Laboratory, Cambridge, MA, DTIC Document No.
AIM-746
.https://dspace.mit.edu/bitstream/handle/1721.1/5642/AIM-746.pdf?sequence=2
9.
Akizuki
,
S.
, and
Hashimoto
,
M.
,
2015
, “
Stable Position and Pose Estimation of Industrial Parts Using Evaluation of Observability of 3D Vector Pairs
,”
J. Rob. Mechatronics
,
27
(
2
), pp.
174
181
.
10.
Fuchs
,
S.
,
Haddadin
,
S.
,
Keller
,
M.
,
Parusel
,
S.
,
Kolb
,
A.
, and
Suppa
,
M.
,
2010
, “
Cooperative Bin-Picking With Time-of-Flight Camera and Impedance Controlled DLR Lightweight Robot III
,”
IEEE/RSJ International Conference on Intelligent Robots and Systems
(
IROS
), Taipei, Taiwan, Oct. 18–22, pp.
4862
4867
.
11.
Harada
,
K.
,
Nagata
,
K.
,
Tsuji
,
T.
,
Yamanobe
,
N.
,
Nakamura
,
A.
, and
Kawai
,
Y.
,
2013
, “
Probabilistic Approach for Object Bin Picking Approximated by Cylinders
,”
IEEE International Conference on Robotics and Automation
(
ICRA
), Karlsruhe, Germany, May 6–10, pp.
3742
3747
.
12.
Liu
,
M. Y.
,
Tuzel
,
O.
,
Veeraraghavan
,
A.
,
Taguchi
,
Y.
,
Marks
,
T. K.
, and
Chellappa
,
R.
,
2012
, “
Fast Object Localization and Pose Estimation in Heavy Clutter for Robotic Bin Picking
,”
Int. J. Rob. Res.
,
31
(
8
), pp.
951
973
.
13.
Papazov
,
C.
,
Haddadin
,
S.
,
Parusel
,
S.
,
Krieger
,
K.
, and
Burschka
,
D.
,
2012
, “
Rigid 3D Geometry Matching for Grasping of Known Objects in Cluttered Scenes
,”
Int. J. Rob. Res.
,
31
(4), pp.
538
553
.
14.
Pronobis
,
A.
, and
Caputo
,
B.
,
2007
, “
Confidence-Based Cue Integration for Visual Place Recognition
,”
IEEE/RSJ International Conference on Intelligent Robots and Systems
(
IROS
), San Diego, CA, Oct. 29–Nov. 2, pp.
2394
2401
.
15.
Bicchi
,
A.
, and
Kumar
,
V.
,
2000
, “
Robotic Grasping and Contact: A Review
,”
IEEE International Conference on Robotics and Automation
(
ICRA
), San Francisco, CA, Apr. 24–28, pp.
348
353
.
16.
Bohg
,
J.
,
Morales
,
A.
,
Asfour
,
T.
, and
Kragic
,
D.
,
2014
, “
Data-Driven Grasp Synthesis—A Survey
,”
IEEE Trans. Rob.
,
30
(
2
), pp.
289
309
.
17.
Dupuis
,
D. C.
,
Léonard
,
S.
,
Baumann
,
M. A.
,
Croft
,
E. A.
, and
Little
,
J. J.
,
2008
, “
Two-Fingered Grasp Planning for Randomized Bin-Picking
,”
Robotics: Science and Systems 2008 Manipulation Workshop-Intelligence in Human Environments
, June 28.http://www.cs.ubc.ca/~little/links/linked-papers/RSS_MAN_08_two_fingered_grasp.pdf
18.
Ellekilde
,
L. P.
,
Jorgensen
,
J. A.
,
Kraft
,
D.
,
Kruger
,
N.
,
Piater
,
J.
, and
Petersen
,
H. G.
,
2012
, “
Applying a Learning Framework for Improving Success Rates in Industrial Bin Picking
,”
IEEE/RSJ International Conference on Intelligent Robots and Systems
(
IROS
), Vilamoura, Portugal, Oct. 7–12, pp.
1637
1643
.
19.
Kendall
,
A.
, and
Cipolla
,
R.
,
2016
, “
Modelling Uncertainty in Deep Learning for Camera Relocalization
,”
IEEE International Conference on Robotics and Automation
(
ICRA
), Stockholm, Sweden, May 16–21, pp.
4762
4769
.
20.
Zheng
,
Y.
, and
Qian
,
W. H.
,
2005
, “
Coping With the Grasping Uncertainties in Force-Closure Analysis
,”
Int. J. Rob. Res.
,
24
(
4
), pp.
311
327
.
21.
Berenson
,
D.
,
Srinivasa
,
S. S.
, and
Kuffner
,
J. J.
,
2009
, “
Addressing Pose Uncertainty in Manipulation Planning Using Task Space Regions
,”
IEEE/RSJ International Conference on Intelligent Robots and Systems
(
IROS
), St. Louis, MO, Oct. 10–15, pp.
1419
1425
.
22.
Chang
,
L.
,
Smith
,
J. R.
, and
Fox
,
D.
,
2012
, “
Interactive Singulation of Objects From a Pile
,”
IEEE International Conference on Robotics and Automation
(
ICRA
), Saint Paul, MN, May 14–18, pp.
3875
3882
.
23.
Kaipa
,
K. N.
,
Kankanhalli-Nagendra
,
A. S.
,
Kumbla
,
N. B.
,
Shriyam
,
S.
,
Thevendria-Karthic
,
S. S.
,
Marvel
,
J. A.
, and
Gupta
,
S. K.
,
2016
, “
Addressing Perception Uncertainty Induced Failure Modes in Robotic Bin-Picking
,”
Robotics and Computer-Integrated Manufacturing
, Vol.
42
,
Elsevier
,
Amsterdam, The Netherlands
, pp.
17
38
.
24.
Kaipa
,
K. N.
,
Kankanhalli-Nagendra
,
A. S.
,
Kumbla
,
N. B.
,
Shriyam
,
S.
,
Thevendria-Karthic
,
S. S.
,
Marvel
,
J. A.
, and
Gupta
,
S. K.
,
2016
, “
Enhancing Robotic Unstructured Bin-Picking Performance by Enabling Remote Human Interventions in Challenging Perception Scenarios
,”
IEEE International Conference on Automation Science and Engineering
(
CASE
), Fort Worth, TX, Aug. 21–25, pp.
639
645
.
25.
Kaipa
,
K. N.
,
Shriyam
,
S.
,
B
,
N.
, and
Gupta
,
S. K.
,
2016
, “Resolving Occlusions Through Simple Extraction Motions in Robotic Bin Picking,”
ASME
Paper No. MSEC2016-8661.
26.
Kaipa
,
K. N.
,
Shriyam
,
S.
,
Kumbla
,
N. B.
, and
Gupta
,
S. K.
,
2015
, “
Automated Plan Generation for Robotic Singulation From Mixed Bins
,”
IROS Workshop on Task Planning for Intelligent Robots in Service and Manufacturing
, Hamburg, Germany, Oct. 2, pp. 45–50.http://citeseerx.ist.psu.edu/viewdoc/download;jsessionid=216DAF63796EA6003DAEE4F2C196FBBC?doi=10.1.1.709.9295&rep=rep1&type=pdf
27.
Kaipa
,
K. N.
,
Kumbla
,
N. B.
, and
Gupta
,
S. K.
,
2015
, “
Characterizing Performance of Sensorless Fine Positioning Moves in the Presence of Grasping Position Uncertainty
,”
IROS Workshop on Task Planning for Intelligent Robots in Service and Manufacturing
, Hamburg, Germany, Oct. 2, pp. 51–56.http://citeseerx.ist.psu.edu/viewdoc/download;jsessionid=043268EBCA8E7183D05E26B3974A66BD?doi=10.1.1.708.6122&rep=rep1&type=pdf
28.
Ilies
,
H. T.
,
2009
, “
Continuous Collision and Interference Detection for 3D Geometric Models
,”
ASME J. Comput. Inf. Sci. Eng.
,
9
(
2
), p.
021007
.
29.
Akgunduz
,
A.
,
Banerjee
,
P.
, and
Mehrotra
,
S.
,
2005
, “
A Linear Programming Solution for Exact Collision Detection
,”
ASME J. Comput. Inf. Sci. Eng.
,
5
(
1
), pp.
48
55
.
30.
Kim
,
B.
, and
Rossignac
,
J.
,
2003
, “
Collision Prediction
,”
ASME J. Comput. Inf. Sci. Eng.
,
3
(
4
), pp.
295
301
.
You do not currently have access to this content.