Human-Robot Task Handoff: A Probabilistic Modeling Approach Explored through Cooperative Drawing
DOI:
https://doi.org/10.47611/jsrhs.v13i2.6545Keywords:
Task Handoff, State Estimation, Human-Robot CollaborationAbstract
Recent research in human-robot interaction explores the potential for human-machine collaboration in surgical procedures, dividing tasks into manual and automatable subtasks. This paper investigates the task of handoff detection, crucial for the success of robot-assisted surgery, focusing on the creation of a synthetic dataset which can be used for training and benchmarking models for this task. We present a dataset of parabolas, simulating cooperative drawing between a human and a robot, with variations in drawing rates and added noise. The study demonstrates the applicability of HMMs in determining handoff points, laying the groundwork for future research in human-machine collaborative surgery. The dataset, along with the provided code and raw data, are provided as a resource for future research. Finally, we discuss the limitations of the dataset and suggest directions for future research, emphasizing the need for higher-dimensional and real-world datasets.
Downloads
References or Bibliography
Padoy, Nicolas, & Hager, G. D. (2011). Human-machine collaborative surgery using learned models. 2011 IEEE International Conference on Robotics and Automation. https://doi.org/10.1109/icra.2011.5980250
Padoy, N., Mateus, D., Weinland, D., Berger, M.-O., & Navab, N. (2009). Workflow monitoring based on 3D motion features. 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops. https://doi.org/10.1109/iccvw.2009.5457648
Lan, Y., Zhou, D., Zhang, H., & Lai, S. (2017). Development of early warning models. Early Warning for Infectious Disease Outbreak, 35–74. https://doi.org/10.1016/b978-0-12-812343-0.00003-5
L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," in Proceedings of the IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989, doi: 10.1109/5.18626 .
Leonard E. Baum. Ted Petrie. "Statistical Inference for Probabilistic Functions of Finite State Markov Chains." Ann. Math. Statist. 37 (6) 1554 - 1563, December, 1966. https://doi.org/10.1214/aoms/1177699147
Varier, V. M., Rajamani, D. K., Goldfarb, N., Tavakkolmoghaddam, F., Munawar, A., & Fischer, G. S. (2020, August). Collaborative suturing: A reinforcement learning approach to automate hand-off task in suturing for surgical robots. In 2020 29th IEEE international conference on robot and human interactive communication (RO-MAN) (pp. 1380-1386). IEEE.
Rafii-Tari, H., Liu, J., Payne, C. J., Bicknell, C., & Yang, G. Z. (2014). Hierarchical HMM based learning of navigation primitives for cooperative robotic endovascular catheterization. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2014: 17th International Conference, Boston, MA, USA, September 14-18, 2014, Proceedings, Part I 17 (pp. 496-503). Springer International Publishing.
Hu, Z. J., Wang, Z., Huang, Y., Sena, A., y Baena, F. R., & Burdet, E. (2023). Towards Human-Robot Collaborative Surgery: Trajectory and Strategy Learning in Bimanual Peg Transfer. IEEE Robotics and Automation Letters.
Kaplan, K. E., Nichols, K. A., & Okamura, A. M. (2016, May). Toward human-robot collaboration in surgery: Performance assessment of human and robotic agents in an inclusion segmentation task. In 2016 IEEE International Conference on Robotics and Automation (ICRA) (pp. 723-729). IEEE.
Intuitive. Robotic-assisted surgery with da Vinci systems. https://www.intuitive.com/en-us/patients/da-vinci-robotic-surgery/
Published
How to Cite
Issue
Section
Copyright (c) 2024 Lucas Choi; Ross Greer
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Copyright holder(s) granted JSR a perpetual, non-exclusive license to distriute & display this article.
