A Study of Assistive Robotics in Simulation Environment

Authors

  • Ava Shi Palo Alto High School

DOI:

https://doi.org/10.47611/jsrhs.v12i1.4183

Keywords:

Assistive Robotic, Reinforcement Learning , Assistive Gym , OpenAI Gym , Physics Simulator ,PyBullet, RLlib , Healthcare ,

Abstract

As the demand for caregiving increases, robots hold significant promise to provide improvements in the quality of life for millions worldwide. While previous research has provided baseline learning environments, this experiment investigates the adaptability of control policies in new environments more realistic to real world applications. Using Assistive Gym, an open source physics simulation framework for the study, the 6 commercial robots were trained with control policies, then in a customized bed/bathing environment with varying bed positions and multi robot reaching environment with cooperative reinforcement learning. 

Downloads

Download data is not yet available.

References or Bibliography

Admin. (2022, March 21). Bullet real-time physics simulation. Bullet RealTime Physics Simulation. Retrieved January 2, 2023, from https://pybullet.org/wordpress/

Anatomy, patient positioning - StatPearls - NCBI Bookshelf. (n.d.). Retrieved January 3, 2023, from https://www.ncbi.nlm.nih.gov/books/NBK513320/

Bullet real-time physics simulation. Bullet RealTime Physics Simulation. (n.d.). Retrieved January 2, 2023, from https://pybullet.org/wordpress/index.php/forum-2/

Centers for Disease Control and Prevention. (2022, October 28). Disability impacts all of us infographic. Centers for Disease Control and Prevention. Retrieved January 2, 2023, from https://www.cdc.gov/ncbddd/disabilityandhealth/infographic-disability-impacts-all.html

Erickson, Z., Gangaram, V., Kapusta, A., Liu, C. K., & Kemp, C. C. (2019, October 10). Assistive gym: A physics simulation framework for assistive robotics. arXiv.org. Retrieved January 2, 2023, from https://arxiv.org/abs/1910.04700

Gazebo. (n.d.). Retrieved January 2, 2023, from https://gazebosim.org/

Google. (n.d.). Google colaboratory. Google Colab. Retrieved January 2, 2023, from https://colab.research.google.com/drive/1NPWZNFpB9NCgTQpbwM78jVHJAC7q_0oR?usp=sharing

Healthcare-Robotics. (n.d.). 6. creating a new assistive environment · Healthcare-Robotics/Assistive-Gym Wiki. GitHub. Retrieved January 2, 2023, from https://github.com/Healthcare-Robotics/assistive-gym/wiki/6.-Creating-a-New-Assistive-Environment

Healthcare-Robotics. (n.d.). Healthcare-Robotics/Assistive-Gym: Assistive Gym, a physics-based simulation framework for physical human-robot interaction and robotic assistance. GitHub. Retrieved January 2, 2023, from https://github.com/Healthcare-Robotics/assistive-gym

Isaac Sim. NVIDIA Developer. (2022, December 30). Retrieved January 2, 2023, from https://developer.nvidia.com/isaac-sim

Kwiatkowski, A., Alvarado, E., Kalogeiton, V., Liu, C. K., Pettré, J., van de Panne, M., & Cani, M.-P. (2022, March 7). A survey on reinforcement learning methods in character animation. arXiv.org. Retrieved January 2, 2023, from https://arxiv.org/abs/2203.04735

Körber, M., Lange, J., Rediske, S., Steinmann, S., & Glück, R. (2021, March 8). Comparing popular simulation environments in the scope of Robotics and Reinforcement Learning. arXiv.org. Retrieved January 2, 2023, from https://arxiv.org/abs/2103.04616

Mujoco. MuJoCo. (n.d.). Retrieved January 2, 2023, from https://mujoco.org/

Ray 2.2.0. RLlib: Industry-Grade Reinforcement Learning - Ray 2.2.0. (n.d.). Retrieved January 2, 2023, from https://docs.ray.io/en/latest/rllib/index.html

Reinforcement learning for robot research: A comprehensive review and ... (n.d.). Retrieved January 3, 2023, from https://journals.sagepub.com/doi/abs/10.1177/17298814211007305

Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017, August 28). Proximal policy optimization algorithms. arXiv.org. Retrieved January 2, 2023, from https://arxiv.org/abs/1707.06347

Webots. Webots: robot simulator. (n.d.). Retrieved January 2, 2023, from https://cyberbotics.com/

Welcome to spinning up in deep rl!¶. Welcome to Spinning Up in Deep RL! - Spinning Up documentation. (n.d.). Retrieved January 2, 2023, from https://spinningup.openai.com/en/latest/

Wikimedia Foundation. (2022, December 12). Reinforcement learning. Wikipedia. Retrieved January 2, 2023, from https://en.wikipedia.org/wiki/Reinforcement_learning

Ye, R., Xu, W., Fu, H., Jenamani, R. K., Nguyen, V., Lu, C., Dimitropoulou, K., & Bhattacharjee, T. (2022, October 19). RCareWorld: A human-centric simulation world for Caregiving Robots. arXiv.org. Retrieved January 2, 2023, from https://arxiv.org/abs/2210.10821

Published

02-28-2023

How to Cite

Shi, A. (2023). A Study of Assistive Robotics in Simulation Environment. Journal of Student Research, 12(1). https://doi.org/10.47611/jsrhs.v12i1.4183

Issue

Section

HS Research Projects