Author: Kweon, Jihoon; Kim, Kyunghwan; Lee, Chaehyuk; Kwon, Hwi; Park, Jinwoo; Song, Kyoseok; Kim, Young In; Park, Jeeone; Back, Inwook; Roh, Jae-Hyung; Moon, Youngjin; Choi, Jaesoon; Kim, Young-Hak
Title: Deep reinforcement learning for guidewire navigation in coronary artery phantom Cord-id: 0unvmj2y Document date: 2021_10_5
ID: 0unvmj2y
Snippet: In percutaneous intervention for treatment of coronary plaques, guidewire navigation is a primary procedure for stent delivery. Steering a flexible guidewire within coronary arteries requires considerable training, and the non-linearity between the control operation and the movement of the guidewire makes precise manipulation difficult. Here, we introduce a deep reinforcement learning(RL) framework for autonomous guidewire navigation in a robot-assisted coronary intervention. Using Rainbow, a se
Document: In percutaneous intervention for treatment of coronary plaques, guidewire navigation is a primary procedure for stent delivery. Steering a flexible guidewire within coronary arteries requires considerable training, and the non-linearity between the control operation and the movement of the guidewire makes precise manipulation difficult. Here, we introduce a deep reinforcement learning(RL) framework for autonomous guidewire navigation in a robot-assisted coronary intervention. Using Rainbow, a segment-wise learning approach is applied to determine how best to accelerate training using human demonstrations with deep Q-learning from demonstrations (DQfD), transfer learning, and weight initialization. `State' for RL is customized as a focus window near the guidewire tip, and subgoals are placed to mitigate a sparse reward problem. The RL agent improves performance, eventually enabling the guidewire to reach all valid targets in `stable' phase. Our framework opens anew direction in the automation of robot-assisted intervention, providing guidance on RL in physical spaces involving mechanical fatigue.
Search related documents:
Co phrase search for related documents- accurate rapid and machine learning: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24
- accurate rapid and machine learning area: 1
- accurate rapid identification and machine learning: 1, 2, 3, 4
- accurately mimic and machine learning: 1
Co phrase search for related documents, hyperlinks ordered by date