Respiratory Motion Prediction Using Deep Convolutional Long Short-Term Memory Network

Shahabedin Nabavi, Monireh Abdoos, Mohsen Ebrahimi Moghaddam, Mohammad Mohammadi

DOI: 10.4103/jmss.JMSS_38_19

Abstract


Background: Pulmonary movements during radiation therapy can cause damage to healthy tissues. It is necessary to adapt treatment planning based on tumor motion to avoid damage to healthy tissues. A range of approaches has been proposed to monitor the issue. A treatment planning based on fourdimensional computed tomography (4D CT) images can be addressed as one of the most achievable options. Although several methods proposed to predict pulmonary movements based on mathematical algorithms, the use of deep artificial neural networks has recently been considered. Methods: In the current study, convolutional long shortterm memory networks are applied to predict and generate images throughout the breathing cycle. A total of 3295 CT images of six patients in three different views was considered as reference images. The proposed method was evaluated in six experiments based on a leaveonepatientout method similar to crossvalidation. Results: The weighted average results of the experiments in terms of the rootmeansquared error and structural similarity index measure are 9 * 10^-3 and 0.943, respectively. Conclusion: Utilizing the proposed method, because of its generative nature, which results in the generation of CT images during the breathing cycle, improves the radiotherapy treatment planning in the lack of access to 4D CT images.


Keywords


Convolutional long short-term memory, deep neural network, lung motion, radiotherapy, respiratory motion prediction

Full Text:

PDF

References


Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A, et al. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 2018;68:394-424. Back to cited text no. 1

Korreman SS. Image-guided radiotherapy and motion management in lung cancer. Br J Radiol 2015;88:20150100. Back to cited text no. 2

Keall P. 4-dimensional computed tomography imaging and treatment planning. Semin Radiat Oncol 2004;14:81-90. Back to cited text no. 3

Ehrhardt J. 4D modeling and estimation of respiratory motion for radiation therapy. Lorenz C, editor. Berlin: Springer; 2013. Back to cited text no. 4

Verma P, Wu H, Langer M, Das I, Sandison G. Survey: Real-time tumor motion prediction for image-guided radiation treatment. Comput Sci Eng 2010;13:24-35. Back to cited text no. 5

Cerviño LI, Jiang Y, Sandhu A, Jiang SB. Tumor motion prediction with the diaphragm as a surrogate: A feasibility study. Phys Med Biol 2010;55:N221-9. Back to cited text no. 6

Riaz N, Shanker P, Wiersma R, Gudmundsson O, Mao W, Widrow B, et al. Predicting respiratory tumor motion with multi-dimensional adaptive filters and support vector regression. Phys Med Biol 2009;54:5735-48. Back to cited text no. 7

Ruan D, Fessler JA, Balter JM. Real-time prediction of respiratory motion based on local regression methods. Phys Med Biol 2007;52:7137-52. Back to cited text no. 8

Sharp GC, Jiang SB, Shimizu S, Shirato H. Prediction of respiratory tumour motion for real-time image-guided radiotherapy. Phys Med Biol 2004;49:425-40. Back to cited text no. 9

Vedam SS, Keall PJ, Docef A, Todor DA, Kini VR, Mohan R. Predicting respiratory motion for four-dimensional radiotherapy. Med Phys 2004;31:2274-83. Back to cited text no. 10

Werner R, Ehrhardt J, Schmidt R, Handels H. Patient-specific finite element modeling of respiratory lung motion using 4D CT image data. Med Phys 2009;36:1500-11. Back to cited text no. 11

McClelland JR, Hawkes DJ, Schaeffter T, King AP. Respiratory motion models: A review. Med Image Anal 2013;17:19-42. Back to cited text no. 12

Isaksson M, Jalden J, Murphy MJ. On using an adaptive neural network to predict lung tumor motion during respiration for radiotherapy applications. Med Phys 2005;32:3801-9. Back to cited text no. 13

Ren Q, Nishioka S, Shirato H, Berbeco RI. Adaptive prediction of respiratory motion for motion compensation radiotherapy. Phys Med Biol 2007;52:6651-61. Back to cited text no. 14

Goodband JH, Haas OC, Mills JA. A comparison of neural network approaches for on-line prediction in IGRT. Med Phys 2008;35:1113-22. Back to cited text no. 15

Murphy MJ, Pokhrel D. Optimization of an adaptive neural network to predict breathing. Med Phys 2009;36:40-7. Back to cited text no. 16

Lee SJ, Motai Y, Murphy M. Respiratory motion estimation with hybrid implementation of extended Kalman filter. IEEE Trans Industr Electron 2012;59:4421-32. Back to cited text no. 17

Rostampour N, Jabbari K, Esmaeili M, Mohammadi M, Nabavi S. Markerless respiratory tumor motion prediction using an adaptive neuro-fuzzy approach. J Med Signals Sens 2018;8:25-30. Back to cited text no. 18

[PUBMED] [Full text]

LeCun Y, Bengio Y, Hinton G. Deep learning. Nature 2015;521:436-44. Back to cited text no. 19

Kai J, Fujii F, Shiinoki T, editors. Prediction of Lung Tumor Motion Based on Recurrent Neural Network. 2018 IEEE International Conference on Mechatronics and Automation (ICMA). IEEE; 2018. Back to cited text no. 20

Lin H, Shi C, Wang B, Chan MF, Tang X, Ji W, et al. Towards real-time respiratory motion prediction based on long short-term memory neural networks. Phys Med Biol 2019;64:085010. Back to cited text no. 21

Park S, Lee SJ, Weiss E, Motai Y. Intra- and inter-fractional variation prediction of lung tumors using fuzzy deep learning. IEEE J Transl Eng Health Med 2016;4:1-12. Back to cited text no. 22

Wang R, Liang X, Zhu X, Xie Y. A feasibility of respiration prediction based on deep Bi-LSTM for real-time tumor tracking. IEEE Access 2018;6:51262-8. Back to cited text no. 23

Greff K, Srivastava RK, Koutnik J, Steunebrink BR, Schmidhuber J. LSTM: A Search space Odyssey. IEEE Trans Neural Netw Learn Syst 2017;28:2222-32. Back to cited text no. 24

Shirato H, Shimizu S, Kunieda T, Kitamura K, van Herk M, Kagei K, et al. Physical aspects of a real-time tumor-tracking system for gated radiotherapy. Int J Radiat Oncol Biol Phys 2000;48:1187-95. Back to cited text no. 25

Finn C, Goodfellow I, Levine S. Unsupervised learning for physical interaction through video prediction. In Advances in neural information processing systems; 2016. p. 64-72. Back to cited text no. 26

Lotter W, Kreiman G, Cox D. Unsupervised Learning of Visual Structure Using Predictive Generative Networks. CoRR; 2015. Back to cited text no. 27

Lotter W, Kreiman G, Cox D. Deep Predictive Coding Networks for Video Prediction and Unsupervised Learning. International Conference on Learning Representations. (ICLR); 2017. Back to cited text no. 28

Mathieu M, Couprie C, LeCun Y. Deep Multi-Scale Video Prediction Beyond Mean Square Error. International Conference on Learning Representations (ICLR); 2015. Back to cited text no. 29

Ranzato M, Szlam A, Bruna J, Mathieu M, Collobert R, Chopra S. Video (Language) Modeling: A Baseline for Generative Models of Natural Videos. CoRR; 2014. Back to cited text no. 30

Srivastava N, Mansimov E, Salakhudinov R, editors. Unsupervised Learning of Video Representations Using Lstms. International Conference on Machine Learning; 2015. Back to cited text no. 31

Xue T, Wu J, Bouman K, Freeman B, editors. Visual Dynamics: Probabilistic Future Frame Synthesis Via Cross Convolutional Networks. Advances in Neural Information Processing Systems; 2016. Back to cited text no. 32

Vandemeulebroucke J, Sarrut D, Clarysse P, editors. The POPI-Model, A Point-Validated Pixel-Based Breathing Thorax Model. XVth International Conference on the use of Computers in Radiation Therapy. (ICCR); 2007. Back to cited text no. 33

Xingjian S, Chen Z, Wang H, Yeung DY, Wong WK, Woo WC, editors. Convolutional LSTM Network: A Machine Learning Approach for Precipitation Now Casting. Advances in Neural Information Processing Systems; 2015. Back to cited text no. 34

Kingma DP, Ba J. Adam: A Method for Stochastic Optimization. CoRR; 2014. Back to cited text no. 35

Keras CF; 2016. Available from: http://keras.io/. [Last accessed on 2019 Apr 20]. Back to cited text no. 36

Kohavi R, editor A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection. Montreal, Canada: IJCAI; 1995. Back to cited text no. 37

Wang Z, Bovik AC, Sheikh HR, Simoncelli EP. Image quality assessment: From error visibility to structural similarity. IEEE Trans Image Process 2004;13:600-12. Back to cited text no. 38

Yamamoto T, Langner U, Loo BW Jr., Shen J, Keall PJ. Retrospective analysis of artifacts in four-dimensional CT images of 50 abdominal and thoracic radiotherapy patients. Int J Radiat Oncol Biol Phys 2008;72:1250-8. Back to cited text no. 39


Refbacks

  • There are currently no refbacks.


 

  https://e-rasaneh.ir/Certificate/22728

https://e-rasaneh.ir/

ISSN : 2228-7477