Author: Mathews, Roshan P; Panicker, Mahesh Raveendranatha; Hareendranathan, Abhilash R; Chen, Yale Tung; Jaremko, Jacob L; Buchanan, Brian; Narayan, Kiran Vishnu; Kesavadas, C; Mathews, Greeta
Title: Unsupervised multi-latent space reinforcement learning framework for video summarization in ultrasound imaging Cord-id: ya1anwzu Document date: 2021_9_3
ID: ya1anwzu
Snippet: The COVID-19 pandemic has highlighted the need for a tool to speed up triage in ultrasound scans and provide clinicians with fast access to relevant information. The proposed video-summarization technique is a step in this direction that provides clinicians access to relevant key-frames from a given ultrasound scan (such as lung ultrasound) while reducing resource, storage and bandwidth requirements. We propose a new unsupervised reinforcement learning (RL) framework with novel rewards that faci
Document: The COVID-19 pandemic has highlighted the need for a tool to speed up triage in ultrasound scans and provide clinicians with fast access to relevant information. The proposed video-summarization technique is a step in this direction that provides clinicians access to relevant key-frames from a given ultrasound scan (such as lung ultrasound) while reducing resource, storage and bandwidth requirements. We propose a new unsupervised reinforcement learning (RL) framework with novel rewards that facilitates unsupervised learning avoiding tedious and impractical manual labelling for summarizing ultrasound videos to enhance its utility as a triage tool in the emergency department (ED) and for use in telemedicine. Using an attention ensemble of encoders, the high dimensional image is projected into a low dimensional latent space in terms of: a) reduced distance with a normal or abnormal class (classifier encoder), b) following a topology of landmarks (segmentation encoder), and c) the distance or topology agnostic latent representation (convolutional autoencoders). The decoder is implemented using a bi-directional long-short term memory (Bi-LSTM) which utilizes the latent space representation from the encoder. Our new paradigm for video summarization is capable of delivering classification labels and segmentation of key landmarks for each of the summarized keyframes. Validation is performed on lung ultrasound (LUS) dataset, that typically represent potential use cases in telemedicine and ED triage acquired from different medical centers across geographies (India, Spain and Canada).
Search related documents:
Co phrase search for related documents- long range and lung involvement: 1
- long short and loss function: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11
- long short and loss minimize: 1
- long short and low resource: 1, 2, 3, 4
- long short and lstm architecture: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15
- long short and lstm decoder: 1, 2, 3, 4, 5, 6
- long short and lstm long short term memory: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73
- long short and lung image: 1, 2
- long short and lung ultrasound: 1, 2, 3, 4, 5
- long short and lus lung ultrasound: 1, 2, 3, 4, 5
- long short term and loss function: 1, 2, 3, 4, 5, 6, 7, 8, 9
- long short term and loss minimize: 1
- long short term and low resource: 1, 2
- long short term and lstm architecture: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15
- loss function and lstm decoder: 1
- loss function and lstm long short term memory: 1, 2, 3, 4
- loss function and lung image: 1
- loss function and lung involvement: 1
- loss function and lung state: 1
Co phrase search for related documents, hyperlinks ordered by date