Modality Classification for Searching Figures in Biomedical Literature.

Xue Z, Rahman M, Antani SK, Long LR, Demner-Fushman D, Thoma GR

Proceedings of the IEEE 29th International Symposium on Computer-Based Medical Systems, pp. 152-157, 2016. doi:10.1109/CBMS.2016.29.

---

Abstract:

Image modality classification categorizes images according to their type. It is an important module in the Open-iSM multimodal (text+image) search engine that retrieves figures from biomedical articles. It is a hierarchical classification where on the top level the input figures are classified into two general categories: regular images (X-ray, CT, MRI, photographs, etc.) vs. illustration images (cartoon sketch, charts, graphs, etc.). This binary classification task is challenged by the vast diversity of visual material (image type), and the way it is organized (simple or compound figures). We present two methods for this binary classification: (i) Support Vector Machines (SVM) with manually-selected features, including a feature based on semantic concepts, and, (ii) Deep Learning method which avoids the process of feature handcrafting. Both methods were tested and compared on a dataset of 16400 figures. Both methods achieved good performance (above 95% accuracy). The slightly better performance of the feature-based method demonstrates the effectiveness of the features we chose.

Xue Z, Rahman M, Antani SK, Long LR, Demner-Fushman D, Thoma GR. Modality Classification for Searching Figures in Biomedical Literature. 
Proceedings of the IEEE 29th International Symposium on Computer-Based Medical Systems, pp. 152-157, 2016. doi:10.1109/CBMS.2016.29.

PDF | URL: https://www.computer.org/csdl/proceedings/cbms/2016/9036/00/9036a152-abs.html