You are here


Screen detail of OpenI Web page
Project information

The Open-ism (pronounced “open eye”) experimental multimedia search engine retrieves and displays structured MEDLINE citations augmented by image-related text and concepts and linked to images based on image features.

The Open-i project provides novel information retrieval services for biomedical articles from the full text collections such as PubMed Central. It is unique in its ability to index both the text and images in the articles. The article retrieval is powered by the LHNCBC-built search engine Essie.

The Open-I biomedical image search engine lets users retrieve not only the MEDLINE citation information, but also the outcome statements in the article and the most relevant figure from it. Further, it is possible to use the figure as a query component to find other relevant images or other visually similar images. Future stages aim to provide image region-of-interest (ROI) based querying. The initial number of images is projected to be around 600,000 and will scale to millions. The extensive image analysis and indexing and deep text analysis and indexing require distributed computing. Future plans include making the image computation services available as a NLM service.

Ben Abacha A, De Herrera A, Gayen S, Demner-Fushman D, Antani SK. NLM at ImageCLEF 2017 Caption Task. CLEF (Working Notes) 2017
Xue Z, Antani SK, Long LR, Thoma GR. Automatic multi-label annotation of abdominal CT images using CBIR. Proc. SPIE 10138, Medical Imaging 2017: Imaging Informatics for Healthcare, Research, and Applications, 1013807 (March 13, 2017); doi:10.1117/12.2254368.
Chachra S, Ben Abacha A, Shooshan SE, Rodriguez L, Demner-Fushman D. A Hybrid Approach to Generation of Missing Abstracts in Biomedical Literature. Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers: 1093-1100.
Narum R, Zou J, Antani SK. Semi-Automated Ground-Truth Data Collection and Annotation for Journal Figure Analysis. 2016 NIH Research Festival
De Herrera A, Long LR, Antani SK. Content-Based fMRI Brain Maps Retrieval. International Conference on Brain and Health Informatics, Omaha, NE, USA, October 13-16, 2016.
De Herrera A, Schaer R, Antani SK, Müller H. Using Crowdsourcing for Multi-label Biomedical Compound Figure Annotation. First International Workshop, LABELS 2016, and Second International Workshop, DLMIA 2016, Held in Conjunction with MICCAI 2016, Athens, Greece, October 21, 2016.
Xue Z, Rahman M, Antani SK, Long LR, Demner-Fushman D, Thoma GR. Modality Classification for Searching Figures in Biomedical Literature. Proceedings of the IEEE 29th International Symposium on Computer-Based Medical Systems, pp. 152-157, 2016. doi:10.1109/CBMS.2016.29.
Demner-Fushman D, Antani SK, Chachra S, Kushnir M, Gayen S. Open-i Imaging informatics, natural language processing and multi-modal information retrieval - research and development Technical Report to the LHNCBC Board of Scientific Counselors September 2016
Ben Abacha A, Demner-Fushman D. Meta-Learning with Selective Data Augmentation for Medical Entity Recognition. International Journal of Computational Linguistics and Applications (IJCLA) 7(2): 167-182 (2016)
Xue Z, Antani SK, Long LR, Demner-Fushman D, Thoma GR. Improving face image extraction by using deep learning technique. Proc. SPIE 9789, Medical Imaging 2016: PACS and Imaging Informatics: Next Generation and Innovations, 97890J (March 25, 2016); doi:10.1117/12.2216278.