You are here

Open-i

Screen detail of OpenI Web page
Project information

The Open-ism (pronounced “open eye”) experimental multimedia search engine retrieves and displays structured MEDLINE citations augmented by image-related text and concepts and linked to images based on image features.

The Open-i project provides novel information retrieval services for biomedical articles from the full text collections such as PubMed Central. It is unique in its ability to index both the text and images in the articles. The article retrieval is powered by the LHNCBC-built search engine Essie.

The Open-I biomedical image search engine lets users retrieve not only the MEDLINE citation information, but also the outcome statements in the article and the most relevant figure from it. Further, it is possible to use the figure as a query component to find other relevant images or other visually similar images. Future stages aim to provide image region-of-interest (ROI) based querying. The initial number of images is projected to be around 600,000 and will scale to millions. The extensive image analysis and indexing and deep text analysis and indexing require distributed computing. Future plans include making the image computation services available as a NLM service.

Publications/Tools: 
Xue Z, Antani SK, Long LR, Thoma GR. Automatic multi-label annotation of abdominal CT images using CBIR. Proc. SPIE 10138, Medical Imaging 2017: Imaging Informatics for Healthcare, Research, and Applications, 1013807 (March 13, 2017); doi:10.1117/12.2254368.
Chachra S, Ben Abacha A, Shooshan SE, Rodriguez L, Demner-Fushman D. A Hybrid Approach to Generation of Missing Abstracts in Biomedical Literature. Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers: 1093-1100.
Narum R, Zou J, Antani SK. Semi-Automated Ground-Truth Data Collection and Annotation for Journal Figure Analysis. 2016 NIH Research Festival
De Herrera A, Long LR, Antani SK. Content-Based fMRI Brain Maps Retrieval. International Conference on Brain and Health Informatics, Omaha, NE, USA, October 13-16, 2016.
Xue Z, Rahman M, Antani SK, Long LR, Demner-Fushman D, Thoma GR. Modality Classification for Searching Figures in Biomedical Literature. Proceedings of the IEEE 29th International Symposium on Computer-Based Medical Systems, pp. 152-157, 2016. doi:10.1109/CBMS.2016.29.
Demner-Fushman D, Antani SK, Chachra S, Kushnir M, Gayen S. Open-i Imaging informatics, natural language processing and multi-modal information retrieval - research and development Technical Report to the LHNCBC Board of Scientific Counselors September 2016
Xue Z, Antani SK, Long LR, Demner-Fushman D, Thoma GR. Improving face image extraction by using deep learning technique. Proc. SPIE 9789, Medical Imaging 2016: PACS and Imaging Informatics: Next Generation and Innovations, 97890J (March 25, 2016); doi:10.1117/12.2216278.
Demner-Fushman D, Shooshan SE, Rodriguez L, Antani SK, Thoma GR. Annotation of Chest Radiology Reports for Indexing and Retrieval. Multimodal Retrieval in the Medical Domain 2015 (MRMD 2015), Vienna, Austria, March 29, 2015
Vajda S. Label the many with a few: Semi-automatic medical image modality discovery in a large image collection. IEEE Symposium Series on Computational Intelligence, Orlando, FL, Dec 9-12, 2014
Rahman MM, You D, Simpson MS, Antani SK, Demner-Fushman D. Interactive Cross and Multimodal Biomedical Image Retrieval Based on Automatic Region-Of-Interest (ROI) Identification and Classification. International Journal of Multimedia Information Retrieval (MMIR) 2014 Sep;3(3):131-146.

Pages