Performance Tests on Dictionaries

I. Introduction

Performance tests are conducted on different dictionaries for finding the (best performance) dictionary for CSpell. Both original and revised gold standard of the training set are tested.

II. Setup

• Program: ${C_SPELL}/PostProcess/bin/PerformanceTest
• Data: ${C_SPELL}/PostProcess/data/Test/Baseline

III. Performance Results on Training Set

The ranking method chosen is the basic orthographic similarity (in Dec., 2017). At the time of test, no sophisticated ranking method was developed yet because ranking development was planed after the dictionary generation. Thus, recall are chosen over precision for developing the algorithm of generating dictionary. This result is not the final performance of CSpell. However, this setup was used as the base for a systematic approach of generating the dictionary for CSpell release.

• * LexcionE: use Lexicon, with Aa, unit, and Mw (includes spVar and Pn)
• ** Combo1: use LexcionE, with replacing suggDic by baseline (eng_med.dic)
• *** Combo2: use LexcionE+Medline, with replacing suggDic by baseline (eng_med.dic)
• *4* cSpell-1 (All, Med): use LexcionE, with replacing suggDic by Lexicon.enEwLc.dic.AddRm + UMLS_ST (Med.dic, All)
• *5* cSpell-1 (Medline, Med): use LexcionE, with replacing suggDic by Lexicon.enEwLc.dic.AddRm + UMLS_ST (Med.dic, All and existed in Medline)
• *6* cSpell-1 (Medline, Med): use LexcionE, with replacing suggDic by Lexicon + UMLS_ST (EngMed.dic)