Sub-Term Mapping Tools

All Terms with SMT synonyms lsit

The setup of thsi test are described as follows:

  • Input Terms: all terms from UMLS-Core:
    • Original ID|TERM|CUI: 15,447
    • Total term with multi-CUI: 35
    • Total term with multi-ID: 1,492
    • It has been modified to 13,077 input TERM|CUI.

  • SMT model:
    • Lexicon, 2013
    • Meta-thesaurus, 2013AA
    • Synonyms list: SMT 2013

Test IDSynonymslvg flowNo Sub.1 Sub.2 Sub.PrecisionRecallF1-measureMetaMap
Distance
Score
SMTSMT synonyms 78.23% (10,230)4.74% (620)0.31% (40)63.48%77.52%0.6980N/A
SMT_sSMT synonyms + s 78.23% (10,230)5.00% (654)0.34% (45)63.44%77.76%0.6987N/A
SMT_iSMT synonyms + i 78.23% (10,230)4.76% (623)0.31% (40)63.47%77.53%0.6980N/A
SMT_ySMT synonyms + y 78.23% (10,230)4.74% (620)0.31% (40)63.48%77.52%0.6980N/A
SMT_ASMT synonyms + A 78.23% (10,230)6.35% (830)0.63% (82)63.52%79.64%0.7067N/A
SMT_aSMT synonyms + a 78.23% (10,230)6.42% (840)0.68% (89)63.50%79.71%0.7069N/A
SMT_dSMT synonyms + d 78.23% (10,230)5.21% (681)0.42% (55)63.37%77.99%0.6992N/A
SMT_GeSMT synonyms + Ge 78.23% (10,230)7.33% (959)0.89% (117)62.63%80.65%0.7050N/A

  • Precision = relevant, retrieved / total retrieved
  • Recall = relevant, retrieved / total relevant
  • F1 = (2 x Precision x Recall) / (Precision + Recall)
    precision and recall are equally important, so use F1 (β = 1)