The SPECIALIST Lexicon

Old Validatation on LEXICON.release (before 2014)

Validate following of LEXICON.release:

  • Check Irreg Base:

    Check irreg in lexRecords:

    • shell> cp -p ${LEXICON}.release $LEX_BUILD/data/WebApp/Outputs/Lexicon/LEXICON
    • shell> ${LEX_BUILD}/Tools/PostProcessing/CheckIrreg
    • Compare output file (irreg.data) with exceptions from previous year (${LEX_BUILD}/data/WebApp/Outputs/PostProc/IrregExceptions/*)
    • Send the rest to Allen for the verification
  • Check cross-Ref:
    Cross-Ref (skip this step if it's checked before LEXICON was generated, unless there is a change on the source code).
    • Load release data into LB database
    • shell> cp -p ${LEXICON}.release $LEX_BUILD/data/WebApp/Outputs/Lexicon/LEXICON
    • shell> ${LEX_BUILD}/Tools/PostProcessing/ProcCrossRef
      ------------------------------------
      Which Program ?
      1) GenerateAcrAbbNomRecords
      2) CheckCrossRef
      3) AnaylyzeData
      ------------------------------------
      1
      2
      3->1,2,3
    • Check the word count (wc) of output files under under abb/ acr/ nom/:
      • missCat.data: manually fixed (auto fixed)
      • missEui.data: manually fixed (auto fixed)
      • noBaseField.data: manually fixed
      • noEui.data: send to Allen (records should be added to LEXICON)
      • noCat.data: manually fixed (auto fixed)
      • noRecFound.data: send to Allen (deleted line if caused by deleted records)
      • notSym.data: manually fixed (auto fixed)
      • others.data: should be 0
      • wrongCatCase.data: should be 0
      • wrongCat.data: should be 0
      • wrongEui.data: send to Allen (duplicated records)

      • dup.data: send to Allen (duplicated records)
    • Update exceptions under exceptions/
    • Please refer to design docs for details