Lexical Tools

Regression Test on Flows & Options Unit

I. Setup testing environment

  • Install Lexical Tools on testing computer
    • shell> cp lvg${YEAR}.tgz ${PROJECT}
    • shell> cd ${PROJECT}
    • shell> gtar -xzvf lvg${YEAR}.tgz
    • shell> cd lvg${YEAR}
    • shell> ./install/bin/install_linux-i586.sh
  • Update Configuration file
    • Update $LVG_DIR in ${PROJECT}/lvg${YEAR}/data/config/lvg.properties.hsql
  • Update Test Input data & Scripts
    • Update ${TEST}/LVG/UnitTest/data/${YEAR}/Input
      => copy ${TEST_DATA}/${PRE_YEAR}/Input to ${TEST_DATA}/${YEAR}/Input

II. Test Flows

  • shell> cd $${TEST}/LVG/UnitTest/bin
  • shell> TestFlows
  • Copy the Output_Standard directory from last year
  • shell> AnalyzeFlows
    • Compare HSql to MySql
    • Compare data from this year to last year

    • Check file under ${TEST}/LVG/UnitTest/data/${YEAR}/Report
    • See details in file under ${TEST}/LVG/UnitTest/data/${YEAR}/Diff
  • Flows with possible different results due to data changes (Lexicon)
    • -f:fa => Generate known acronym expansions
    • -f:A => Generate known acronyms
    • -f:An => Generate antiNorm
    • -f:b => Uninflect the input term
    • -f:B => Uninflect words
    • -f:Bn => Normalized Uninflect words
    • -f:C => Canonicalize
    • -f:d => Generate derivational variants
    • -f:dc => Generate derivational variants, specifying output categories
    • -f:e => Retrieve uninflected spelling variants
    • -f:E => Retrieve Eui
    • -f:f => Filter output
    • -f:G => Generate fruitful variants
    • -f:Ge => Fruitful variants, enhanced
    • -f:Gn => Generate known fruitful variants
    • -f:i => Generate inflectional variants
    • -f:ici => Generate inflectional variants, specifying output categories and inflection
    • -f:is => Generate inflectional variants (simple infl)
    • -f:L => Retrieve category and inflection
    • -f:Ln => Retrieve category and inflection from database
    • -f:nom => Retrieve nominalizations
    • -f:N => Normalize
    • -f:N3 => LuiNormalize
    • -f:R => Recursive derivations
    • -f:r => Recursive synonyms
    • -f:s => Generate spelling variants
    • -f:v => Generate fruitful variants from database
    • -f:y => Generate synonyms

III. Test Options

  • shell> cd ${TEST}/LVG/UnitTest/bin
  • shell> TestOptions
  • shell> AnalyzeOptions
    • Compare HSql to MySql
    • Compare data from this year to last year

    • Check file under ${TEST}/LVG/UnitTest/data/${YEAR}/Report
      => -ci will be different
    • See details in file under ${TEST}/LVG/UnitTest/data/${YEAR}/Diff
  • Options with possible different results due to data changes (Lexicon)
    • -ci => Show configuration information
    • -d => Displays details status for each transformation
    • -kd:1 => Restricts the output generated from the derivation facts
    • -kd:2 => Restricts the output generated from the derivation rules
    • -kd:3 => Restricts the output generated from the derivation facts then rule
    • -kdn:O => Restricts derivation negations to Otherwise
    • -kdn:N => Restricts derivation negations to Negative
    • -kdn:B => Restricts derivation negations to Both Negative and Otherwise
    • -kdt:S => Restricts derivation types to suffixD
    • -kdt:ZS => Restricts derivation types to ZeroD and suffixD
    • -kdt:SP => Restricts derivation types to suffixD and prefixD
    • -kdt:ZSP => Restricts derivation types to zeroD, suffixD and prefixD
    • -m => Displays extra information for mutation
    • -v => Returns the current verion identification of Lvg
    • -x => Loading an alternative configuration file