Performance Test

I. Software Quality Assurance

The performance test suite on lexAccess was set up since 2007 version. JavaDb is added and test its performance in 2008. Due to the slow performance, Java DB is dropped in 2009. This test suite tests on:

• Performance
• Quality assurance

Below are the detail descriptions on lexAccess Performance test:

I. Test Procedures

• create directory ${TEST}/LA/PerformanceTest/data/${YEAR}

  shell> cd ${TEST}/LA/PerformanceTest/data
  shell> mkdir 2012
  	

• link 5 files from $TEST/LVG/PerformanceTest/data/${YEAR}/Input
  • test.in.100
  • test.in.10000
  • test.in
  • lexiconTerms.data
  • meta.data

  shell> cd ${TEST}/LA/PerformanceTest/data/2012
  shell> mkdir Input
  shell> cd Input
  shell> ln -sf /export/home/lu/Test/LVG/PerformanceTest/data/2012/Input/test.in.100 test.in.100
  shell> ln -sf /export/home/lu/Test/LVG/PerformanceTest/data/2012/Input/test.in.10000 test.in.10000
  shell> ln -sf /export/home/lu/Test/LVG/PerformanceTest/data/2012/Input/test.in test.in
  shell> ln -sf /export/home/lu/Test/LVG/PerformanceTest/data/2012/Input/lexiconTerms.data lexiconTerms.data 
  shell> ln -sf /export/home/lu/Test/LVG/PerformanceTest/data/2012/Input/meta.data meta.data
  	

• update top LA directory in the config file. lexAccess.property.hsql
• update ${YEAR} in ${TEST}/LA/PerformanceTest/data/${YEAR}/Input/script/testCaseAll
• update ${TEST}/LA/PerformanceTest/bin/PerformanceTest (if needed)
• update ${TEST}/LA/PerformanceTest/bin/testAll (if needed)
• run ${TEST}/LVG/PerformanceTest/bin/testAll or
• run ${TEST}/LVG/PerformanceTest/bin/PerformanceTest (just for 1 DB, HSqlDb)

  The test can be performed on software versions and year of data.

II. Quality assurance

Compare the results for all above 5 files for different database, such as HSqlDb and JavaDb. The results of these two databases are under:

• ${TEST}/LA/PerformanceTest/data/${YEAR}/Output_HSql
• ${TEST}/LA/PerformanceTest/data/${YEAR}/Output_JavaDb

III. Performance Test results

From the results, we conclude:

• The outputs of HSqlDb and JavaDb are the same
• The performance of HSqlDb is about 1~2 magnitude faster than JavaDb