Lexical Tools

Performance Test

The performance of lvg, norm, and luiNorm has been improved over years by the following factors:

  • Java source code optimization
  • Faster database server (IDB -> MySql -> HSqlDb)
  • Faster JDBC
  • Faster platform (Unix -> Linux)
    • cat /etc/redhat-release
    • cat /proc/cpuinfo | grep "model name"
    • free -mh

Flatform Spec:

  • OS: shell> cat /etc/redhat-release
  • shell> uname -a
  • Processsor: shell> sudo dmidecode
  • Memory: shell> free -m
  • Preparation:
    shell> cd ${TEST}/LVG/PerformanceTest/data/
    shell> mkdir ${YEAR}
    shell> cd ${YEAR}
    shell> cp -rp ../${PREV_YEAR}/Input .
    shell> cd script
    shell> edit * (change ${PRE_YEAR} to ${YEAR})
    
  • Run Test (on lexdev):
    shell> cd ${TEST}/LVG/PerformanceTest/bin/
    shell> TestAll
    ${YEAR}
       3
    => It takes 3 hrs to complete
    => Update results to perfoamcne test web page (below)
    

There are lots of new enhanced features implemented since 2005 version. In terms of performance, it's not a fair comparison to compare 2005 release to previous versions. Tables below shows performance test for norm and luiNorm.

I. norm

 Test Environment10000 Records1462203 Records (2002 Metathesaurus)
C 1_84h
  • Unix, Sun, Ultra-60, Solaris 5.9 Sparc
49.30u 1.20s 1:23.44 60.5% 13940.62u 463.66s 4:03:09.21 98.7%
2002
  • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
  • MySql-3.22.25
  • mm.mysql-2.0.6
125.92u 31.92s 3:15.09 80.9% 32389.38u 14391.48s 15:49:45.63 6.7%
2003
  • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
  • MySql-3.22.25
  • mm.mysql-2.0.6
38.88u 3.45s 1:25.73 49.3% 9473.60u 857.01s 4:51:54.42 58.9%
2002
(New Db)
  • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
  • MySql-4.0.14
  • mysql-connector-java-3.0.8
121.99u 49.07s 2:59.40 95.3% 41161.97u 16654.78s 16:39:33.94 96.4%
2003
(New Db)
  • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
  • MySql-4.0.14
  • mysql-connector-java-3.0.8
23.47u 2.79s 0:34.49 76.1% 5443.99u 706.17s 2:13:54.79 76.5%
2004
  • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
  • MySql-4.0.14
  • mysql-connector-java-3.0.8
32.92u 5.20s 0:53.48 71.2% 7679.98u 1468.95s 3:33:16.22 71.4%
2005
  • Red Hat 2.4.21-20, Pentium 3.4GHz, 2 Gb Ram
  • HSqlDb 1.7.2
13.420u 1.950s 0:41.62 36.9% 3578.770u 52.330s 1:15:38.22 80.0%
2006
  • Red Hat 2.4.9-11, Pentium 3.4GHz, 2 Gb Ram
  • HSqlDb 1.8.0
10.679u 0.544s 0:11.37 98.5% 2153.353u 66.258s 38:40.24 95.6%
2007
  • Red Hat 2.4.9-11, Pentium 3.4GHz, 2 Gb Ram
  • HSqlDb 1.8.0.4
11.208u 0.569s 0:11.81 99.5% 2764.469u 72.222s 47:56.29 98.6%
2008
  • Red Hat 2.4.9-11, Pentium 3.4GHz, 2 Gb Ram
  • HSqlDb 1.8.0.7
11.531u 0.484s 0:12.00 100.0% 2820.537u 59.690s 48:58.33 98.0%
2009
  • Red Hat 4, 2.6.9-78, Intel-Xeon 3.8GHz, 4 Gb Ram
  • HSqlDb 1.8.0.10
9.829u 0.451s 0:09.83 104.4% 2185.478u 54.586s 37:18.94 100.0%
2010
  • Red Hat 5.4, 2.6.18-164.6.1.el5, Intel-Xeon 3333MHz, 4 Gb Ram
  • HSqlDb 1.8.0.10
8.232u 0.278s 0:06.23 136.4% 2728.102u 65.741s 47:04.88 98.9%
2011
  • Red Hat 5.5, 2.6.18-194.8.1.el5, Intel-Xeon 3333MHz, 4 Gb Ram
  • HSqlDb 2.0.0
9.923u 0.389s 0:07.30 141.0% 3211.376u 41.357s 53:42.04 100.9%
2012
  • Red Hat 5.7, 2.6.18-274.7.1.el5, Intel-Xeon 3333MHz, 4 Gb Ram
  • HSqlDb 2.2.5
12.284u 0.411s 0:07.50 169.2% 3241.635u 41.307s 54:16.55 100.8%
2013 (lexlx1)
  • Red Hat Enterprise Linux Client release 5.5 (Tikanga), 2.6.18-308.13.1.el5, Intel-Xeon 3333MHz, 4 Gb Ram
  • HSqlDb 2.2.8
9.569u 0.425s 0:07.36 135.5% 3025.799u 41.657s 50:33.35 101.1%
2013 (lexdev)
  • Red Hat Enterprise Linux Workstation release 6.3 (Santiago), 16 Gb Ram
  • HSqlDb 2.2.8
15.949u 1.074s 0:08.47 200.8% 3193.846u 91.376s 50:09.72 109.1%
2014 (lexdev)
  • Red Hat Enterprise Linux Workstation release 6.4 (Santiago)
  • Intel(R) Xeon(R) CPU E5506 @ 2.13GHz, 16 Gb Ram
  • HSqlDb 2.3.0
15.700u 0.965s 0:08.76 190.1% 4140.662u 81.331s 1:06:21.30 106.0%
2015 (lexdev)
  • Red Hat Enterprise Linux Workstation release 6.5 (Santiago)
  • Intel(R) Xeon(R) CPU E5506 @ 2.13GHz, 48 Gb Ram
  • HSqlDb 2.3.2
16.913u 0.884s 0:09.15 194.4% 4205.883u 81.314s 1:17:34.76 92.1%
2016 (lexdev)
  • Red Hat Enterprise Linux Workstation release 6.7 (Santiago)
  • Intel(R) Xeon(R) CPU E5506 @ 2.13GHz, 48 Gb Ram
  • HSqlDb 2.3.2
23.087u 1.274s 0:11.83 205.8% 3849.117u 78.864s 1:03:44.79 102.6%
2017 (lexdev)
  • Red Hat Enterprise Linux Workstation release 6.8 (Santiago)
  • Intel(R) Xeon(R) CPU E5506 @ 2.13GHz, 48 Gb Ram
  • HSqlDb 2.3.4
20.379u 1.588s 0:33.90 64.7% 4034.125u 91.207s 1:05:53.30 104.3%
2018 (lexdev)
  • Red Hat Enterprise Linux Workstation release 6.9 (Santiago)
  • Intel(R) Xeon(R) CPU E5506 @ 2.13GHz, 48 Gb Ram
  • HSqlDb 2.3.4
20.419u 1.463s 0:45.53 48.0% 4176.833u 95.576s 1:10:50.56 100.5%
2019 (lexdev)
  • Red Hat Enterprise Linux Workstation release 7.5 (Maipo)
  • Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz, 132 Gb Ram
  • HSqlDb 2.4.1
21.848u 1.734s 0:31.50 74.8% 4037.390u 172.752s 1:02:56.82 111.4%
2020 (lexdev)
  • Red Hat Enterprise Linux Workstation release 7.7 (Maipo)
  • Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz, 132 Gb Ram
  • HSqlDb 2.5.0
22.340u 0.918s 0:06.79 342.4% 4080.065u 120.517s 1:02:46.40 111.5%
2021 (lexdev)
  • Red Hat Enterprise Linux Workstation release 7.9 (Maipo)
  • Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz, 132 Gb Ram
  • HSqlDb 2.5.1
22.078u 0.981s 0:06.99 329.7% 4087.465u 179.675s 1:04:27.46 110.3%
2022 (lexdev)
  • Red Hat Enterprise Linux Workstation release 7.9 (Maipo)
  • Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz, 132 Gb Ram
  • HSqlDb 2.5.1
19.665u 1.031s 0:07.23 286.1% 4026.615u 179.014s 1:03:23.66 110.5%
2023 (lexdev)
  • Red Hat Enterprise Linux Workstation release 7.9 (Maipo)
  • Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz, 132 Gb Ram
  • HSqlDb 2.7.0-jdk8
19.620u 1.490s 1:02.21 33.9% 4084.113u 131.671s 1:03:08.77 111.2%
2024 (lexdev)
  • Red Hat Enterprise Linux Workstation release 7.9 (Maipo)
  • Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz, 128 Gb Ram
  • HSqlDb 2.7.2-jdk8
18.363u 0.795s 0:06.60 290.1% 4102.914u 123.212s 1:03:27.20 111.0%

II. luiNorm

Test dataTest Environment10000 Records1462203 Records (2002 Metathesaurus)
C 1_84h
  • Unix, Sun, Ultra-60, Solaris 5.9 Sparc
52.01u 1.78s 1:35.58 56.2% 14394.76u 720.45s 4:22:12.19 96.0%
2002
  • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
  • MySql-3.22.25
  • mm.mysql-2.0.6
125.14u 34.82s 3:39.44 72.8% 34111.04u 14941.83s 17:01:37.05 9.9%
2003
  • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
  • MySql-3.22.25
  • mm.mysql-2.0.6
50.08u 5.55s 1:50.36 50.4% 11993.57u 1330.25s 6:59:42.42 52.9%
2002
(new Db)
  • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
  • MySql-4.0.14
  • mysql-connector-java-3.0.8
126.22u 50.37s 3:11.37 92.2% 41827.16u 17607.38s 17:29:45.35 94.3%
2003
(new Db)
  • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
  • MySql-4.0.14
  • mysql-connector-java-3.0.8
29.12u 4.55s 0:48.21 69.8% 6857.08u 1171.96s 3:09:17.85 70.6%
2004
  • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
  • MySql-4.0.14
  • mysql-connector-java-3.0.8
29.73u 5.36s 0:49.49 70.9% 6740.90u 1259.28s 3:05:24.25 71.9%
2005
  • Red Hat 2.4.21-20, Pentium 3.4GHz, 2 Gb Ram
  • HSqlDb 1.7.2
12.530u 0.840s 0:55.54 24.0% 2875.820u 81.370s 1:01:40.41 79.9%
2006
  • Red Hat 2.4.9-11, Pentium 3.4GHz, 2 Gb Ram
  • HSqlDb 1.8.0
10.480u 0.562s 0:11.17 98.8% 1990.414u 95.871s 36:56.10 94.1%
2007
  • Red Hat 2.4.9-11, Pentium 3.4GHz, 2 Gb Ram
  • HSqlDb 1.8.0.4
10.878u 0.662s 0:11.57 99.6% 2348.834u 106.469s 41:25.72 98.7%
2008
  • Red Hat 2.4.9-11, Pentium 3.4GHz, 2 Gb Ram
  • HSqlDb 1.8.0.7
11.050u 0.536s 0:11.60 99.8% 2551.715u 83.859s 44:54.72 97.8%
2009
  • Red Hat 4, 2.6.9-78, Intel-Xeon 3.8GHz, 4 Gb Ram
  • HSqlDb 1.8.0.10
9.512u 0.564s 0:10.22 98.5% 2022.738u 83.185s 37:43.68 93.0%
2010
  • Red Hat 5.4, 2.6.18-164.6.1.el5, Intel-Xeon 3333MHz, 4 Gb Ram
  • HSqlDb 1.8.0.10
9.829u 0.451s 0:09.83 104.4% 2276.579u 88.682s 39:19.78 100.2%
2011
  • Red Hat 5.5, 2.6.18-194.8.1.el5, Intel-Xeon 3333MHz, 4 Gb Ram
  • HSqlDb 2.0.0
9.802u 0.625s 1:43.15 10.1% 2575.986u 59.953s 43:00.67 102.1%
2012
  • Red Hat 5.7, 2.6.18-274.7.1.el5, Intel-Xeon 3333MHz, 4 Gb Ram
  • HSqlDb 2.2.5
10.071u 0.498s 1:02.48 16.9% 2612.924u 57.926s 43:45.37 101.7%
2013 (lexlx1)
  • Red Hat Enterprise Linux Client release 5.5 (Tikanga), 2.6.18-308.13.1.el5, Intel-Xeon 3333MHz, 4 Gb Ram
  • HSqlDb 2.2.8
9.440u 0.418s 0:07.24 136.0% 2410.561u 59.427s 40:15.56 102.2%
2013 (lexdev)
  • Red Hat Enterprise Linux Workstation release 6.3 (Santiago), 16 Gb Ram
  • HSqlDb 2.2.8
15.450u 0.928s 0:08.22 199.1% 3193.846u 91.376s 50:09.72 109.1%
2014 (lexdev)
  • Red Hat Enterprise Linux Workstation release 6.4 (Santiago)
  • Intel(R) Xeon(R) CPU E5506 @ 2.13GHz, 16 Gb Ram
  • HSqlDb 2.3.0
15.700u 0.965s 0:08.76 190.1% 3332.485u 86.613s 51:46.62 110.0%
2015 (lexdev)
  • Red Hat Enterprise Linux Workstation release 6.5 (Santiago)
  • Intel(R) Xeon(R) CPU E5506 @ 2.13GHz, 48 Gb Ram
  • HSqlDb 2.3.2
16.151u 0.747s 0:08.64 195.4% 3482.666u 93.574s 1:07:57.26 87.7%
2016 (lexdev)
  • Red Hat Enterprise Linux Workstation release 6.7 (Santiago)
  • Intel(R) Xeon(R) CPU E5506 @ 2.13GHz, 48 Gb Ram
  • HSqlDb 2.3.2
23.595u 1.220s 0:14.98 165.6% 3325.270u 92.856s 51:45.11 110.0%
2017 (lexdev)
  • Red Hat Enterprise Linux Workstation release 6.8 (Santiago)
  • Intel(R) Xeon(R) CPU E5506 @ 2.13GHz, 48 Gb Ram
  • HSqlDb 2.3.4
18.638u 1.180s 0:17.63 112.3% 3483.074u 104.430s 54:28.18 109.7%
2018 (lexdev)
  • Red Hat Enterprise Linux Workstation release 6.9 (Santiago)
  • Intel(R) Xeon(R) CPU E5506 @ 2.13GHz, 48 Gb Ram
  • HSqlDb 2.3.4
21.076u 1.493s 0:54.78 41.1% 3535.282u 105.352s 55:29.44 109.3%
2019 (lexdev)
  • Red Hat Enterprise Linux Workstation release 7.5 (Maipo)
  • Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz, 132 Gb Ram
  • HSqlDb 2.4.1
19.799u 1.417s 0:21.60 98.1% 3679.774u 146.864s 52:15.30 122.0%
2020 (lexdev)
  • Red Hat Enterprise Linux Workstation release 7.7 (Maipo)
  • Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz, 132 Gb Ram
  • HSqlDb 2.5.0
20.538u 0.958s 0:07.00 306.8% 3741.786u 142.074s 53:10.26 121.7%
2021 (lexdev)
  • Red Hat Enterprise Linux Workstation release 7.9 (Maipo)
  • Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz, 132 Gb Ram
  • HSqlDb 2.5.1
17.784u 0.999s 0:06.71 279.7% 3685.188u 242.356s 54:45.71 119.5%
2022 (lexdev)
  • Red Hat Enterprise Linux Workstation release 7.9 (Maipo)
  • Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz, 132 Gb Ram
  • HSqlDb 2.5.1
16.103u 1.062s 0:06.55 261.9% 3708.189u 266.908s 54:51.37 120.7%
2023 (lexdev)
  • Red Hat Enterprise Linux Workstation release 7.9 (Maipo)
  • Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz, 132 Gb Ram
  • HSqlDb 2.7.0-jdk8
17.465u 1.210s 0:17.48 106.8% 3710.166u 180.050s 52:45.18 122.9%
2024 (lexdev)
    Red Hat Enterprise Linux Workstation release 7.9 (Maipo)
  • Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz, 128 Gb Ram
  • HSqlDb 2.7.2-jdk8
16.120u 0.842s 0:06.13 276.6% 3716.492u 153.617s 53:05.11 121.5%