Exclusive Filter: A Term contains a measurement

• Description:
  If a term contains a measurement, it is not a valid. A measurement includes a number and an unit. Three patterns and examples are described in the following table:

• Examples:

  ID	Pattern	Example
  1	float + unit	0.5 mg at -5 degrees 10 cigarettes per day
  2	range + unit	2-3 days
  3	number + unit	four months two patients
  4	float + unit/...	.1 mg/kg 2 micrograms/ml, 50 mg/kg/day
  5	range + unit/...	0.1-2.3 mg/day 1-2 tablets
  6	number + unit/...	two micrograms/ml
  7	month + year	from May 2002 2003 to June 2004 1 January 1991
  8	age	4-year-old 4 year-old four year-old 4 yr-old 4 year-olds 4 hour-olds

• Input Term: core-term
• Filter Algorithm:
  • Logics:

    Description	FilterType	Notes
    Get words from inTerm	FT_TBD
    if contains regular measurement if a word is a float, range, number if the next word is a [unit] or pattern of [unit/..]	FT_MEASUREMENT	See example 1-6 in above table
    if date (month + number) if a word is a float, range, number if the previous word is a [month]	FT_MEASUREMENT	See example-7 in above table
    if age XX-[AGE_UNIT]-old XX [AGE_UNIT]-old XX-[AGE_UNIT]-olds XX [AGE_UNIT]-olds [AGE_UNIT]: year, yr, month, week, wk, day, d, hour, hr	FT_MEASUREMENT	See example-8 in above table

  • source code: FilterMeasurement.java
  • FilterType: FilterType.FT_MEASUREMENT

• Accuracy Test on Lexicon:
  • InFile:
    • ${OUT_DATA}/03.LeadEndTerm/lexWords.data
    • ${IN_DATA}/unit.data";
    • ${IN_DATA}/NRVAR"
  • Result:

    Lexicon	Filter	Sample No	Pass No	Trap No	Exp No	Pass-Rate
    2023	FT_MEASUREMENT	1001867	1001743	124	0	99.9876%
    2022	FT_MEASUREMENT	998845	998721	124	0	99.9876%
    2021	FT_MEASUREMENT	992545	992421	124	0	99.9875%
    2020	FT_MEASUREMENT	983420	983297	123	0	99.9875%
    2019	FT_MEASUREMENT	972721	972604	117	0	99.9880%
    2018	FT_MEASUREMENT	955564	955456	108	0	99.9887%
    2017	FT_MEASUREMENT	935276	935193	83	0	99.9911%
    2016	FT_MEASUREMENT	915583	915510	73	0	99.9920%
    2015	FT_MEASUREMENT	896213	896175	38	0	99.9958%
    2014	FT_MEASUREMENT	875090	875061	29	0	99.9967%