Exclusive Filter: A Term contains pattern of incomplete

• Description:
  If a term contains pattern of incomplete, it is an invalid MWE. Incomplete patterns are terms that does not have even number of left and right parenthesis or square brackets or they are not closed. This filter also takes into consideration of core-term so that the input is a nGram. Patterns included are shown as the table below:

  Description	Incomplete Pattern
  uneven number of parenthesis	xx (yy xx ((yy) zz xx) yy (xx) yy) zz
  uneven number of brackets	xx [yy xx [[yy] zz xx] yy [xx] yy] zz
  unclosed parenthesis	xx) yy (zz
  unclosed brackets	xx] yy [zz

• Examples:
  • II (Hunter syndrome
  • 0.05) higher
  • bond]C-C[triple
  • (chi(2)

  This filter take core-term into consideration, such as XXX) will be convert to XXX and then check if it matches the incomplete pattern.

• Input Term: original term
• Filter Algorithm:
  • Logics:

    Description	FilterType	Notes
    Assign default filter type	FT_INCOMPLET
    Check if a term is not incomplete (complete)	FT_TBD	check if number of left and right of parenthesis and square brackets are even check if parenthesis and square brackets are closed correctly
    Check if the core-term is not incomplete (complete). For example, "test" is the core-term of "(test", which is complete, thus "(test" pass this filter because core-term are used as LMW candidates at the end of these processes (this feature is updated in 2016).	FT_TBD	check if number of left and right of parenthesis and square brackets are even check if parenthesis and square brackets are closed correctly

  • source code: FilterIncomplete.java
  • FilterType: FilterType.FT_INCOMPLETE

• Accuracy Test on Lexicon:
  • InFile:
    • ${OUT_DATA}/03.LeadEndTerm/lexWords.data
  • Result:

    Lexicon	Filter	Sample No	Pass No	Trap No	Exp No	Pass-Rate
    2025	FT_INCOMPLETE	1007634	1007634	0	0	100.0000%
    2024	FT_INCOMPLETE	1005102	1005102	0	0	100.0000%
    2023	FT_INCOMPLETE	1001867	1001867	0	0	100.0000%
    2022	FT_INCOMPLETE	998845	998845	0	0	100.0000%
    2021	FT_INCOMPLETE	992545	992545	0	0	100.0000%
    2020	FT_INCOMPLETE	983420	983420	0	0	100.0000%
    2019	FT_INCOMPLETE	972721	972721	0	0	100.0000%
    2018	FT_INCOMPLETE	955564	955564	0	0	100.0000%
    2017	FT_INCOMPLETE	935276	935276	0	0	100.0000%
    2016	FT_INCOMPLETE	915583	915583	0	0	100.0000%
    2015	FT_INCOMPLETE	896213	896212	1	0	99.9999%
    2014	FT_INCOMPLETE	875090	875089	1	0	99.9999%

    Please note the only trapped term from Lexicon, "antipoly ADP-ribose) polymerase", is an error in Lexicon.2014. It should be "antipoly (ADP-ribose) polymerase" and expected to be fixed in later version. In other words, the passing-rate is 100%.