Example - Add SD-Rules from Other Suggestions
Other suggested SD-Rules can be evaluated and added to this system by following the same approach in the previous two sessions: nomD session and factD session.
Suggested SD-Rule | Notes | Examples | Status |
---|---|---|---|
$|verb|less$|adj | This rule should be evaluated first to complete suffix negation. |
| Evaluated: Bad SD-Rule |
$|adj|ly$|adv | Suggested by Lynn |
| Rejected - duplicated |
$|noun|y$|adj | Suggested by Lynn |
| Rejected - duplicated |
al$|adj|us$|noun | Suggested by Chris, seconded by Destinee & Lynn |
| TBD |
$|noun|ize$|verb | Suggested by Lynn |
| TBD |
e$|verb|ing$|noun | Suggested by Chris |
| TBD |
The iterative results are shown as follows:
ID | Suggested Candidate Rule | Total Yes | Total Rule No. | Rule No. | A. Rate | Occr. | Yes | No | Tbd | SD-Rule | Status | Source | Notes | Sys A. Rate | Sys C. Rate | Sys. Perf | Notes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2.3.4.5 (prev. optimized set) | 42,545 | 95 | 73 | 60.66% | 183 | 111 | 72 | 0 | ar$|adj|e$|noun | 2013 | ORG_RULE | SELF | 95.30% | 95.02% | 1.9033 | Baseline | |
2.3.4.5.1 |
101|1.84%|381|7|374|0|$|verb|less$|adj|2013|ORG_FACT|SELF
| 42,552 = 42,545 + 7 | 96 | 73 | 60.66% | 183 | 111 | 72 | 0 | ar$|adj|e$|noun | 2013 | ORG_RULE | SELF | 95.30% | 95.01% | 1.9031 | Worse |
The result shows the new selected SD-rule does not improve the system performance and should not be included in the optimized set. However, this SD-rule is added to the SD-rules evaluation set to cover more evaluated SD-rules. The new optimized set has coverage rate (95.01%) and system performance (1.9031) with accuracy rate of 95.30% to include 73 (out of 96) SD-rules. This set should be used as baseline for evaluating new rules in the future. The diagram below shows the system accuracy and coverage curves of this optimized set.