CSpell

Noisy Channel Score

I. Introduction

Noisy Channel Model is used by combining above scores for the ranking. More investigation and tests are planned to be performed when more resources are available.

  • NoisyChannelScore.java
    => NC score = language Model score x error Model score
    where:
    • language model score: word frequency score
    • error model score: orthographic score

II. Results

Tests on non-word on the training set with different ranking mode for the function mode of 1-to-1 and Split

Ranking ModeRaw dataPerformance
Orthographic592|769|7740.7698|0.7649|0.7673
Frequency534|770|7740.6935|0.6899|0.6917
Context446|554|7740.8051|0.5762|0.6713
Noisy Channel551|770|7740.7156|0.7119|0.7137

From the results:

  • The noisy channel score is better than word frequency score, but worse than Orthographic score.