gov.nih.nlm.nls.lvg.Flows

Class ToStripMapUnicode

java.lang.Object

gov.nih.nlm.nls.lvg.Flows.Transformation

gov.nih.nlm.nls.lvg.Flows.ToStripMapUnicode

All Implemented Interfaces:

java.lang.Cloneable

public class ToStripMapUnicode
extends Transformation
implements java.lang.Cloneable

This class strips or maps non-ASCII Unicode characters. This is a pure table mapping method with simply algorithm to

• strip non-ASCII unicode characters if they are not in mapping table
• convert non-ASCII unicode characters to ASCII if they are in mapping table

This flow is used to perform final tune up in normalizing Unicode to ASCII after using other Unicode normalization flows.

Users may define their own mapping in $LVG/data/Unicode/nonStripMap.data.

History:

Version:

V-2026

Author:

NLM NLS Development Team

See Also:

Design Document , Strip or Map Unicode

Field Summary

Fields inherited from class gov.nih.nlm.nls.lvg.Flows.Transformation

NO_MUTATE_INFO, UPDATE

Constructor Summary

Constructors

Constructor and Description
ToStripMapUnicode()

Method Summary

Modifier and Type	Method and Description
static java.util.Hashtable<java.lang.Character,java.lang.String>	GetNonStripMapFromFile(Configuration config) Read in non-strip map unicode list from configuration file
static void	main(java.lang.String[] args) A unit test driver for this flow component.
static java.util.Vector<LexItem>	Mutate(LexItem in, java.util.Hashtable<java.lang.Character,java.lang.String> nonStripMap, boolean detailsFlag, boolean mutateFlag) Performs the mutation of this flow component.
static java.lang.String	StripMapUnicodeToAscii(char inChar, java.util.Hashtable<java.lang.Character,java.lang.String> nonStripMap) Strip or map unicode to ASCII

Methods inherited from class gov.nih.nlm.nls.lvg.Flows.Transformation

GetTestStr, PrintResult, PrintResults, UpdateLexItem, UpdateLexItem, UpdateLexItem

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ToStripMapUnicode

public ToStripMapUnicode()

Method Detail

Mutate

public static java.util.Vector<LexItem> Mutate(LexItem in,
                                               java.util.Hashtable<java.lang.Character,java.lang.String> nonStripMap,
                                               boolean detailsFlag,
                                               boolean mutateFlag)

Performs the mutation of this flow component.

Parameters:

in - a LexItem as the input for this flow component

nonStripMap - a hash table contains the non-Strip map unicode

detailsFlag - a boolean flag for processing details information

mutateFlag - a boolean flag for processing mutate information

Returns:

the results from this flow component - a collection (Vector) of LexItems

GetNonStripMapFromFile

public static java.util.Hashtable<java.lang.Character,java.lang.String> GetNonStripMapFromFile(Configuration config)

Read in non-strip map unicode list from configuration file

Parameters:

config - Configuratin object

Returns:

a hash table of non-strip map Unicode list

StripMapUnicodeToAscii

public static java.lang.String StripMapUnicodeToAscii(char inChar,
                                                      java.util.Hashtable<java.lang.Character,java.lang.String> nonStripMap)

Strip or map unicode to ASCII

Parameters:

inChar - an input character

nonStripMap - a hash table contains the unicode

Returns:

the stripped or mapped string in ASCII

main

public static void main(java.lang.String[] args)

A unit test driver for this flow component.

Parameters:

args - arguments