Strip Punctuation

• Short Description: Strip punctuation.
  
  
• Full Description:

  This flow is used to strips punctuation from the input term. The stripped items are not replaced by spaces. Punctuations are defined in Java Character class and include:

  • DASH_PUNCTUATION (20): -
  • START_PUNCTUATION (21): ( { [
  • END_PUNCTUATION (22): ) } ]
  • CONNECTOR_PUNCTUATION (23): _
  • OTHER_PUNCTUATION (24): ! @ # % & * \ : ; " ' , . ? /
  • MATH_SYMBOL (25): ~ + = | < >
  • CURRENCY_SYMBOL (26): $
  • MODIFIER_SYMBOL (27): ` ^

  No effect on the -m option. "none" is added at the end of the output.
  
  

• Difference:
  1. Java version trims output terms (remove spaces at the beginning and ending of the term).
  2. Different result for testing diacritics, such as \345\346... in the unit test.
  
  
  
• Features:
  1. Strip a character from the input term if the character belongs to above list.
  
  
  
• Symbol: p
  
  
• Examples:

  
  shell> lvg -f:p
  St. John's
  St. John's|St Johns|2047|16777215|p|1|
  

  More examples
  
  
• Implementation Logic:
  1. Go through every character in the input term; strip it if the character is a punctuation.
  
  
• Source Code: ToStripPunctuation.java
  
  
• Hierarchy: Object -> Transformation -> ToStripPunctuation