Lexical Tools

  • Fields
  • Java


Introduction

It is a common process to filter out certain fields and/or rearrange fields from file(s) according to user's preference in the natural language process. A Java based program, fields, along with Java APIs is included in Lvg.${YEAR} release.

Setup

Follow the installation instructions to install lexical tool and run the fields program. Check on the following items only if you don't use the provided script to install Lexical tools.

  • CLASSPATH:
    1. include the Lexical tools distribution jar file, ${LVG_DIR}/lib/lvg${YEAR}dist.jar, in your CLASSPATH
    2. include the lvg top directory, ${LVG_DIR}, in your CLASSPATH

Test Run

  • run java program

    Enter the command:

    
    shell> fields -F:3:1 -p
    - Please input a term (type "Ctl-d" to quit) >
    test 1|Field 2|field 3|field-4
    field 3|test 1
    

    where:

    • fields: script for cut out and/or rearrange fields
    • -F:3:1: put the 3rd field, then the 1st field in the output
    • -p: set fields system option to show prompt (try -h option!)

Output Format

fields takes its input (entire line) from standard input, cut and/or rearrange fields, and then send the results to standard output.

Global Behavior Options

Please refer to design documents

Output Field Options

Please refer to design documents