BROWNFREQ(1) User Contributed Perl Documentation BROWNFREQ(1)NAMEbrownFreq.pl - Compute Information Content from the Brown Corpus
SYNOPSISbrownFreq.pl [--outfile=OUTFILE [--stopfile=STOPFILE]
[--wnpath=WNPATH] [--resnik] [--smooth=SCHEME] FILES
| --help --version]
DESCRIPTION
This program reads the Brown Corpus and computes the frequency counts
for each synset in WordNet. These frequency counts are used by various
measures of semantic relatedness to calculate the information content
values of concepts. The output is generated in a format as required by
the WordNet::Similarity modules for computing semantic relatedness.
There are various forms of the Brown corpus available. The one we use
for this program comes from the ICAME Collection of English Language
Corpora, Second Edition, 1999. <http://www.hit.uib.no/icame/cd>
A more detailed description of how information content is calculated
can be found in rawtextFreq.pl. This program uses exactly the same
techniques as described there.
OPTIONS
--outfile=filename
The name of a file to which output should be written
--stopfile=filename
A file containing a list of stop listed words that will not be
considered in the frequency counts. A sample file can be down-
loaded from
http://www.d.umn.edu/~tpederse/Group01/WordNet/words.txt
--wnpath=path
Location of the WordNet data files (e.g.,
/usr/local/WordNet-3.0/dict)
--resnik
Use Resnik (1995) frequency counting
--smooth=SCHEME
Smoothing should used on the probabilities computed. SCHEME can
only be ADD1 at this time
--help
Show a help message
--version
Display version information
FILES
Files for the Brown Corpus (e.g., /home/sid/Brown/BROWN1/*.TXT).
BUGS
Report to WordNet::Similarity mailing list :
<http://groups.yahoo.com/group/wn-similarity>
SEE ALSO
WordNet::Similarity
ICAME Corpus :
<http://www.hit.uib.no/icame/cd>
WordNet home page :
<http://wordnet.princeton.edu>
WordNet::Similarity home page :
<http://wn-similarity.sourceforge.net>
AUTHORS
Ted Pedersen, University of Minnesota, Duluth
tpederse at d.umn.edu
Satanjeev Banerjee, Carnegie Mellon University, Pittsburgh
banerjee+ at cs.cmu.edu
Siddharth Patwardhan, University of Utah, Salt Lake City
sidd at cs.utah.edu
COPYRIGHT
Copyright (c) 2005-2008, Ted Pedersen, Satanjeev Banerjee, and
Siddharth Patwardhan
This program is free software; you can redistribute it and/or modify it
under the terms of the GNU General Public License as published by the
Free Software Foundation; either version 2 of the License, or (at your
option) any later version. This program is distributed in the hope
that it will be useful, but WITHOUT ANY WARRANTY; without even the
implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR
PURPOSE. See the GNU General Public License for more details.
You should have received a copy of the GNU General Public License along
with this program; if not, write to the Free Software Foundation, Inc.,
59 Temple Place - Suite 330, Boston, MA 02111-1307, USA.
perl v5.20.2 2015-08-31 BROWNFREQ(1)
