I need create a list of words and their frequencies for corpora

[HughP]

I need create a list of words and their frequencies for corpora.

Try This to get me started: cat comment_file.txt | tr " " "\n" | sort | uniq -c | wc -l from http://www.unix.com/shell-programming-and-scripting/45838-how-read-all-unique-words-text-file.html

Here are some links to get me started:

• http://stackoverflow.com/questions/16489317/how-to-generate-list-of-unique-words-from-text-file-in-ubuntu
• http://www.unix.com/shell-programming-and-scripting/45838-how-read-all-unique-words-text-file.html

Via Python:

• http://stackoverflow.com/questions/19350900/finding-all-unique-words-from-a-list-using-loops
• http://stackoverflow.com/questions/22978602/how-to-return-unique-words-from-the-text-file-using-python