Online Tools

(0) Scrubber (alpha) -- strip tags, remove stop words, apply lemma list: prepare text for (1) diviText
(1) diviText -- cut texts into segments in one of three ways, count words, .zip results
(2) treeView (beta) -- build a dendrogram and save as .pdf or phyloXML
(3) cluster validation (in progress) -- just how "good" is that dendrogram?

Analysis Software (as)

This suite of software morphs data into needed formats in preparation for your experimental analyses of texts, including statistical summaries of word usage across select groups (or chunks) of texts, authorship attribution techniques, and clustering and classification methods.

• Sort into Directories
  Starting with a directory of SGML-encoded texts, sorts texts into a new directory hierarchy according to the class/genre (A_Poetry vs. B_Prose) and manuscript names (A1, A2, ... B1, etc).

  sort_Into_directories.zip - ReadMe

• Cut Text into Chunks
  This handy script "cuts" texts into user-specified chunks. For example, you could cut the poem of Daniel into ten 450 words chunks; subsequent scripts will treat each of these chunks as an independent text.

  cutter.zip - ReadMe

• Count the Number of Words in each File
  This script counts the number of words in each file. Input files are organized in subfolders, e.g., by author or by textname if the text was split into chunks using a2_cutter.pl (see above).

  countWords.zip - ReadMe

• Merge the Counts into One File
  This script can be used either after you've created a Virtual Manuscript or following as3_countWords. The main goal of this script, in addition to collecting some statistics on your collection of texts, is to merge the counts into one file in preparation for further analysis, for example, in R (see below).

  mergeWordCounts.zip - ReadMe

• Generates Additional Statistical Reports
  This script is a follow-up to as4a. In short, this script generates additional statistical reports and rotates the merged data (rows to columns) for follow-up analyses in R (see below).

  as4b_getStats_prepare4R - ReadMe

Additional Scripts

• 
  • 
    Cluster, Classification, and Other Analyses on Texts
    kick_as5_R
    We are presently working on a set of scripts in R to perform cluster, classification, and other analyses of sets of texts.

  • 
    
    Burrow's DELTA Authorship Attribution Technique
    as6_DeltaBurrows.pl
    We are presently working on a set of scripts in Perl to perform variations of Burrow's DELTA authorship attribution technique.