WordStat

WordStat is a flexible and easy-to-use text analysis software – whether you need text mining tools for fast extraction of themes and trends, or careful and precise measurement with state-of-the-art quantitative content analysis tools. WordStat‘s seamless integration with SimStat – our statistical data analysis tool – and QDA Miner – our qualitative data analysis software – gives you unprecedented flexibility for analyzing text and relating its content to structured information, including numerical and categorical data.

WordStat Features

TEXT PROCESSING CAPABILITIES

• Content analysis on short alphanumeric variable (up to 255 characters) and longer ANSI or RTF document (several mb).
• Dictionary moderated lemmatization and stemming (English, French, Italian and Spanish; contact us for other languages).
• Ability to call external text pre-processing EXE or DLL (sample English porter stemmer and n-grams transformation are include)
• Optional exclusion of pronouns, conjunctions, etc, by the use of user-defined exclusion lists (or stop list).
• Categorization of words or phrases using existing or user-defined dictionaries.
• Word categorization based on Boolean (AND, OR, NOT) and proximity rules (NEAR, AFTER, BEFORE)
• Word and phrase substitution and scoring using wildcards and weighting.
• Frequency analysis on keywords, phrases, derived categories or concepts, or user-defined codes entered manually within a text.
• Interactive development and easy maintenance of hierarchical dictionaries, taxonomies, or categorization schema.
• Drag and drop editor for easy assignments of words, phrases into categories!
• Ability to restrict the analysis to specific portions of a text or to exclude comments and annotations.
• Ability to perform an analysis on a random sample of cases.
• Integrated spell-checking with support for different languages such as English, French, Spanish, etc.
• Integrated thesaurus (English only) to assist the creation of taxonomies and comprehensive categorization schemas.
• Powerful case filtering on any numeric or alphanumeric field and on code occurrence (with AND, OR, and NOT boolean operators)
• Prints presentation quality tables
• Imports MS Word, WordPerfect, RTF and HTML.
• Exports any table to Excel, ASCII, Tab separated or comma separated value files, or HTML files.
• Flexible keyword highlighting (the text editor can display all categories using different colors).

UNIVARIATE KEYWORD FREQUENCY ANALYSIS

• Univariate word frequency analysis (word or category count and record occurrence).
• Word x word co-occurrence matrix.
• Word x case data matrix.
• Integrated multidimensional scaling with 2D and 3D maps.
• Proximity plot.

FEATURE EXTRACTION

• Topic modeling tool automatically extract topics by applying factor analysis on word x segment matrices.
• Vocabulary finder extracts technical terms, product and company names as well as common misspellings.
• Pattern based named-entity extraction.
• Phrase finder allows one to easily identify recurring phrases and expressions

NORM CREATION AND COMPARISON

• Ability to create norm files based on frequency analysis of words or content categories.
• Comparison of obtained frequencies to previously saved norm files.

KEYWORD RETRIEVAL FUNCTION

• A powerful keyword retrieval function allows identification of text units (documents, paragraph or sentences) containing one keyword or a combination of keywords with optional filtering of cases.
• Ability to attach QDA Miner codes to retrieved segments.
• Retrieved segments may be exported to disk in tabular format (Excel or delimited text files) or as text reports (Rich Text Format).

KEYWORD CO-OCCURRENCE ANALYSIS

• Integrated clustering and dendrogram display of keyword co-occurrence.
• First- and second-order proximity analysis.
• Proximity plot to easily identify all keywords that co-occurs with a target keyword.
• 2D and 3D multidimensional scaling on either joint frequency or co-occurrence of words or categories.
• Flexible keyword co-occurrence criteria (within a case, a sentence, a paragraph, a window of n words, a user-defined segment) as well as clustering methods (first- and second-order proximity, choice of similarity measures).
• Easy text retrieval from dendrogram or proximity plots.

ANALYSIS OF CASE OR DOCUMENT SIMILARITY

• Hierarchical clustering, multidimensional scaling and proximity plot may be used to explore the similarity between documents or cases.

MULTIPLE RESPONSES AND COMPARISONS

• Can perform univariate frequency analysis and crosstabulation on information stored in several alphanumeric fields (memo or string variables).
• Comparison of keyword occurrence between different fields.
• Computes inter-raters agreement measures (pct. of agreement, Cohen’s Kappa, Scott’s Pi, Krippendorff’s R and r-bar, free marginal) based on codes manually entered in different variables.

BIVARIATE COMPARISONS BETWEEN SUBGROUPS

• Bivariate comparison between any textual field and any nominal or ordinal variable (such as the sex of the respondent, specific subgroups, years of publication, etc.).
• Choice between 11 different association measures to assess the relationship between word occurrence and nominal or ordinal variables (Chi-square, Likelihood ratio, Tau-a, Tau-b, Tau-c, symmetric Somers’ D, asymmetric Somers’ Dxy and Dyx, Gamma, Person’s R, Spearman’s Rho)
• Computation statistics on either absolute or relative frequency
• Ability to sort matrix in alphabetic order of words, by word frequency or word occurrence, on the obtained statistics or on its probability.
• Visually compare items between subgroups using bar charts and line charts.
• Correspondence analysis (statistics, 2D & 3D joint plots). This feature is accessible from the crosstab page and allows one to see graphically the relationship between nominal variables and codes resulting from a content analysis.
• Heatmap plot (with dual-clustering of keywords and variables)

AUTOMATED TEXT CLASSIFICATION

• Machine learning algorithms (Naive Bayes and K-Nearest Neighbors) for document classification.
• Flexible feature selection for automatic selection of best subsets of attributes.
• Numerous validation methods (leave-but-one, n-fold crossvalidation, split sample).
• Experimentation module allows easy comparison of predictive models and fine-tuning of classification models.
• Classification models may be saved to disk and applied later using either a standalone document classification utility program, a command line program or a programming library . Note: The command line and the programming library are part of WordStat Software Developer’s kit (SDK) which is sold separately.

KEYWORD-IN-CONTEXT (KWIC)

• Ability to display a KWIC table to examine the textual context of a word, word pattern, or category.
• Ability to sort the table on any independent (numeric) variables.
• Ability to jump from a KWIC keyword to the textual variable in order to view or edit the original text.
• KWIC list can be saved in data files for further processing.
• Customizable KWIC display (paragraph, sentence or user defined segment).
• Concordance report (displays all hits as a list of paragraphs, sentences or user defined segments)

FULL INTEGRATION WITH A STATISTICAL SOFTWARE

• Alphanumeric variables can be stored in the same file as all other numeric variables.
• Variable selection, statistical analysis and content analysis are performed within the same application program.
• Matrix outputs are automatically added to existing statistical outputs.
• New variables representing occurrence of words, keywords or concepts can be added to the existing data file or exported to a new data file in order to be submitted to further statistical analysis (such as cluster analysis on words or cases, principal coordinate analysis, correspondence analysis, multiple regression, etc.).
• Data can be imported from and exported to different file format including dBase, Paradox, Excel, Quattro Pro, Lotus 1-2-3, SPSS for DOS, SPSS for Windows, comma or tab separated text files, etc.
• Ability to perform numeric and alphanumeric transformation or to apply filters on records of the data file to restrict the analysis to specific subgroups. .

UTILITY PROGRAMS

• Dictionary building assistant to find related words (synonyms, antonyms, holonyms, meronyms, hypernyms, hyponyms) in aWordNet based thesaurus (English only). (100,000 synonyms, 120,000 root words)
• WS Document Classifier, a small standalone application to apply previously saved categorization and classification models to external documents.
• WSTOOLS – Utility program to easily import documents of any size into Simstat database files.
  • Various file formats may be directly imported such as:
    • Plain text (with optional DOS ASCII to Windows ANSI conversion)
    • HTML (with or without removal of HTML tags)
    • RTF
    • MS Word
    • WordPerfect
    • Adobe PDF
  • Optional removal of leading and trailing spaced and hard returns.
  • Extraction of numeric and alphanumeric variables from documents.
  • Extraction options may be saved on disk and later retrieved.
  • Documents may be stored as plain ANSI text or as RTF documents.