qdap

qdap (Quantitative Discourse Analysis Package) is an R package designed to assist in quantitative discourse analysis. The package stands as a bridge between qualitative transcripts of dialogue and statistical analysis and visualization.

Installation

Note: Windows users may need to install RCurl before installing qdap. Use the following short script:

URL <- "http://www.stats.ox.ac.uk/pub/RWin/bin/windows/contrib/3.0/"
install.packages("RCurl", contriburl = URL)
install.packages("qdap")

Additionally, if there is a discrepency between the R and Java architectures you will have to download the appropriate version of Java compatable with the version of R you're using.

Download the development version of qdap here

Help topics

Project Template

A function to generate a project template of folders, scripts and documents.

• new_project
  Project Template

Import/Export Data

Functions for importing data and exporting output.

• dir_map
  Map Transcript Files from a Directory to a Script
• mcsv_r mcsv_w
  Read/Write Multiple csv Files at a Time
• read.transcript
  Read Transcripts Into R

Cleaning/Parsing

Function to clean and parse text data.

• bracketX
  Bracket Parsing
• bracketXtract
  Bracket Parsing
• genX
  Bracket Parsing
• genXtract
  Bracket Parsing
• beg2char
  Grab Begin/End of Sting to Character
• char2end
  Grab Begin/End of Sting to Character
• clean
  Remove Escaped Characters
• incomplete.replace
  Denote Incomplete End Marks With "|"
• incomp
  Denote Incomplete End Marks With "|"
• multigsub mgsub
  Multiple gsub
• potential_NA
  Search for Potential Missing Values
• qprep
  Quick Preparation of Text
• replace_abbreviation
  Replace Abbreviations
• replace_contraction
  Replace Contractions
• replace_number
  Replace Numbers With Text Representation
• replace_symbol
  Replace Symbols With Word Equivalents
• rm_row
  Remove Rows That Contain Markers
• rm_empty_row
  Remove Rows That Contain Markers
• scrubber
  Clean Imported Text
• space_fill
  Replace Spaces
• spaste
  Add Leading/Trailing Spaces
• stemmer
  Stem Text
• stem.words
  Stem Text
• stem2df
  Stem Text
• Trim
  Remove Leading/Trailing White Space

Viewing

Functions to aid data viewing.

• htruncdf
  Dataframe Viewing
• ltruncdf
  Dataframe Viewing
• qview
  Dataframe Viewing
• truncdf
  Dataframe Viewing
• left.just right.just
  Text Justification
• strWrap
  Wrap Character Strings to Format Paragraphs

Reshaping

Functions to reshape data.

• adjacency_matrix adjmat
  Takes a Matrix and Generates an Adjacency Matrix
• colSplit
  Separate a Column Pasted by paste2
• colsplit2df
  Wrapper for colSplit that Returns Dataframe(s)
• lcolsplit2df
  Wrapper for colSplit that Returns Dataframe(s)
• gantt
  Generate Unit Spans
• gantt_rep
  Generate Unit Spans for Repeated Measures
• key_merge
  Merge Demographic Information with Person/Text Transcript
• paste2
  Paste an Unspecified Number Of Text Columns
• prop
  Convert Raw Numeric Matrix or Data Frame to Proportions
• qcombine
  Combine Columns
• sentSplit
  Sentence Splitting
• sentCombine
  Sentence Splitting
• TOT
  Sentence Splitting
• speakerSplit
  Break and Stretch if Multiple Persons per Cell

Word Extraction/Comparison

Functions for working with dialogue at the word level.

• all_words
  Searches Text Column for Words
• bag.o.words
  Bag of Words
• breaker
  Bag of Words
• word.split
  Bag of Words
• common
  Find Common Words Between Groups
• exclude
  Exclude Elements From a Vector
• ngrams
  Generate ngrams
• stopwords
  Remove Stopwords
• strip
  Strip Text
• synonyms syn
  Search For Synonyms
• word_associate
  Find Associated Words.
• word_diff_list
  Differences In Word Use Between Groups
• word_list
  Raw Word Lists/Frequency Counts

Coding Tools

cm functions are code matrix functions. These functions are used for coding and reshaping transcripts, dataframes, and time spans for further use in analysis and visualization.

• cm_code.blank
  Blank Code Transformation
• cm_code.combine
  Combine Codes
• cm_code.exclude
  Exclude Codes
• cm_code.overlap
  Find Co-occurrence Between Codes
• cm_code.transform
  Transform Codes
• cm_combine.dummy
  Find Co-occurrence Between Codes
• cm_df.fill
  Range Coding
• cm_df.temp
  Break Transcript Dialogue into Blank Code Matrix
• cm_df.transcript
  Transcript With Word Number
• cm_df2long
  Transform Codes to Start-End Durations
• cm_distance
  Distance Matrix Between Codes
• cm_dummy2long
  Convert cm_combine.dummy Back to Long
• cm_long2dummy
  Stretch and Dummy Code cm_xxx2long
• cm_range.temp
  Range Code Sheet
• cm_range2long
  Transform Codes to Start-End Durations
• cm_time.temp
  Time Span Code Sheet
• cm_time2long
  Transform Codes to Start-End Times

Counts/Descriptives

Functions for word counts and descriptive statistics.

• distTab
  SPSS Style Frequency Tables
• multiscale
  Nested Standardization
• outlier.detect
  Detect Outliers in Text
• outlier.labeler
  Locate Outliers in Numeric String
• pos
  Parts of Speech Tagging
• pos.by
  Parts of Speech Tagging
• pos.tags
  Parts of Speech Tagging
• question_type
  Count of Question Type
• syllable.sum
  Syllabication
• combo_syllable.sum
  Syllabication
• polysyllable.sum
  Syllabication
• syllable.count
  Syllabication
• termco
  Search For and Count Terms
• term.match
  Search For and Count Terms
• termco.d
  Search For and Count Terms
• termco2mat
  Search For and Count Terms
• termco.c
  Combine Columns from a termco Object
• wfm wfdf
  Word Frequency Matrix
• wf.combine
  Word Frequency Matrix
• wfm.expanded
  Word Frequency Matrix
• word.count wc
  Word Counts
• character.count
  Word Counts
• character.table char.table
  Word Counts
• word_stats
  Descriptive Word Statistics

Measures

Word measures and Scoring.

• automated_readability_index coleman_liau flesch_kincaid fry linsear_write SMOG
  Readability Measures
• dissimilarity
  Dissimilarity Statistics
• diversity
  Diversity Statistics
• formality
  Formality Score
• kullback.leibler
  Kullback Leibler Statistic
• polarity
  Polarity Score (Sentiment Analysis)

qdap Tools

Tools to assist in transcript/discourse analysis.

• blank2NA
  Replace Blanks in Data Frame
• capitalizer
  Capitalize Select Words
• duplicates
  Find Duplicated Words in a Text String
• hash
  Hash/Dictionary Lookup
• hms2sec
  Convert h:m:s to Seconds
• lookup
  Hash Table/Dictionary Lookup
• qcv
  Quick Character Vector
• replacer
  Replace Cells in a Matrix or Data Frame
• Search
  Search Columns of a Data Frame
• sec2hms
  Convert Seconds to h:m:s
• text2color
  Map Words to Colors
• url_dl
  Download Instructional Documents
• v.outer
  Vectorized Version of outer

Identification

Identify sentence elements/types.

• end_inc
  Test for Incomplete Sentences
• end_mark
  Sentence End marks
• imperative
  Intuitively Remark Sentences as Imperative
• NAer
  Replace Missing Values (NA)

Visualization

Plotting functions.

• gradient_cloud
  Gradient Word Cloud
• gantt_plot
  Gantt Plot
• gantt_wrap
  Gantt Plot
• plot.character.table
  Plots a character.table Object
• plot.diversity
  Plots a diversity object
• plot.formality
  Plots a formality Object
• plot.polarity
  Plots a polarity Object
• plot.pos.by
  Plots a pos.by Object
• plot.question_type
  Plots a question_type Object
• plot.termco
  Plots a termco object
• plot.word_stats
  Plots a word_stats object
• qheat
  Quick Heatmap
• rank_freq_mplot
  Rank Frequency Plot
• rank_freq_plot
  Rank Frequency Plot
• tot_plot
  Visualize Word Length by Turn of Talk
• trans.cloud
  Word Clouds by Grouping Variable
• trans.venn
  Venn Diagram by Grouping Variable
• word.network.plot
  Word Network Plot

Print Functions

• print.adjacency_matrix
  Prints an adjacency_matrix Object
• print.character.table
  Prints a character.table object
• print.cm_distance
  Prints a cm_distance Object
• print.colsplit2df
  Prints a colsplit2df Object.
• print.dissimilarity
  Prints a dissimilarity object
• print.diversity
  Prints a diversity object
• print.formality
  Prints a formality Object
• print.kullback.leibler
  Prints a kullback.leibler Object.
• print.polarity
  Prints a polarity Object
• print.pos
  Prints a pos Object.
• print.pos.by
  Prints a pos.by Object.
• print.question_type
  Prints a question_type object
• print.termco
  Prints a termco object.
• print.v.outer
  Prints a v.outer Object.
• print.word_associate
  Prints a word_associate object
• print.word_list
  Prints a word_list Object
• print.word_stats
  Prints a word_stats object

Data

Data sets included in qdap and used in examples.

• abbreviations
  Small Abbreviations Data Set
• action.verbs
  Action Word List
• adverb
  Adverb Word List
• BuckleySaltonSWL
  Buckley & Salton Stopword List
• contractions
  Contraction Conversions
• DATA
  Fictitious Classroom Dialogue
• DATA2
  Fictitious Repeated Measures Classroom Dialogue
• DICTIONARY
  Nettalk Corpus Syllable Data Set
• emoticon
  Emoticons Data Set
• env.syl
  Syllable Lookup Environment
• env.syn
  Syllable Lookup Environment
• increase.amplification.words
  Amplifying Words
• interjections
  Interjections
• labMT
  Language Assessment by Mechanical Turk (labMT) Sentiment Words
• mraja1
  Romeo and Juliet: Act 1 Dialogue Merged with Demographics
• mraja1spl
  Romeo and Juliet: Act 1 Dialogue Merged with Demographics and Split
• negation.words
  Negating Words
• negative.words
  Negative Words
• OnixTxtRetToolkitSWL1
  Onix Text Retrieval Toolkit Stopword List 1
• positive.words
  Positive Words
• preposition
  Preposition Words
• raj.act.1
  Romeo and Juliet: Act 1
• raj.act.2
  Romeo and Juliet: Act 2
• raj.act.3
  Romeo and Juliet: Act 3
• raj.act.4
  Romeo and Juliet: Act 4
• raj.act.5
  Romeo and Juliet: Act 5
• raj.demographics
  Romeo and Juliet Demographics
• raj
  Romeo and Juliet (Unchanged & Complete)
• rajPOS
  Romeo and Juliet Split in Parts of Speech
• rajSPLIT
  Romeo and Juliet (Complete & Split)
• SYNONYM
  Synonyms Data Set
• Top100Words
  Fry's 100 Most Commonly Used English Words
• Top200Words
  Fry's 200 Most Commonly Used English Words
• Top25Words
  Fry's 25 Most Commonly Used English Words