Creating, Refining, and Validating Automated Discourse Codes is an interactive CSCL 2019 half-day pre-conference workshop where participants will work together to analyze their own data using the nCoder and rho toolkits.

The goals of the workshop are for each participant to:

    1. Understand how to combine qualitative and quantitative perspectives for text analysis and use two key tools for conducting such analyses,
    2. Create codebooks for code validation and publication,
    3. Develop, test, and validate automated classifiers to code text data, and
    4. Find a meaningful result from their own data that they can refine in future work, ideally leading to the publication of a special issue on current approaches to automated text analyses.

This workshop will provide an overview of the methodology and hands-on experience with two tools:

nCoder is a learning analytics platform used to develop, validate, and implement automated coding schemes.

nCoder is available as an R package (ncodeR) and interactive website´╗┐

Rho, a statistical method for establishing the generalizability of inter-rater reliability metrics.

rho is available as an R package (rhoR) and interactive website

This is a data-intensive workshop where you get to develop codes for your own data, and discuss your process and results with other participants and with experts in automated data analysis.