Statistical Discourse Analysis
Summary
Contributor: Ming Ming Chiu
Identifying triggers of target actions within individual or social processes across time and their links to higher-level outcomes requires modeling individual (and group) characteristics and sequences of actions. One such method is statistical discourse analysis (SDA). SDA can model (a) pivotal moments that radically change subsequent processes and divide the time points into distinct time periods, (b) effects of previous actions (or their sequences) on target actions, and (c) influences at various levels (turn, time period, individual, group, organization, province, country, etc.). SDA addresses difficulties involving data (unit of analysis, coding, inter-rater reliability, missing data, parallel conversations, breakpoints, time periods, statistical power), dependent variables (discrete variables, infrequency bias, nested data, multiple dependent variables), and explanatory variables (variables at earlier turns, cross-level interactions, indirect multilevel mediation, serial correlation, false positives, odds ratios, robustness). To show how sequences of processes are related to higher-level group outcomes, we add the group outcome as an independent variable. For example, we can test how social metacognitive actions (e.g., agree, rudely disagree) affect the likelihood of correct, new ideas (micro-creativity) and justifications, using 3,296 turns of talk by 80 students in 20 groups working on an algebra problem. A rude disagreement often triggered another rude disagreement, which yielded less micro-creativity. In groups that solved the problem or after a wrong idea however, a rude disagreement yielded greater micro-creativity. After a student with a higher mathematics grade spoke, more justifications followed; this effect differed across time periods. SDA requirements include specification of explanatory variables, independent and identically distributed residuals, and a minimum sample size (20 units at the highest level).
These abstracts are living documents provided and modified by NAPLeS members. The more contributions we have towards refining the documents the more representative they will be of the community as a whole. If you would like to suggest revisions, please contact [email protected].
Syllabi and Slides
Statistical Discourse Analysis slides by Ming Ming Chiu
Video Resources
Watch the full webinar on Statistical Discourse Analysis featuring Ming Ming Chiu:
Listen to the Statistical Discourse Analysis webinar
Reading
- Chiu, M. M. (2008). Flowing toward correct contributions during groups’ mathematics problem solving: A statistical discourse analysis. Journal of the Learning Sciences, 17(3), 415-463. [Access Online]
- Chiu, M. M. (2018). Statistically Modelling Effects of Dynamic Processes on Outcomes: An Example of Discourse Sequences and Group Solutions. Journal of Learning Analytics, 5(1), 75-91. [Access Online]
- Chiu, M. M., & Khoo, L. (2005). A new method for analyzing sequential processes: Dynamic multi-level analysis. Small Group Research, 36, 600-631.
- Chiu, M. M., & Khoo, L. (2003). Rudeness and status effects during group problem solving: Do they bias evaluations and reduce the likelihood of correct solutions? Journal of Educational Psychology, 95, 506-523.
- Chiu, M. M., & Lehmann-Willenbrock, N. (2016). Statistical Discourse Analysis: Modeling Sequences of Individual Actions During Group Interactions Across Time. Group Dynamics: Theory, Research, and Practice, 20(3), 242-258. [Access Online]
- Wise, A., & Chiu, M. M. (2011). Analyzing temporal patterns of knowledge construction in a role-based online discussion. International Journal of Computer-Supported Collaborative Learning, 6, 445-470. [Access Online]
Learning Scientists Who Have Researched This Topic
- Gaowei Chen
- Ming Ming Chiu
- Susannah Paletz
- Noreen Webb
- Tzu-Jung Lin