A mixed-methods framework for analyzing text data: Integrating computational techniques with qualitative methods in demography

Parijat Chakrabarti; Margaret Frye

doi:10.4054/DemRes.2017.37.42

Volume 37 - Article 42 | Pages 1351–1382

A mixed-methods framework for analyzing text data: Integrating computational techniques with qualitative methods in demography

By Parijat Chakrabarti, Margaret Frye

Date received:

6 Jun 2017

Date published:

2 Nov 2017

Word count:

8062

Keywords:

automated text analysis, Malawi, mixed methods, qualitative data, qualitative methods

DOI:

10.4054/DemRes.2017.37.42

Replicable Material:

demographic-research.37-42 (zip file, 36 MB)
readme.37-42 (text file, 878 Byte)

Download PDF
Submit a Response Letter

Abstract

Background: Automated text analysis is widely used across the social sciences, yet the application of these methods has largely proceeded independently of qualitative analysis.

Objective: This paper explores the advantages of applying automated text analysis to augment traditional qualitative methods in demography. Computational text analysis does not replace close reading or subjective theorizing, but it can provide a complementary set of tools that we believe will be appealing for qualitative demographers.

Methods: We apply topic modeling to text data from the Malawi Journals Project as a case study.

Results: We examine three common issues that demographers face in analyzing qualitative data: large samples, the challenge of comparing qualitative data across external categories, and making data analysis transparent and readily accessible to other scholars. We discuss ways that new tools from machine learning and computer science might help qualitative scholars to address these issues.

Conclusions: We believe that there is great promise in mixed-method approaches to analyzing text. New methods that allow better access to data and new ways to approach qualitative data are likely to be fertile ground for research.

Contribution: No research, to our knowledge, has used automated text analysis to take an explicitly mixed-method approach to the analysis of textual data. We develop a framework that allows qualitative researchers to do so.