Identifying patterns in students’ scientific argumentation: content analysis through text mining using Latent Dirichlet Allocation

© 2020, Association for Educational Communications and Technology. Constructing scientific arguments is an important practice for students because it helps them to make sense of data using scientific knowledge and within the conceptual and experimental boundaries of an investigation. In this study,...

Full description

Bibliographic Details
Main Authors: Xing, W, Lee, HS, Shibani, A
Format: Article in Journal/Newspaper
Language:English
Published: SPRINGER 2020
Subjects:
Online Access:http://hdl.handle.net/10453/144137
_version_ 1821708889871089664
author Xing, W
Lee, HS
Shibani, A
author_facet Xing, W
Lee, HS
Shibani, A
author_sort Xing, W
collection University of Technology Sydney: OPUS - Open Publications of UTS Scholars
description © 2020, Association for Educational Communications and Technology. Constructing scientific arguments is an important practice for students because it helps them to make sense of data using scientific knowledge and within the conceptual and experimental boundaries of an investigation. In this study, we used a text mining method called Latent Dirichlet Allocation (LDA) to identify underlying patterns in students written scientific arguments about a complex scientific phenomenon called Albedo Effect. We further examined how identified patterns compare to existing frameworks related to explaining evidence to support claims and attributing sources of uncertainty. LDA was applied to electronically stored arguments written by 2472 students and concerning how decreases in sea ice affect global temperatures. The results indicated that each content topic identified in the explanations by the LDA— “data only,” “reasoning only,” “data and reasoning combined,” “wrong reasoning types,” and “restatement of the claim”—could be interpreted using the claim–evidence–reasoning framework. Similarly, each topic identified in the students’ uncertainty attributions— “self-evaluations,” “personal sources related to knowledge and experience,” and “scientific sources related to reasoning and data”—could be interpreted using the taxonomy of uncertainty attribution. These results indicate that LDA can serve as a tool for content analysis that can discover semantic patterns in students’ scientific argumentation in particular science domains and facilitate teachers’ providing help to students.
format Article in Journal/Newspaper
genre Sea ice
genre_facet Sea ice
id ftunivtsydney:oai:opus.lib.uts.edu.au:10453/144137
institution Open Polar
language English
op_collection_id ftunivtsydney
op_relation Educational Technology Research and Development
10.1007/s11423-020-09761-w
Educational Technology Research and Development, 2020, 68, (5), pp. 2185-2214
1042-1629
1556-6501
http://hdl.handle.net/10453/144137
op_rights info:eu-repo/semantics/closedAccess
publishDate 2020
publisher SPRINGER
record_format openpolar
spelling ftunivtsydney:oai:opus.lib.uts.edu.au:10453/144137 2025-01-17T00:45:41+00:00 Identifying patterns in students’ scientific argumentation: content analysis through text mining using Latent Dirichlet Allocation Xing, W Lee, HS Shibani, A 2020-11-19T02:34:57Z application/pdf http://hdl.handle.net/10453/144137 English eng SPRINGER Educational Technology Research and Development 10.1007/s11423-020-09761-w Educational Technology Research and Development, 2020, 68, (5), pp. 2185-2214 1042-1629 1556-6501 http://hdl.handle.net/10453/144137 info:eu-repo/semantics/closedAccess 1303 Specialist Studies in Education Education Journal Article 2020 ftunivtsydney 2022-03-13T13:21:29Z © 2020, Association for Educational Communications and Technology. Constructing scientific arguments is an important practice for students because it helps them to make sense of data using scientific knowledge and within the conceptual and experimental boundaries of an investigation. In this study, we used a text mining method called Latent Dirichlet Allocation (LDA) to identify underlying patterns in students written scientific arguments about a complex scientific phenomenon called Albedo Effect. We further examined how identified patterns compare to existing frameworks related to explaining evidence to support claims and attributing sources of uncertainty. LDA was applied to electronically stored arguments written by 2472 students and concerning how decreases in sea ice affect global temperatures. The results indicated that each content topic identified in the explanations by the LDA— “data only,” “reasoning only,” “data and reasoning combined,” “wrong reasoning types,” and “restatement of the claim”—could be interpreted using the claim–evidence–reasoning framework. Similarly, each topic identified in the students’ uncertainty attributions— “self-evaluations,” “personal sources related to knowledge and experience,” and “scientific sources related to reasoning and data”—could be interpreted using the taxonomy of uncertainty attribution. These results indicate that LDA can serve as a tool for content analysis that can discover semantic patterns in students’ scientific argumentation in particular science domains and facilitate teachers’ providing help to students. Article in Journal/Newspaper Sea ice University of Technology Sydney: OPUS - Open Publications of UTS Scholars
spellingShingle 1303 Specialist Studies in Education
Education
Xing, W
Lee, HS
Shibani, A
Identifying patterns in students’ scientific argumentation: content analysis through text mining using Latent Dirichlet Allocation
title Identifying patterns in students’ scientific argumentation: content analysis through text mining using Latent Dirichlet Allocation
title_full Identifying patterns in students’ scientific argumentation: content analysis through text mining using Latent Dirichlet Allocation
title_fullStr Identifying patterns in students’ scientific argumentation: content analysis through text mining using Latent Dirichlet Allocation
title_full_unstemmed Identifying patterns in students’ scientific argumentation: content analysis through text mining using Latent Dirichlet Allocation
title_short Identifying patterns in students’ scientific argumentation: content analysis through text mining using Latent Dirichlet Allocation
title_sort identifying patterns in students’ scientific argumentation: content analysis through text mining using latent dirichlet allocation
topic 1303 Specialist Studies in Education
Education
topic_facet 1303 Specialist Studies in Education
Education
url http://hdl.handle.net/10453/144137