onstructing a Norm for Children’s Scientific Drawing: Distribution Features Based on Semantic Similarity of Large Language Models
he use of childrens drawings to examining their conceptual understanding has been proven to be an effective method, but there are two major problems with previous research: 1. The content of the drawings heavily relies on the task, and the ecological validity of the conclusions is low; 2. The interpretation of drawings relies too much on the subjective feelings of the researchers. To address this issue, this study uses the Large Language Model (LLM) to identify 1420 childrens scientific drawings (covering 9 scientific themes/concepts), and uses the word2vec algorithm to calculate their semantic similarity. The study explores whether there are consistent drawing representations for children on the same theme, and attempts to establish a norm for childrens scientific drawings, providing a baseline reference for follow-up childrens drawing research. The results show that the representation of most drawings has consistency, manifested as most semantic similarity>0.8. At the same time, it was found that the consistency of the representation is independent of the accuracy (of LLMs recognition), indicating the existence of consistency bias. In the subsequent exploration of influencing factors, we used Kendall rank correlation coefficient to investigate the effects of "sample size", "abstract degree", and "focus points" on drawings, and used word frequency statistics to explore whether children represented abstract themes/concepts by reproducing what was taught in class. It was found that accuracy (of LLMs recognition) is the most sensitive indicator, and data such as sample size and semantic similarity are related to it; The consistency between classroom experiments and teaching purpose is also an important factor, many students focus more on the experiments themselves rather than what they explain.
Yi Zhang、Fan Wei、Jingyi Li、Yan Wang、Yanyan Yu、Jianli Chen、Zipo Cai、Xinyu Liu、Wei Wang、Sensen Yao、Peng Wang、Zhong Wang
first primary school, fengtai, beijingfangzhuang primary school, fengtai, beijingcolledge of elementary education, capital normal universityfirst primary school, fengtai, beijingfirst primary school, fengtai, beijingfirst primary school, fengtai, beijingfirst primary school, fengtai, beijingfirst primary school, fengtai, beijingfirst primary school, fengtai, beijingbeijing fengtai institute of education, fengtai ,beijinghepingli no.9 primary school, dongcheng, beijingBeijing Doers Education Consulting Co.,Ltd, Beijing
科学、科学研究教育
children’s drawingsnormLLMWord2vecsemantic similaritydistribution
children’s drawingsnormLLMWord2vecsemantic similaritydistribution
Yi Zhang,Fan Wei,Jingyi Li,Yan Wang,Yanyan Yu,Jianli Chen,Zipo Cai,Xinyu Liu,Wei Wang,Sensen Yao,Peng Wang,Zhong Wang.onstructing a Norm for Children’s Scientific Drawing: Distribution Features Based on Semantic Similarity of Large Language Models[EB/OL].(2025-08-29)[2025-09-04].https://chinaxiv.org/abs/202508.00424.点此复制
评论