Updated on 2024/12/07

写真a

 
WANG, Qiao
 
Affiliation
Faculty of Science and Engineering, School of Creative Science and Engineering
Job title
Assistant Professor(without tenure)
Homepage URL

Research Experience

  • 2020.04
    -
    Now

    Waseda University   Faculty of Science and Engineering   Assistant Professor

Professional Memberships

  • 2022.07
    -
    Now

    Learner Corpus Association

  • 2022.04
    -
    Now

    The Japan Association for Language Education and Technology

  • 2022.04
    -
    Now

    The Japanese Association for Natural Language Processing

  • 2022.03
    -
    Now

    The Japanese Association for Language Teaching

  • 2021.09
    -
    Now

    CALICO

  • 2021.09
    -
    Now

    EUROCALL

▼display all

Research Areas

  • Foreign language education   Computer-Based Testing / Foreign language education   Automated Writing Evaluation / Foreign language education   Computer Assisted Language Learning

Research Interests

  • Large Language Models

  • Natural Language Processing

  • English Grammar

  • English for Academic Purposes

Awards

  • 奨学生

    2017.06   公益財団法人 西村奨学財団  

 

Papers

  • Effectiveness of large language models in automated evaluation of argumentative essays: finetuning vs. zero-shot prompting

    Qiao Wang, John Maurice Gayed

    Computer Assisted Language Learning    2024.07  [Refereed]

    Authorship:Lead author, Corresponding author

    DOI

  • Assessing the Efficacy of Grammar Error Correction: A Human Evaluation Approach in the Japanese Context

    Wang, Q, Yuan, Z

    Proceedings of the Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING)    2024.05  [Refereed]

    Authorship:Lead author, Corresponding author

  • Automated Generation of Multiple-Choice Cloze Questions for Assessing English Vocabulary Using GPT-turbo 3.5

    Qiao Wang, Ralph Rose, Naho Orita, Ayaka Sugawara

    Proceedings of the NLP4DH-IWCLUL 2023 Conference    2023.11  [Refereed]

    Authorship:Lead author

  • The role of live transcripts in synchronous online L2 classrooms: Learning outcomes and learner perceptions

    Wang Qiao, Chen Yijun

    Education and Information Technologies    2023.11  [Refereed]

    Authorship:Lead author

    DOI

  • A content-controlled monolingual comparable corpus approach to comparing learner and proficient argumentative writing

    Qiao Wang, Laurence Anthony, Nurul Ihsan Arshad

    Research Methods in Applied Linguistics   2 ( 2 )  2023.08  [Refereed]

    Authorship:Lead author

    DOI

  • The use of semantic similarity tools in automated content scoring of fact-based essays written by EFL learners

    Qiao Wang

    Education and Information Technologies    2022.11  [Refereed]

    Authorship:Lead author, Last author, Corresponding author

    DOI

  • Classroom intervention for integrating simulation games into language classrooms: An exploratory study with the SIMs 4

    Wang, Q

    CALL-EJ   20 ( 2 ) 101 - 128  2020.04  [Refereed]

    Authorship:Lead author, Last author, Corresponding author

  • The Role of Classroom-Situated Game-Based Language Learning in Promoting Students' Communicative Competence

    Qiao Wang

    International Journal of Computer-Assisted Language Learning and Teaching   10 ( 2 ) 59 - 82  2020.04  [Refereed]  [International journal]

    Authorship:Lead author, Last author, Corresponding author

     View Summary

    The study is the second in a series of mixed-methods studies on the integration of The Sims 4, a life-simulation game, into language classrooms. In this study, the researcher explores the effect of game-based language learning (GBLL) on students' English communicative competence from three aspects, interaction, fluency and content, in a Japanese university. In class, students received instruction from the teacher on game language and gameplay skills, played the game on their own and presented gameplay stories. The presentations were recorded for evaluation. Surveys were also administered for students' perceptions on the GBLL classroom. Results showed that no clear improvement in communicative competence was suggested by quantitative evaluation. Qualitatively data, however, indicated that the game afforded students interesting events and proper expressions in presentations and that the teacher played a vital role in ensuring ample interactional opportunities and linguistic support. Suggestions for future research in classroom-situated GBLL were also proposed.

    DOI

  • Out-of-school language learning through digital gaming: a case study from an activity theory perspective

    Ke Li, Mark Peterson, Qiao Wang

    Computer Assisted Language Learning     1 - 29  2024.07  [Refereed]

    Authorship:Lead author

    DOI

  • Mapping the research trends of digital game-based language learning (DGBLL): a scientometrics review

    Ke Li, Mark Peterson, Qiao Wang, Haitao Wang

    Computer Assisted Language Learning    2024.01

    DOI

  • The Use of Network-Based Virtual Worlds in Second Language Education

    Mark Peterson, Qiao Wang, Maryam Sadat Mirzaei

       2022.12

    DOI

  • Evaluation Dataset of Multiple-Choice Cloze Items for Vocabulary Training and Testing

    Ralph L. Rose, Naho Orita, Ayaka Sugawara, Qiao Wang

    Proceedings of the 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing    2022.09  [Refereed]

    DOI

  • A Review of Research on the Application of Digital Games in Foreign Language Education

    Mark Peterson, Jeremy White, Maryam Sadat Mirzaei, Qiao Wang

        1948 - 1971  2022

    DOI

  • Using Community of Inquiry to Scaffold Language Learning in Out-of-School Gaming

    Ke Li, Mark Peterson, Qiao Wang

    International Journal of Game-Based Learning   11 ( 1 ) 31 - 52  2021.01  [Refereed]

    Authorship:Lead author

    DOI

  • A Review of Research on the Application of Digital Games in Foreign Language Education

    Mark Peterson, Jeremy White, Maryam S. Mirzaei, Qiao Wang

    New Technological Applications for Foreign and Second Language Learning and Teaching    2020.03  [International journal]

     View Summary

    The use of digital games represents an expanding domain in computer-assisted language learning (CALL) research. This chapter reviews the findings of 26 learner-based studies in this area that are informed by cognitive and social accounts of SLA. The analysis shows that massively multiplayer online role-playing games (MMORPGs) are the most frequently investigated game type and the majority of studies involved EFL learners in higher education. Mixed methods were the most frequent research tool utilized by researchers. Limitations of current research include the preponderance of small-scale experimental studies that investigated only a limited number of factors. Although the research is not conclusive, findings indicate that game play facilitates collaboration, the production of target language output, vocabulary learning, and reduces the influence of factors that inhibit learning. This chapter concludes by identifying promising areas for future research.

    DOI

  • A Review of Research on the Application of Digital Games in Foreign Language Education

    Mark Peterson, Jeremy White, Maryam Sadat Mirzaei, Qiao Wang

        69 - 92  2020

    DOI

  • The Use of Network-Based Virtual Worlds in Second Language Education

    Mark Peterson, Qiao Wang, Maryam S. Mirzaei

    Assessing the Effectiveness of Virtual Technologies in Foreign and Second Language Instruction    2018.12  [International journal]

     View Summary

    This chapter reviews 28 learner-based studies on the use of network-based social virtual worlds in second language learning published during the period 2007-2017. The purpose of this review is to establish how these environments have been implemented and to identify the target languages, methods used, research areas, and important findings. Analysis demonstrates that research is characterized by a preponderance of small-scale studies conducted in higher education settings. The target languages most frequently investigated were English, Spanish, and Chinese. In terms of the methodologies adopted, analysis reveals the majority of studies were qualitative in nature. It was found that the investigation of learner target language production, interaction, and affective factors represent the primary focus of research. Although positive findings relating to the above areas have been reported, the analysis draws attention to gaps in the current research base. The researchers provide suggestions for future research.

    DOI

▼display all

Books and Other Publications

  • Research Anthology on Virtual Environments and Building the Metaverse

    Mark Peterson, Qiao Wang, Maryam Sadat Mirzaei( Part: Contributor, The Use of Network-Based Virtual Worlds in Second Language Education)

    2022.12 ISBN: 1668475979

    ASIN

  • New Technological Applications for Foreign and Second Language Learning and Teaching

    Mark Peterson, Jeremy White, Maryam Sadat Mirzaei, Qiao Wang( Part: Contributor)

    2020.03 ISBN: 1799825914

    ASIN

  • Higher education

    Qiao Wang, David Dalsky( Part: Contributor)

    2017.02 ISBN: 1942799772

    ASIN

Works

  • Online diagnostic grammar test (https://grammar-diagnosis.herokuapp.com)

    Wang Qiao  Web Service 

    2022.03
    -
    Now

  • VocaTT application (https://vocatt-server.herokuapp.com/)(updated version: vocatt-class1-yisiyu.org)

    Rose, R. Orita, N, Sugawara, A, Wang, Q  Web Service 

    2021.12
    -
    Now

  • Automated Multiple-Choice Cloze Question Generator for English Vocabulary (https://github.com/judywq/cloze-generator-with-llm)

    Wang, Q, Rose, R, Sugawara, A, Orita, N  Software 

Presentations

  • Enhancing vocabulary learning outcomes through gamification: A study of a web-based vocabulary application for Japanese university students learning the Academic Word List

    Qiao Wang

    EUROCALL 2023 

    Presentation date: 2023.08

  • Semantic similarity tools and their potential in automated content scoring of fact-based writing.

    Wang Qiao

    EuroCal 2022 

    Presentation date: 2022.08

    Event date:
    2022.08
     
     
  • Adding rich interaction and speech scripts into a game-based communication class: A case study with the game “Sims 4”

    Wang Qiao

    JALT CALL 

    Presentation date: 2022.06

    Event date:
    2022.06
     
     
  • Issues and concerns in the automatic generation of vocabulary training and testing items

    Rose, R, Wang, Q, Orita, N, Sugawara, A

    JALT CALL 

    Presentation date: 2022.06

    Event date:
    2022.06
     
     
  • The role of classroom-situated game-based language learning in promoting students’ communicative competence

    Wang Qiao

    The 18th AsiaCALL 

    Presentation date: 2021.11

    Event date:
    2021.11
     
     
  • Automated evaluation of semantic content in fact-based writing with semantic similarity tools

    Wang Qiao

    The 18th AsiaCALL 

    Presentation date: 2021.11

    Event date:
    2021.11
     
     

▼display all

Research Projects

  • The development of a computerized adaptive diagnostic grammar test for Japanese university students

    Japan Society for the Promotion of Science  Grants-in-Aid for Scientific Research

    Project Year :

    2023.04
    -
    2026.03
     

  • Automated evaluation of semantic content in fact-based writing with semantic similarity tools

    Waseda University  Grants for Special Research Projects (Support for Kaken Applicants)

    Project Year :

    2022.07
    -
    2023.03
     

  • The creation of a computer-based grammar diagnostic test for Japanese university students

    Waseda University  Grants for Special Research Projects (Research Base Creation)

    Project Year :

    2022.04
    -
    2023.03
     

  • 一般英語学習者のモチベーションと学習効果の向上を目指す教育ゲームの開発

    Waseda University  Grants for Special Research Projects (Early Scientists)

    Project Year :

    2021.04
    -
    2022.04
     

  • Developing gold standard data for Vocabulary Training and Testing

    Waseda University  Grant for Special Research Projects

    Project Year :

    2021.07
    -
    2022.03
     

    Ralph L. Rose, Naho Orita, Ayaka Sugawara, Qiao Wang

  • Integrating computer games into English writing classrooms

    Waseda University  Grants for Special Research Projects (Research Base Creation)

    Project Year :

    2020.07
    -
    2021.03
     

▼display all

 

Syllabus

▼display all

Teaching Experience

  • Special Topics in Functional English-Computer Assisted Language Learning

    Waseda University  

    2023.04
    -
    Now
     

  • Concept Building and Discussion

    Waseda University  

    2020.04
    -
    Now
     

  • Academic Reading

    Waseda University  

    2020.04
    -
    Now
     

 

Social Activities

  • Pro Bono Work

    Elixir English Training School 

    2018.03
    -
    2022.03

Academic Activities

  • Reviewer for Computer Assisted Language Learning

    Peer review

    2022.04
    -
    Now
  • Reviewer for ReCALL

    Peer review

    2023.09
    -
     

Internal Special Research Projects

  • Automated grammar error detection (GED) for texts written by Japanese university students

    2023   Zheng YUAN

     View Summary

    In this study, we evaluated the performance of the state-of-the-art sequence tagging grammar error detection and correction model (SeqTagger) using Japanese university students' writing samples. With an automatic annotation toolkit, ERRANT, we first evaluated SeqTagger's performance on error correction with human expert correction as the benchmark. Then a human-annotated approach was adopted to evaluate Seqtagger's performance in error detection using a subset of the writing dataset. Results indicated a precision of 63.66% and a recall of 20.19% for error correction in the full dataset. For the subset, after manual exclusion of irrelevant errors such as semantic and mechanical ones, the model shows an adjusted precision of 97.98\% and an adjusted recall of 42.98% for error detection, indicating the model’s high accuracy but also its conservativeness. Thematic analysis on errors undetected by the model revealed that determiners and articles, especially the latter, were predominant. Specifically, in terms of context-independent errors, the model occasionally overlooked basic ones and faced challenges with overly erroneous or complex structures. Meanwhile, context-dependent errors, notably those related to tense and noun number, as well as those possibly influenced by the students' first language (L1), remained particularly challenging.

  • The creation of a computer-based grammar diagnostic test for Japanese university students

    2022  

     View Summary

    A web-based testing system including the most important grammar points has been created, which can be accessed via https://grammar-diagnosis.herokuapp.com/

  • Automated Evaluation of Semantic Content in Fact-Based Writing with Semantic Similarity Tools

    2022  

     View Summary

    The research has yield fruitful results in the evaluation of open-source semantic similarity tools and in developing a web-based application for automated grading of fact-based writing. The evaluation part has been published in a high-impact journal, Education and Information Technologies, while the application is under beta test right now.

  • Integrating computer games into English writing classrooms

    2021  

     View Summary

    This study explores the role of story-rich computer games in narrative writing of Chinese university students. In a two-month writing class with the game Sim4, a participant received instruction on gameplay techniques and language, completed game quests set by the teacher, wrote 14 narratives based on gameplay events and received all-encompassing corrective feedback to her writing samples. A pre-test on game vocabulary and two writing pre- and post- tests based on non-game videos were also administered. The researchers evaluated the participant’s narrative writing performance with in-depth analysis of linguistic features in the writing samples, which included syntax, lexicon, cohesion and content. The analysis was conducted through NLP technology and inductive coding on revisions in the corrective feedback. A follow-up interview was conducted to complement results on writing evaluation and to provide information on the participant’s perception and attitude towards the GBW class. Results show that while writing evaluation did not indicate any consistent improvement in the participant’s narrative writing performance throughout the GBW class, the rich stories and contextualized vocabulary in the game contributed to her content and lexicon and helped her to better understand how to write narratives. The study further indicates that the challenges facing similar medium-level students in narrative writing are likely to be caused by inadequate grammatical competence and the inability to express ideas clearly in English, rather than by specific features of the narrative genre. Moreover, the all-encompassing feedback in the study was found to be cost-inefficient and thus is not recommended in future studies. 

  • 一般英語学習者のモチベーションと学習効果の向上を目指す教育ゲームの開発

    2021  

     View Summary

    This research aims to create a gamified application for students to learn English grammar. The researcher first referred to the CEFR and CEFR-J for well-stablished grammatical categories and wrote 180 questions corresponding to 180 grammar points under the categories. A group of 5 experts reviewed and finalized the questions to ensure they cover the most important grammar points in university students' exposure to English reading and writing. After that, a web-based app was developed for this research, where the users can take the grammar quizzes and get feedback. For gamification of the app, the researcher will add leaderboard features to encourage engagement from students. When this is done, the researcher will recruit students to try the app and iterate the app based on student feedback. Then, the researcher will make the app adaptive, which means the questions for each individual student will be based on his or her prior performance in the app.