Web-Based Intelligent Tutoring System Delivers Powerful Reading Comprehension Strategy to Children

Transcription

1 Web-Based Intelligent Tutoring System Delivers Powerful Reading Comprehension Strategy to Children Kay Wijekumar, Ph.D. Bonnie J.F. Meyer, Ph.D. Puiwa Lei Ph.D. The research reported here was supported by the Institute of Education Sciences, U.S. Department of Education, through Grant R305G to The Pennsylvania State University. The opinions expressed are those of the authors and do not represent views of the Institute or the U.S. Department of Education. Please address all communications regarding this poster to Dr. Kay Wijekumar,

2 Outline The Structure Strategy Web-Based Tutoring Efficacy Studies Grades 4,5,7, and 8 Results Lessons learned

3 Models of Comprehension Construction Integration (Kintsch & van Dijk) Landscape (van den Broek) Text Structure Model (Meyer) Top-Down Integration with Prior Knowledge Reader-Text-Task

4 The Text Structure Strategy Selection, Encoding, Strategic Memory, Comprehension Monitoring, and Application (Meyer, 1975 ) Five Text Structures and Nested Structures 4 Steps to Application Signals/Linking Words Identify Text Structure Summarize Using a Main Idea Pattern Recall/apply/monitor

5 4 Steps Comparison Structure 1. Determine the text structure by finding the linking signaling words for the comparison text structure e.g., compared, different, in contrast, similarly, but, however, the same as, 2. Write a main idea using the main idea pattern for the comparison text structure and were compared on,, and. 3. Recall information by using the main idea as a guide 4. Monitor comprehension by checking your main idea pattern to organize and review the parallel components of the compared entities

6 Example 1 Comparison Structure Differences Between Favorite Presidents of the U.S.A. George Washington was a farmer and military commander. He was the first President of the United States. George Washington raised two stepchildren. On the other hand, Abraham Lincoln was a lawyer. He was the 16th President of the United States. In contrast to George Washington, Abraham Lincoln had four sons, Robert, Edward, William, and Thomas.

7 Main Idea Abraham Lincoln and George Washington were compared on jobs, order of presidency, and children. Comparing Presidents Abraham Lincoln George Washington 16th Lawyer 4 sons 1st Farmer 2

8 Structure Strategy and Reading Comprehension Text Structure Comparison, Problem and Solution, Cause and Effect, Sequence, and Description Expanding access to the structure strategy Consistent delivery, modeling, assessment, scaffolding, and feedback Multiple domains Wide range of reading levels and prior knowledge Designing for learners Integrating with current practices

9

10

11

12

13

14

15 ITSS Efficacy Studies 3 States Over 60 schools Over 14,000 total users on the system Approximately 130 teachers at each grade level Tools Study Management Data management Wijekumar, Meyer, Lei, ( ) U.S. Department of Education The research reported here was supported by the Institute of Education Sciences, U.S. Department of Education, through Grant R305G to The Pennsylvania State University. The opinions expressed are those of the authors and do not represent views of the Institute or the U.S. Department of Education.

16 The following tables are from recent publications cited below: Wijekumar, K., Meyer, B.J.F., Lei, P.-W, Lin, Y., Johnson, L.A., Shurmatz, K., Spielvogel, J., Ray,M, & Cook, M. (2014). Improving reading comprehension for 5 th grade readers in rural and suburban schools using web-based intelligent tutoring systems. Journal of Research in Educational Effectiveness, 7:4, , DOI: / Wijekumar, K., Meyer, B.J.F., Lei, P.-W. (2013). High-fidelity implementation of web-based intelligent tutoring system improves fourth and fifth graders content area reading comprehension. Computers & Education, 68, Wijekumar, K., Meyer, B.J.F., Lei, P. (2012). Large-scale randomized controlled trial with 4 th graders using intelligent tutoring of the structure strategy to improve nonfiction reading comprehension. Journal of Educational Technology Research and Development. 60,

17 ITSS Efficacy 5 th Grade Effect Sizes Effect size (standard error) from HLM a Measures Coefficient for ITSS Pooled studentlevel standard deviation Gray Silent Reading Test 2.34*** (.44) Comparison text Signaling test 2.93*** (.39) Main idea quality.82*** (.08) Total recall 5.57*** (1.07) Comparison competence.64*** (.14) Problem and solution text Total recall 2.38*** (.64) Problem and solution competence.37** (.12) Note. Effect size = Adjusted difference between ITSS (coded ½) and Control (coded -½) groups divided by the student-level pooled standard deviation. **p<.01, ***p<.001. Source: Wijekumar et al., 2013

18 ITSS Efficacy 7 th Grade Effect Sizes Measures Coefficient for ITSS (standard error) from HLM a Pooled studentlevel pretest standard deviation Effect size Gray Silent Reading Test 2.06** (.48) Comparison text (1) Signaling test 1.59*** (.41) Top level structure.68*** (.12) # issues.27* (.12) Competence.29* (.12) Comparison text (2) Advanced Top level structure.49*** (.13) # issues.14* (.06) Competence.27** (.10) Main Idea Top level structure.70*** (.10) # issues.50*** (.08) Competence.37*** (.06) Problem and solution text Top level structure.57*** (.15) Competence.51*** (.13) Note. Effect size = Adjusted difference between ITSS (coded ½) and Control (coded -½) groups divided by the student-level pooled standard deviation. *p<.05**p<.01, ***p<.001.

19 Lessons Learned Teacher roles in technology use Teacher knowledge and efficacy in text structure and teaching with text structure Misconceptions about text structure School technology infrastructure and support variability

20 Related findings and New Developments Writing* (collaboration with Drs. Karen R. Harris and Steve Graham, Arizona State University) Strategy Instruction on the Web for Spanish speaking English Language Learners (SWELL) Changing profiles of learners Teacher and intelligent tutor roles Wijekumar, Harris, Meyer, Graham, Lei ( ) U.S. Department of Education.

21 When Linking Signals are Not Present Favorite Presidents of the U.S.A. George Washington was a farmer and military commander. He was the first President of the United States. George Washington raised two stepchildren. Abraham Lincoln was a lawyer. He was the 16th President of the United States. George Washington, Abraham Lincoln had four sons, Robert, Edward, William, and Thomas.

22

23

24

25 These research projects were funded by the U.S. Department of Education, Institute for Education Sciences