Metacognitive Management of Attention in Online Learning.

Performance during training is a poor predictor of long-term retention. Worse yet, conditions of training that produce rapidly improving performance typically do not produce long-lasting, generalizable learning. As a result, learners and instructors alike can be misled into adopting training or educational experiences that are suboptimal for producing actual learning.

Going beyond the spacing effect: Does it matter how time on a task is distributed?

We assessed the effects of removing some constraints that characterise traditional experiments on the effects of spaced, rather than massed, study opportunities. In five experiments-using lists of to-be-remembered words-we examined the effects of how total study time was distributed across multiple repetitions of a given to-be-remembered word. Overall, within a given list, recall profited from study time being distributed (e.

Where and how to learn: The interactive benefits of contextual variation, restudying, and retrieval practice for learning.

Students are often advised to do all of their studying in one good place, but restudying to-be-learned material in a new context can enhance subsequent recall. We examined whether there are similar benefits for testing. In Experiment 1 ( = 106), participants studied a 36-word list and 48 hr later-when back in the same or a new context-either restudied or recalled the list without feedback.

Improving conceptual learning via pretests.

Although examples can be structured to emphasize diagnostic features of concepts, novice learners tend to focus on irrelevant surface features and struggle to encode deeper structures. Experiment 1 examined whether pretesting-answering questions about content before it is studied-could enhance learners' noticing of diagnostic features, making them easier to process during subsequent study. Participants studied statistical concepts with examples that emphasized surface details or deep structure, and then classified new examples of these concepts.

Forgetting as the friend of learning: implications for teaching and self-regulated learning.

One of the "important peculiarities" of human learning (Bjork RA and Bjork EL. , 1992, p. 35-67) is that certain conditions that produce forgetting-that is, impair access to some to-be-learned information studied earlier-also enhance the learning of that information when it is restudied.

How should exemplars be sequenced in inductive learning? Empirical evidence versus learners' opinions.

The sequencing of exemplars during study can have a large effect on category or concept induction. Counter to learners' intuitions, interleaving exemplars from different categories is often more effective for learning the different underlying categories than is blocking all the exemplars by category (e.g.

On the learning benefits of confidence-weighted testing.

Taking multiple-choice practice tests with competitive incorrect alternatives can enhance performance on related but different questions appearing on a later cued-recall test (Little et al., Psychol Sci 23:1337-1344, 2012). This benefit of multiple-choice testing, which does not occur when the practice test is a cued-recall test, appears attributable to participants attempting to retrieve not only why the correct alternative is correct but also why the other alternatives are incorrect.

On the difficulty of mending metacognitive illusions: A priori theories, fluency effects, and misattributions of the interleaving benefit.

Interleaving exemplars of to-be-learned categories-rather than blocking exemplars by category-typically enhances inductive learning. Learners, however, tend to believe the opposite, even after their own performance has benefited from interleaving. In Experiments 1 and 2, the authors examined the influence of 2 factors that they hypothesized contribute to the illusion that blocking enhances inductive learning: Namely, that (a) blocking creates a sense of fluent extraction during study of the features defining a given category, and (b) learners come to the experimental task with a pre-existing belief that blocking instruction by topic is superior to intermixing topics.

Multiple-choice pretesting potentiates learning of related information.

Although the testing effect has received a substantial amount of empirical attention, such research has largely focused on the effects of tests given after study. The present research examines the effect of using tests prior to study (i.e.

Improving encoding strategies as a function of test knowledge and experience.

Information that is produced or generated during learning is better remembered than information that is passively read, a phenomenon known as the generation effect. Prior research by deWinstanley and Bjork (Memory & Cognition, 32, 945-955, 2004) has shown that learners, after experiencing the memorial benefits of generation in the context of a fill-in-the-blank test following the study of a text passage containing both to-be-read and to-be-generated items, become more effective encoders of to-be-read items on a second passage, thus eliminating the generation effect on a subsequent memory test. Current explanations of this phenomenon assume that learners need to actually experience the generation advantage on the test of the first passage to become more effective encoders of to-be-read items on the second passage.

Retrieval-induced forgetting is associated with increased positivity when imagining the future.

People often think of themselves and their experiences in a more positive light than is objectively justified. Inhibitory control processes may promote this positivity bias by modulating the accessibility of negative thoughts and episodes from the past, which then limits their influence in the construction of imagined future events. We tested this hypothesis by investigating the correlation between retrieval-induced forgetting and the extent to which individuals imagine positive and negative episodic future events.

Can Multiple-Choice Testing Induce Desirable Difficulties? Evidence from the Laboratory and the Classroom.

The term desirable difficulties (Bjork, 1994) refers to conditions of learning that, though often appearing to cause difficulties for the learner and to slow down the process of acquisition, actually improve long-term retention and transfer. One known desirable difficulty is testing (as compared with restudy), although typically it is tests that clearly involve retrieval--such as free and cued recall tests--that are thought to induce these learning benefits and not multiple-choice tests. Nonetheless, multiple-choice testing is ubiquitous in educational settings and many other high-stakes situations.

Judgments of learning as memory modifiers.

A frequent procedure used to study how individuals monitor their own learning is to collect judgments of learning (JOLs) during acquisition, considered to be important, in part, because such judgments are assumed to guide how individuals allocate their future learning resources. In such research, however, a tacit assumption is frequently made: Namely, that asking for such metacognitive judgments does not affect the learning process per se. In 3 experiments, the present research addressed the accuracy of this assumption and tested a possible account--based on aspects of Koriat's cue-utilization approach to JOLs (Koriat, 1997) and de Winstanley, Bjork, and Bjork's (1996) transfer-appropriate multifactor account of generation effects--for why the mere act of making JOLs might enhance later memory for the information so judged.

Multiple-choice tests stabilize access to marginal knowledge.

Marginal knowledge refers to knowledge that is stored in memory, but is not accessible at a given moment. For example, one might struggle to remember who wrote The Call of the Wild, even if that knowledge is stored in memory. Knowing how best to stabilize access to marginal knowledge is important, given that new learning often requires accessing and building on prior knowledge.

Optimizing multiple-choice tests as tools for learning.

Answering multiple-choice questions with competitive alternatives can enhance performance on a later test, not only on questions about the information previously tested, but also on questions about related information not previously tested-in particular, on questions about information pertaining to the previously incorrect alternatives. In the present research, we assessed a possible explanation for this pattern: When multiple-choice questions contain competitive incorrect alternatives, test-takers are led to retrieve previously studied information pertaining to all of the alternatives in order to discriminate among them and select an answer, with such processing strengthening later access to information associated with both the correct and incorrect alternatives. Supporting this hypothesis, we found enhanced performance on a later cued-recall test for previously nontested questions when their answers had previously appeared as competitive incorrect alternatives in the initial multiple-choice test, but not when they had previously appeared as noncompetitive alternatives.

Expecting to teach enhances learning and organization of knowledge in free recall of text passages.

The present research assessed the potential effects of expecting to teach on learning. In two experiments, participants studied passages either in preparation for a later test or in preparation for teaching the passage to another student who would then be tested. In reality, all participants were tested, and no one actually engaged in teaching.

Why interleaving enhances inductive learning: the roles of discrimination and retrieval.

Kornell and Bjork (Psychological science 19:585-592, 2008) found that interleaving exemplars of different categories enhanced inductive learning of the concepts based on those exemplars. They hypothesized that the benefit of mixing exemplars from different categories is that doing so highlights differences between the categories. Kang and Pashler (Applied cognitive psychology 26:97-103, 2012) obtained results consistent with this discriminative-contrast hypothesis: Interleaving enhanced inductive learning, but temporal spacing, which does not highlight category differences, did not.

Multiple-choice tests exonerated, at least of some charges: fostering test-induced learning and avoiding test-induced forgetting.

Among the criticisms of multiple-choice tests is that-by exposing the correct answer as one of the alternatives-such tests engage recognition processes rather than the productive retrieval processes known to enhance later recall. We tested whether multiple-choice tests could trigger productive retrieval processes-provided the alternatives were made plausible enough to enable test takers to retrieve both why the correct alternatives were correct and why the incorrect alternatives were incorrect. In two experiments, we found not only that properly constructed multiple-choice tests can indeed trigger productive retrieval processes, but also that they had one potentially important advantage over cued-recall tests.

Using verification feedback to correct errors made on a multiple-choice test.

A key educational challenge is how to correct students' errors and misconceptions so that they do not persist. Simply labelling an answer as correct or incorrect on a short-answer test (verification feedback) does not improve performance on later tests; error correction requires receiving answer feedback. We explored the generality of this conclusion and whether the effectiveness of verification feedback depends on the type of test with which it is paired.

Thinking can cause forgetting: memory dynamics in creative problem solving.

Research on retrieval-induced forgetting has shown that retrieval can cause the forgetting of related or competing items in memory (Anderson, Bjork, & Bjork, 1994). In the present research, we examined whether an analogous phenomenon occurs in the context of creative problem solving. Using the Remote Associates Test (RAT; Mednick, 1962), we found that attempting to generate a novel common associate to 3 cue words caused the forgetting of other strong associates related to those cue words.

The costs and benefits of testing text materials.

Tests have been shown to improve the later recall of tested information, a result known as the testing effect. Tests, however, can also impair the later recall of related information, an effect known as retrieval-induced forgetting. Although retrieval-induced forgetting has been demonstrated using a wide variety of materials, recent work suggests that learning information in the context of a coherent text passage may afford protection from retrieval-induced forgetting.

Retrieval experience as a modifier of future encoding: another test effect.

Research on how individuals monitor their level of comprehension during study paints a picture of learners as being insensitive to many of the factors or conditions of learning that can enhance long-term retention and transfer. In previous research, however, deWinstanley and Bjork (2004) demonstrated that learners--if made sensitive to the memorial benefits of generation in the context of an informative test following study of a text passage in which they had encoded both to-be-read and to-be-generated critical items--then became more effective processors of future to-be-read information presented in a 2nd text passage. In Experiments 1 and 2 of the present research, we explored the potential applicability of this effect by testing whether it could survive certain types of activity-filled delays.

Part-list cuing and the dynamics of false recall.

False recall of an unpresented critical word after studying its semantic associates can be reduced substantially if the strongest and earliest-studied associates are presented as part-list cues during testing (Kimball & Bjork, 2002). To disentangle episodic and semantic contributions to this decline in false recall, we factorially manipulated the cues' serial position and their strength of association to the critical word. Presenting cues comprising words that had been studied early in a list produced a greater reduction in false recall than did presenting words studied late in the list, independent of the cues' associative strength, but only when recall of the cues themselves was prohibited.

Knowledge retention after an online tutorial: a randomized educational experiment among resident physicians.

Background: The time course of physicians' knowledge retention after learning activities has not been well characterized. Understanding the time course of retention is critical to optimizing the reinforcement of knowledge.

Design: Educational follow-up experiment with knowledge retention measured at 1 of 6 randomly assigned time intervals (0-55 days) after an online tutorial covering 2 American Diabetes Association guidelines.

Accelerated relearning after retrieval-induced forgetting: the benefit of being forgotten.

Research on retrieval-induced forgetting has demonstrated that retrieving some information from memory can cause the forgetting of other information in memory. Here, the authors report research on the relearning of items that have been subjected to retrieval-induced forgetting. Participants studied a list of category- exemplar pairs, underwent a series of retrieval-practice and relearning trials, and, finally, were tested on the initially studied pairs.