Exploring the Impact of and Perceptions about Interactive, Self-Explaining Environments in Molecular-Level Animations David a. Falvo*1, Michael J. Urban2 and Jerry P. Suits3 ^^ This mixed-method study investigates the effects of interactivity in animations of a molecular-level process and explores perceptions about the animated learning tool used. Treatments were based on principles of cognitive psychology designed to study the main effects of treatment and spatial ability and their interaction. Results with students (n=189) showed that science majors scored higher than non-science majors in retention measures (i.e., structure and function) but not in transfer. Significant main effects were found for treatment in function questions and spatial ability in structure questions. There was a significant interaction between treatment and spatial ability in structure questions. Additionally, in this study participants believed the key and the motion of ions and molecules were the most helpful parts of the animation. This study shows that students perceive the animations as being supportive of their learning, suggesting that animations do have a role in science classrooms. Keywords: Interactive learning environments, Simulations, Visualisations 1 * Corresponding author. Richard W. Riley College of Education and Leadership Walden University, 155 Fifth Ave. South, Suite 100, Minneapolis, MN 55401 david.falvo@waldenu.edu 2 Professional Education, Campus Box 35, Bemidji State University, Bemidji, MN 56601 3 Chemistry & Biochemistry, Campus Box 98,University of Northern Colorado, Greeley, CO Študija vpliva in zaznavanja interaktivnih samorazlagalnih okolij animacij molekularne ravni David A. Falvo*, Michael J. Urban in Jerry P. Suits Študija, izvedena po kombiniranem raziskovalnem pristopu, je ugotavljala učinke interaktivnosti v animacijah procesa na molekularni ravni in zaznave, povezane s tem animacijskim učnim orodjem. Obravnava učne vsebine je temeljila na načelih kognitivne psihologije, proučevani pa so bili glavni učinki obravnave vsebine in prostorske sposobnosti udeležencev. Rezultati učnega uspeha študentov (n = 189) kažejo, da študentje naravoslovja dosegajo višje rezultate kot študentje nenara-voslovnih ved pri preverjanju pomnjenja vsebine (npr. struktura in funkcija), ne pa tudi pri transferu znanja. Pomembni učinki so bili ugotovljeni pri obravnavi vsebine, kadar so bila vprašanja povezana s funkcijo in prostorskimi sposobnostmi, ne pa tudi pri vprašanjih, povezanih s strukturo. Pomembna povezava pa je med obravnavo vsebine in prostorskimi sposobnostmi, kadar so bila vprašanja povezana s strukturo. Udeleženci raziskave so izrazili, da sta bila legenda ter gibanje ionov in molekul del animacije, ki jim je bil najbolj v pomoč pri učenju. Študija ugotavlja, da študentje dojemajo animacije kot učinkovito podporo pri učenju, zato imajo pomembno vlogo pri pouku naravoslovja. Ključne besede: vizualizacija, interaktivna učna okolja, simulacije Introduction A great deal of research has been conducted about improving students' conceptual understandings of chemistry at three different representation levels (i.e., symbolic, particle and macroscopic levels) (Johnstone, 1993; Gabel, 2005). Nurrenbern and Pickering (1987), Sawrey (1990), and Nakhleh (1993) claim that traditional instruction tends to focus on the symbolic level (see Figure 1) in lectures and the macroscopic level in the laboratory. Research has led to specific design principles for instructional multimedia (Chandler & Sweller, 1991; Mayer, 2001). Words and pictures should be used simultaneously and should be presented close to each other in space, while narration should be provided in audio format. Additionally, visualisations and symbols augment human cognitive capacities and help to convey concepts and information (Tversky, 2001). Figure 1: Image of molecules from salt dissolving in water animation. Historically, there have been problems in the use of animations for teaching. Due to the fact that animations sometimes mislead learners, causing misunderstandings, there has been a history of caution about using these tools for teaching. Viewers often interpret movements of forms and figures in an animation as having causality, relationships and even intentions (Martin & Tversky, 2003; Tasker, 2004; Tversky, 2005). Learners assume that the colours and the shapes reflect the actual reality of the represented items, whereas the shapes and colours are, in fact, either symbolic or an idealisation of time and space relations. When effectively designed and used, these visualisations help to ensure adequate perception and comprehension in the real-world context of student learning (Kelly, 2005; Tasker, 2004; Tversky, 2001; Zacks & Tversky, 2003). Theoretical Framework Several studies of self-explaining environments show the effectiveness of this technique (Chi, 1996, 2000). Two studies have shown that students enhance their mental models when they engage in defining explanations of concepts and processes (Chi, 2000; Chi, DeLeeuw, Chiu, & Lavancher, 1994). In another study, researchers found that having students explain a concept using prior knowledge and cognitive reasoning improved the transfer of knowledge learning about the process (Atkinson, Renkl, & Merrill, 2003). Transfer of knowledge learning is defined as the ability to apply knowledge or skills learned in one context to another context. In addition, several learner characteristics can affect how learners perceive and interact with animation features, and may alter the cognitive load they experience (Cook, 2006). In order to study the spatial ability effect on learning from an animation (Schar & Zimmermann, 2007), students were classified as "high spatial" or "low spatial" (Peters et al., 1995; Vandenberg & Kuse, 1978). High-spatial learners may learn better when visual and verbal information is presented simultaneously rather than successively. Conversely, low-spatial learners may not benefit from this design feature (Mayer & Moreno, 2003). Prior knowledge, a covariate in the present study, can influence the representations processed in working memory and how these representations are organised into coherent mental models (Cook, 2006; Schnotz, 2002). There is a difference between how novices and experts process information from an unfamiliar visual representation. Novices focus on the surface features of their perceptual representation, while experts link this representation to a higher level that involves conceptual understanding of the material. Experts omit irrelevant perceptual information and abstract required information from their relevant prior knowledge. Their long-term memory is organised and retrieved as well-developed schemas (Chi, Glaser, & Rees, 1982). Conversely, novices can be confused by visualisations because they lack the prior knowledge to distinguish between relevant and irrelevant information (Linn, 2003). Research Focus This study investigated the interactive environments in a molecular animation in a classroom setting rather than in a laboratory (Cook, 2006). The animation featured sodium chloride (salt) dissolving in water at the molecular level (Tasker et al., 2002). Students saw structures of solid sodium chloride, water molecules, and the structures that resulted when water molecules dissolved the ionic structures of sodium chloride crystals. They witnessed the function of the sodium-chloride ionic attraction that resisted this dissolving process and the opposing function where the water-ion attraction overcomes this resistance to dissolve these ions. The research questions for this study were: • RQ1) Does treatment (i.e., type of interactivity and the self-explaining environment used in the molecular-level animation) affect performance on the dependent variables, which are the post-test knowledge assessments? • RQ2) Does spatial ability (high or low) affect performance on the dependent variables, which are the post-test knowledge assessments? • RQ3) Is there a significant interaction between spatial ability and the treatment (version of the animation) that students engaged with during the study? Method Participants First-year students (n=189) at a Midwestern university participated in the study. These university students were either first-year science majors or elementary education majors. The volunteers were randomly assigned to one of the treatment groups or to the control group. Participants in the qualitative component of the study came from the same pool of individuals. Five females ranging between the ages of 18 and 25 volunteered to take part in the phenomenology with semi-structured interviews (Creswell, 1998). Instruments Students completed a demographic survey about their prior experience in science, as well as providing information about their age, gender and characteristics. Their spatial ability was assessed using the Vandenberg spatial ability assessment (Peters et al.,1995; Vandenberg & Kuse, 1978). Students also took a post-test, which was a knowledge assessment about the topic presented in the animation (i.e., salt dissolution in water at the molecular level). This test included structure and function questions that were used as retention measures. Research design Prior to watching the animation of sodium chloride (salt) dissolving in water (Tasker et al., 2002), students viewed the components of the animation (e.g., see Figure 2), which were detailed on a table within the interface. The first version of the animation was basic, including just the visuals and narration, and students were able to replay the animation. In the second version, students had the option of pausing the animation at any time and were able to replay the animation if they so desired. In the third version, the animation automatically paused at selected points (i.e., segments) in order to create five short sections. At each pause point the viewer/student was prompted to either replay the previous section or to move on to the next section. The viewers also had the ability to, at any time, view any of the five sections in any order. The final version of the animation paused between each of the five sections and students were prompted to self-explain what they were seeing and thinking. They did this in a textual format. Students were allowed to revisit each section of the animation in any order. Treatment: Four versions of an interactive/self-explaining environment The animations used in this study illustrated the process of sodium chloride (salt) dissolving in water at the molecular level (Tasker et al., 2002). It was modified with Flash to create four different versions based on cognitive principles of instructional design. Students viewed the components of the animation (e.g., see Figure 2) before interacting with one of its four versions. Version 1 - Control (Animation Only) The animation played through from start to finish. Students were able to replay the animation if they so desired. Version 2 - Pause Button. Students had the option of pausing the animation at any time. Students were able to replay the animation if they so desired. Version 3 - Pause Button, and Rewind and Forward Buttons. The animation automatically paused at selected points (i.e., segments) in order to create five short sections. At each pause point, the viewer/student was prompted to either replay the previous section or to move on to the next section. The viewer/student also had the ability to, at any time, view any of the five sections in any order. Version 4 -Pace with Self-Explaining Environment. The animation paused between each of the five sections and students were prompted to self-explain what they were seeing and thinking. They did this in a textual format. After submitting their self-explanation, they moved to the next segment of the animation. Students were allowed to revisit each section of the animation in any order. Salt Crystal/Lattice Sodium Water Moleculc Figure 2: Table of key features in the animation. Using SPSS, a general linear model multivariate ANCOVA was used to determine if any of the groups performed significantly better in the post-test. Using the Wilks' Lambda, the researchers explored three different aspects of the independent variables. The Wilks' Lambda (alpha = .05) measures of the proportion of variance in the combination of dependent variables that is unaccounted for by the independent variable (the grouping variable). The analyses explored the effect of treatment, spatial ability and their interaction on transfer knowledge, understanding of structural components and understanding of functional components. Data regarding whether or not participants were science majors was used as a covariate in the analyses. The researchers used the Tukey test as a post-hoc analysis to maintain a family-wise alpha of .05. This research also entailed a phenomenology with semi-structured interviews (Creswell, 1998). All five interviewees planned to become elementary school teachers and ranged in age from 18 to 25. During the interviews, the researchers asked several questions to identify what participants found helpful and what they liked about the animation. Also, they were asked to consider their diagrammatic sketch from the previous study to establish a sense of what they understood, or to let them enhance their sketch by making it more understandable. 52 exploring the impact of and perceptions about interactive, self-explaining ... Results Using SPSS, the MANCOVA test (Table 1) produced significant results for the model on the structure and function retention dependent variables but not for the transfer variable. For the covariant (science or non-science majors), overall the science majors did better on structure (p = .005) and function (p = .016) dependent variables (Table 2). Table 1: MANCOVA tests of between-subjects effects. Source Dependent Variable Type III Sum of Squares df Mean Square F Sig. Corrected Model structure function transfer 109.310 18.095