Learning Replay

As our phase 3 BVS³D research efforts came to a close, we took the opportunity to conduct wrap-up site visits. While conducting student and teacher one-on-one interviews and observing 3D lessons, some interesting discoveries materialized. One such finding, emerging from our teacher interviews, we labeled learning replay.

The phenomenon of learning replay occurred frequently within our 3D classrooms: students expressed the interest in viewing 3D content over and again. Students wanted to see a segment one more time, to make sure that they understood the learning presentation; they wanted to view it again, in order to observe a specific phenomenon more carefully; they asked to see it again, not just because it was visually interesting, but because they wanted to think about a concept from a different perspective.

“Can we see it again?”

“Can we look at it one more time?”

“Can we run that segment over again?

These were the kinds of requests that teachers repeatedly heard. Interestingly, teachers never receive this kind of double-down request when using textbooks, PowerPoint, still graphics, or traditional video. The learning replay phenomenon also became evident after school, when students came in for extra help, tutoring, or to catch up due to an absence. Even though students could have quickly received their tutoring or completed their required makeup, and then rushed out to be with their friends and enjoin their social lives, students instead asked to review the 3D materials repeatedly.

As teachers described this phenomenon, noting the repeated student requests for viewing 3D learning content and witnessing firsthand the increased time on task, we knew we were observing something unique coming out of our 3D classroom experiment—learning replay. As more schools and universities engage in continued studies of 3D learning, this may track well as a potentially useful research question. It may be useful to observe, quantify, and explain the concept of learning replay in your own projects.

Findings from Phase 3

After taking some time for breaking news, we return now to our research series. The full "Phase 3" BVS³D research study conducted by Regis University is due to be released sometime in mid-to-late August. The following preview results, however, were highlighted during the Wednesday panel session at the ISTE 2011 conference:

All Grade Levels

• High interest levels demonstrated by students
• High levels of attention and focus demonstrated by students
• Less disruptive behaviors in classrooms

Elementary School Findings

• Special education students showed positive gains on post-test measures

Middle School Findings

• Positive impact on student understanding, according to teacher observations
• Visualization particularly helpful with the special education student

High School Findings

• Positive effects noted on student written work (more detailed descriptions and illustrations of concepts were evident)

3D@ISTE: AOA Press Release

Some of the most impactful research in the world of educational 3D is being led by the American Optometric Association. Last week, at the ISTE 2011 conference, the AOA issued a special press release provided below, in its entirety:

Referenced at the bottom of the press release is a heart-warming story, an event which occurred just last week in Florida. When 3D viewing difficulties were identified in a kindergarten-aged child, the resulting comprehensive eye exam led to the discovery of a congenital eye muscle disease that can now be treated five years before it would typically have even been diagnosed.


It is also interesting to reflect on the notion that 3D technologies will likely be required in the treatment of many of the eye disorders now being safely diagnosed through the use of 3D in homes, schools, universities, and cinemas.

3D@ISTE: Breaking News

I am interrupting my research series on the Future-Talk 3D blog to share some breaking news related to stereoscopic 3D events at the ISTE 2011 conference. Since the conference starts on Monday, June 27, I am also posting this entry three days ahead of schedule.

 There are now four events featuring stereoscopic 3D technologies at the ISTE 2011 conference. In scheduled order, these events include:

Poster Session

3D Comes to School: The Story Continues

Monday, 6/27/2011, 11:00am–1:00pm
PACC Broad St Atrium        Table: 26

Presenters: Kristin Donley, Dr. Carole Hruskocy, Len Scrogan, Nancye Blair

Learn about the coming explosion of 3D stereoscopic content for the classroom from educators in the second year of a national pilot focused on 3D in learning.

ISTE UnPlugged Session

The Future of Document Cameras

Tuesday, 6/29/2011, 1:00-1:30pm

Presenter: Nancye Blair, Educational Technology Specialist (FL) www.engagingeducation.net or Twitter @engagingedu
Experience how best practices with emerging technologies in document cameras, from wireless mobility to stereoscopic 3D capability, can breathe life into the 21st Century elementary classroom.

Exhibit Hall Presentation

3D Interactive Teaching = Student Engagement

Tuesday, 6/29/2011, 2:30-3:00 Dell Booth, Exhibit Hall

Presenter: Len Scrogan, University of Colorado-Denver and Lesley University

Panel Session

3D Teaching = Student Engagement in the Classroom

Wednesday, 6/29/2011, 10:15am–11:15am
Building/Room: PACC 113A

Panelists: The panel features four thought leaders in the field of 3D in education:

Dr. Carol Hruskocy. Dr. Hruskocy, Associate Professor of Education and Counseling at Regis University (CO), oversees two master degree programs. She is one of the researchers associated with the BVS-3D Case Study project in Boulder, Colorado. She has presented both nationally and internationally on a variety of topics including technology integration, faculty development for online facilitation and course development, and assessment of student learning. 

Kristin Donley. A talented science teacher and runner up Teacher of the Year in the state of Colorado, Kristin currently serves as a high school teacher at Monarch High School in the Boulder Valley School District. She has carried the lead role in the most successful implementation project for 3D in U.S. schools.

Chris Hawes. A trained psychologist, documentary film producer, cinematographer, and advisor to the 3D@Home Consortium, Chris will comment about the role of 3D at home, cinemas, and schools related to human factors research.

Len Scrogan. Your humble blog author will provide an introduction and serve as the moderator for this unique panel session.

Breaking 3D news for those 3-D enthusiasts that are attending the ISTE conference in Philadelphia.

With the demand for 3D technology and educational content on the rise, a 3D document camera is joining the ranks. A 3D Ladibug from Lumens promises to be nothing less than a game-changer. It’s a stereoscopic visual presenter that allows teachers to handcraft unlimited 3D activities supporting standards in math, science, and literacy. The 3D Ladibug Document Camera can be experienced throughout ISTE in the Exhibit Hall at the Ladibug Document Camera Booth, #1049.  The booth will also feature interactive 3D presentations by pilot educator, Nancye Blair, on Monday and Tuesday at 10am and 2pm.  

I will feature this promising new technology in a coming Future-Talk 3D blog post, as well, and discuss the groundbreaking nature of this development.

Findings from Phase 2 (Part 3)

Our final Phase 2 BVS³D findings were school-specific. These findings emerged from classroom-based action research efforts that also helped target and focus the more rigorous Phase 3 evaluation being planned.

High school classrooms

Two interesting findings emerged from our high school action research efforts, which were characterized by much more aggressive data collection efforts:

• Using a 3D lesson (the only variable changed in the instruction) in AP biology classes, our lead teacher saw a small achievement bump of 11% in the essay component of an AP Biology unit test on cell parts and active/passive transport (as compared with historical performance levels).
• A 76% favorable survey rating by students, indicating their preference for 3D learning over traditional learning experiences. 

 Middle school classrooms

Again, our pilot middle school received its equipment later in the project cycle. As a result, at this stage we only received anecdotal comments that the students were really “excited about it” and “understood [classroom] concepts better.” This middle school fully participated in Phase 3 of the case study, so concrete results will be forthcoming in late June or July.

Elementary school classrooms

At the elementary school level, the use of stereoscopic 3D in three 4th grade classrooms was extremely limited due to the lack of educational content for lower grade levels. Still, using some very appropriate 3D math simulations, two interesting findings emerged:

• 3D lessons in math can be easily and successfully conducted simultaneously with desk-based, hands-on activities and manipulatives. (For example, students replicated visual lessons with acetate sheets at their desks, as teachers manipulated the 3D imagery on the screen. Also, 3D in-hand replicas of 3D screen imagery were manipulated simultaneously at student desks.) It was felt that 3D instruction was even more effective with these activities, than without them.

• Preliminary evidence revealed that 3D lessons may indeed have a positive impact on reducing stubborn achievement gap problems: historically struggling students experienced two-and-a-half times the gains on informal post-test measures than other students.

Findings from Phase 2 (Part 2)

One of the pleasant and unexpected surprises that emerged from Phase 2 of our BVS³D project came from our special education case study site, Halcyon Middle-High School. This school serves a few dozen students in a warm and measurably effective day treatment program, supported by a highly trained and extremely dedicated staff. Halcyon Middle-High School is a unique educational and therapeutic program for BVSD students’ grades 6-12.  (HMHS is supported through a multi-agency agreement among the Boulder Valley School District, the Mental Health Center serving Boulder and Broomfield Counties and Boulder County’s Department of Housing and Human Services.)

According to Matt Dudek, the principal of Halcyon, the focus of this highly successful day treatment program is to “provide quality education to students as well as provide therapeutic behavioral interventions and strategies to students and their families.” He adds:  “While at HMHS, students and their families address barriers to success and develop and implement strategies which ultimately allow students to be successful at home, at school and in their community.”

Unlike our other case study schools, this school used entirely different metrics for evaluating the benefits of 3D in instruction. The key goal for this school was to provide access to learning in an environment where access, student focus, and sustained learning opportunities could at times be difficult to sustain. Therefore, this school’s approach was more behavioral in nature. Due to their unique instructional challenges, this school was hoping to see how 3D instruction would affect:

• attendance
• the ability to focus on learning
• time on task
• reduced behavioral incidents
• engagement

During Phase 2 of the case study, an energized Halcyon teacher, Greg All, taught more than six "3D lessons" focusing on the reproductive, digestive, and circulatory systems. 3D content was primarily used to introduce new content or review previously taught content. The results, still informal in nature, exceeded expectations. In the words of the project’s lead teacher:


- 3D kept kids on the edge of their seats
-  In this school’s unique environment, it worked REALLY WELL
-  We have seen very good behavior management results
-  Students were well focused, not distracted as usual
-  There is no way anything works like this for behavior—enabling these students to learn for an entire 40 minute class without any behavior call outs.

Students also weighed in with comments:


-  “Love it“
-  “This is cool“
-  “Awesome“
-  “I Love it“
-  “This is not as good as ‘Avatar,’ though!”

So what's the upshot? Each time it was used, 3D instruction provided students and teachers in this challenging educational environment with 40 minutes of uninterrupted quality science instruction. Access to curriculum. Total focus. No behavioral incidents. That's significant.

Findings from Phase 2 (Part 1)

During Phase 2 of the BVS³D project, much of our time was spent developing the initial research questions and selecting content for the final research study. Concurrently, our teachers were busy testing a growing collection of stereoscopic 3D content in their lessons, hoping to learn as much as they could about teaching with 3D.

Our Phase 2 findings came from the intentional classroom-based action research efforts of our talented teaching staff. At this stage, our efforts were informal and lacked rigorous controls, but the results were still quite informative. Our Phase 2 findings helped further aim and focus the more rigorous Phase 3 evaluation that was yet to come.

In the second phase of the BVS³D case study, the following general findings were clearly and consistently evident across all schools:

Higher levels of student engagement and interest

‘Engagement’ is a fuzzy concept, so a more precise operational definition of student engagement slowly began to emerge from Phase 2 of our case study. In our environment, across all grade levels, ‘engagement’ involved increased attention to subject matter (focus), longer sustained focus on difficult materials (attention span), and improved student behavior, as defined by less behavior incidents per lesson (classroom discipline).

Favorable reactions by students

For example, a high school survey revealed a 76% favorable rating by students, indicating their preference for 3D learning over traditional learning experiences. Elementary, middle school, and special education feedback was similarly positive.

Greater student clarity in understanding abstract concepts

In this case, it is best to let the students speak for themselves:

-   “It provided a better visualization than the textbook.”

-   “It helped to see a 3D view of things; it was easier for me to picture it and understand the structure.”

-   "The 3D really helps me learn and visualize complex structures and processes.  I love seeing what is actually going on to the cellular level.”

-   "These 3D videos do help me learn it easier, especially because I'm a visual learner.  Seeing what is going on is much more helpful than just talking about it.  Especially because it's in 3D—it’s literally in front of you."

    In our next two postings, we will break down our Phase 2 
    findings specifically for each school or program.

BVS3D Case Study

The BVS3D case study in 3D teaching and learning began with a call for participation to all Boulder Valley schools. Schools submitted competitive applications; leaders from the district curriculum division selected the final participants based on specific criteria. Four schools were chosen, representing three different grade levels, involving eight total classrooms. The case study was officially launched in March 2010 and evolved into three distinct phases of research:

Phase 1: The discovery phase (March – June 2010)

Phase 2: The maturing phase (August 2010 – February 2011)

Phase 3: The formal research phase (March – May 2011)

In this posting, we will briefly highlight the gleanings from our "kick start" discovery phase, which was very brief. This phase had limited exposure for teachers and students to 3D learning resources for several reasons. The 'discovery' time was used to:

• set up, learn, and troubleshoot the hardware, software, and glasses used for 3-D instruction; 
• review, evaluate, and match available 3-D software resources to our district curriculum essentials;
• explore, test, and begin to integrate stereoscopic 3D content in the classroom.

In the initial discovery phase of the BVS3D case study, the following findings, informal in nature, were clearly and consistently evident:

high school classrooms

• high student interest
• the ability for students to focus on the learning target, and not be distracted, was noted
• sustained focus (over long periods of time) on classroom content was regularly evident

elementary school classrooms

• high student interest
• livelier student-initiated discussions about the learning content were strongly evidenced, as compared with traditional or typical classroom levels of discussion and curiosity
• solid retention (49%) two weeks after a lesson, as compared with  past experience (usually in the 20-30% range, depending on the child). This informally constructed pre-/post-test experiment consisted of five questions, half of which required higher-order thinking.]

day treatment center classrooms

• high student interest
• positive effects on student behavior were consistently observed

middle school classrooms

• there were no findings at the middle level; this site did not receive their equipment until the following fall

Discussion

Although these phase 1 results were informally collected and fairly ‘soft’ in nature, they are still quite informative and useful. They represent the first order of mental metrics that play out in the minds of teachers as they evaluate new technologies for potential use in classroom instruction. If teachers don't see these simple evidences, it is doubtful that they will continue to use the technology at all.

In the next posting, we will take a close look at our BVS3D phase 2 results.

Past Research

More than twenty-four years ago, the US National Science Foundation (NSF) convened a panel to report on the potential of visualization, including both 2D and 3D projection. This initial effort created a tremendous surge of research by greatly boosting funding for computer-based visualization. I've spent many hours skimming through some of the educational research specific to 3D visualization, which is chiefly focused on the post-graduate environment, and have generally seen learning gains in the 20-30% range, as well as favorable determinations in terms of learner retention and transfer. You can review much of this research by using Google Scholar or generic Google Search and the following search keyword string:  stereoscopic “3D visualization” research study findings NSF. (Scholar will give you a higher class of refereed publications, while Search will open a broader set of public resources for your examination. And please, if you have a better search string—post it in the blog comments area—so that we can all benefit.)

In 2004, the NSF and US National Institutes of Health convened the Visualization Research Challenges Executive Committee to develop a key report on visualization's potential, whether 2D or 3D, as a technology. Two other interesting papers on some of the challenges we face with 2D and 3D visualization are attached or referenced below:

Is there science in visualization? (2007)

The second surge of visualization research (2007)

Research in K12

Until recently, research on stereoscopic 3D in K-12 education has been noticeably sparse. Two of the limited research efforts to date have involved a study out of UC Davis and another out of Illinois. The most recent UC Davis Tahoe Environmental Research Center Study (2010) demonstrated some interesting results in terms of knowledge gains and attitude/perception benefits. It also has a useful literature review (see page 11).

The second study involved a large, state-funded effort focused on the use of 3D interactive simulation in math and science, The study, entitled the Classroom Cubed Illinois Initiative, was conducted by Dr. Lloyd Kilmer from Western Illinois University (2007). The pre- and post-test results of over 1,070 students provided the following subgroup data, indicating some potential for reducing stubborn historical achievement gaps:

• Free/reduced lunch students: 32% increase

• Full paid lunch students: 31% increase
--------------------------------------------------------------------------

• Non-white students: 32% increase

• White students: 32% increase
--------------------------------------------------------------------------

• Special Education students: 31% increase

• Non-special education students: 32% increase
--------------------------------------------------------------------------

• Female students: 35% increase

• Male students: 29% increase
--------------------------------------------------------------------------

• Math ISAT students currently below state standards: 31% increase

• Math ISAT students currently meeting state standards: 33% increase

• Math ISAT students currently exceeding state standards: 30% increase
--------------------------------------------------------------------------

International Effort

Along with our four BVSD schools, many other schools around the world are involved in an international 3D pilot study effort using DLP projector technology. These schools are exploring the learning potential and impact of 3D in the classroom. The map below shows the current location of these pilot projects. Currently, there are over 7 pilot projects underway in the U.S. and over 28 projects abroad (some are so recent, they are not shown on the map).

I wanted to bring this effort to the attention of our blog readers early on. Why? In our fledgling field of 3D in education, current research is still very sparse. Much more needs to be done. Some of the research is just now starting in the international locations mentioned above. Some is being launched by government education ministries and private foundations. Some is informal, some is quite formal. So keep on reading in the coming weeks, as we systematically share with you the past, present, and future of what we know about using 3D in teaching and learning. And please post your questions.  

3D Zombies!

Last summer, at the ISTE 2010 conference in Denver, I was sitting in the sparsely-attended session of a well-known featured speaker. In his talk, he was criticizing many of the aspects of educational technology that are more marketing than substance. Much to my surprise, his topic switched briefly to 3D in schools, and he showed the following slides on the large screen behind him:

There you have it! 3D zombies in the making. All joking aside, this respected technologist was actually sincere with his concern. Those who have known me over my lengthy career in education know that I think in much the same way. Is 3D in schools fad or substance? Do we only see marketing here, or do we see actual educational value?

In order to directly address those questions, I am starting my first series on our Future-Talk 3D blog. Over the next 6-8 posts, I will carefully review past research in this field, examine the international case studies now under way, highlight the preliminary results from our own case study, interview notable researchers, and provide insight into the results we are seeing. In late June, we hope to discuss the findings from our current University-conducted study of 3D in the classroom. If you know me well, I wouldn't be involved in 3D at all if I didn't recognize promising educational value. Come along for the series journey...

3D @ ISTE Update

In a previous posting, I provided a complete list of the 3D presentations being offered at the ISTE 2011 conference, including rendered and stereoscopic 3D presentations. At that time, only one stereoscopic 3D poster session was scheduled.

That has now changed. A new and very inspiring presentation has made the cut: 3D Teaching = Student Engagement in the Classroom. This Wednesday morning panel session promises to be rich in content and extremely up-to-date. You will not want to miss it. The panel tentatively includes three thought leaders in the field of 3D in education:

Dr. Carol Hruskocy. Dr. Hruskocy, Associate Professor of Education and Counseling at Regis University (CO), oversees two master degree programs. She is one of the researchers associated with the BVS-3D Case Study project in Boulder, Colorado. She has presented both nationally and internationally on a variety of topics including technology integration, faculty development for online facilitation and course development, and assessment of student learning. 

Kristin Donley. A talented science teacher and runner up Teacher of the Year in the state of Colorado, Kristin currently serves as a high school teacher at Monarch High School in the Boulder Valley School District. She has carried the lead role in the most successful implementation project for 3D in U.S. schools.

Len Scrogan. Your humble blog author will provide an introduction and serve as the moderator for this unique panel session. I will also provide a brief update on 3D vision and eye health.

Friends in High Places

James Cameron, the well-known director of “Avatar” (the blockbuster 3D sci-fi movie), recently spoke out about the potential of stereoscopic 3D in education.  His thoughts are best conveyed in his own words...

James Cameron Video

3D Simulation

Last week, a friend of mine attended a series of presentations made to customers from the U.S. military at the 27^th National Space Symposium. One of the presentations, which was conducted by Boeing, was an immersive 3D battlefield simulation so realistic that the sense of engagement was palpable and heads were clearly bobbing. The simulation employed 3D to replicate a battlefield experience with the confusion, sounds, and explosions of real warfare—followed by shrapnel whizzing past their heads or flak exploding dangerously nearby. The notion was to build soldier and communications preparedness, quick thinking, and readiness well in advance of any real combat action.

Since I am more of the peaceful sort of person, I swiftly conjured possible applications for K-16 and adult education in this same vein.  Using 3D content to foster preparedness, quick thinking, and ‘field’ readiness could easily be applied in such areas as:

-         plant and employee safety

-         emergency training

-         driver’s education (please don’t laugh!)

-         athletic competition training

-         physical education

3D Integrators

In my humble opinion, the role of integrators in creating 3D projects in a school is invaluable.

An integrator is a company that can help ‘integrate’ the disparate pieces involved in your classroom 3D project. An integrator can help identify the needed hardware components, offer sound technical advice, provide helpful technical support and problem solving over the long-haul, and even suggest appropriate 3D content.

In a word, an integrator can help simplify often confusing 3D technologies, making your road toward instructional success much easier and straighter. In my article, “3D Comes to School” (see January posting), I listed several such integrators. Since that time, I have updated my list of 3D integators:

Convergent Solution 

XpandD 

AV Rover  

(If any of my readers also represent an integrator firm with which I am currently unaware, please leave a comment below, listing your web site; and please contact me via email, so that I can update my list.)

A 3D Lagniappe

Question: “What 3D announcement made in March resulted in over half a billion web impressions in just two weeks?”

Answer: The 3D lagniappe.

“Lagniappe” is a Cajun term meaning “a little extra,” or a bonus gift. (For example, if you were to receive a free slice of scrumptious pecan pie after ordering the large-sized crawfish etouffee—that would be a lagniappe. Or if, at the end of a workshop, a presenter gave everyone in the room a practical new tip, immediately usable—that, too, would be a lagniappe.)

This metaphor is absolutely the best way to describe what is currently erupting in the 3D world. In a recent announcement, the American Optometry Association took a significant position on 3D viewing, and this announcement has since reverberated around the globe. The upshot is that viewing 3D is strongly encouraged by the AOA.  Viewing 3D—in theaters, on home television sets, on game consoles, and in our nation’s classrooms—appears to serve as one of the most reliable and effective vision screeners ever offered. It’s apparently far more effective than the standard eye-chart test.

Who could have imagined? It’s an unexpected bonus, a “little extra” gift for 3D-using schools. Although we are seeing very positive results in classrooms that are using 3D, now we have a 3D lagniappe—a tremendous health benefit is now associated with this impactful teaching tool.

Take a look for yourself by checking out these national announcements: 

3D Eye Health and 3D@Home

Special Notes:

1.  In mid-May, I plan to populate this blog with a rich series of posts about the learning results and successes we are now seeing in our pilot 3D classrooms.  The 3D lagniappe above is just your appetizer!

2.  Yes, I’ve been serving on the national AOA team that has been developing a position paper on this topic. Our work is expected to be released sometime in June—so please stay tuned!