Sunday, February 25, 2018

Inside the Black Box of Adaptive Learning Technology


Inside the Black Box of Adaptive Learning Technology

BAD PRESS
In my previous post, I mentioned that the media has had much to do with our culture's fear of technology--technophobia, and fear of being spied—scopophobia. The news media has had an impact creating fear of technology. According to writer Dwayne Day, “’2001: A Space Odyssey’ movie has been the most culturally and socially influential science fiction film ever made.”
Why?  In the movie, astronauts are on a mission to Jupiter and the spaceship’s computer, HAL9000, kills all but one crewmember, who then unplugs HAL. Perhaps you’ve heard of the 1938 debacle where Orson Welles dramatized a radio program that was produced to sound like real news of a Martian invasion in New Jersey. This radio broadcast was intentionally formatted and dramatized to cause nationwide hysteria (Schwartz).

What about George Orwell’s book, 1984, where the plot contains official deception, secret surveillance, brazenly misleading terminology, and manipulation of recorded history? Fast-forward to May, 2013, when Edward Snowden leaks to a Washington Post reporter that the NSA has a surveillance program called PRISM, which collects data from Facebook, Microsoft, Google, and other social media sites. Author Ian Crouch notes the spike in book sales for 1984 since Snowden fled to Russia and Hong Kong and wrote, “The technological possibilities of surveillance and data collection and storage surely surpass what Orwell imagined.”
TRACKING AND ARTIFICIAL INTELLIGENCE
Adaptive learning technologies—ALEX, Knewton and MyLab, by McGraw Hill and Pearson—made their classroom debut between 2011 to 2013. Parents, students, and teachers were skeptical of adaptive learning, perhaps due to the media’s negative influence on technology and fear of change. Seven years later, adaptive learning technology continues exist as a 21st century classroom tool. The factor missing from adaptive learning technology’s wide-spread acceptance: buy-in. According to Oremus (2015), adaptive learning technology is only in its Model T phase. Adaptive learning technology is so new, there isn’t enough data for school districts to justify the cost of switching over to adaptive learning technologies in the classroom. Others claim their dislike of the data collected by adaptive learning technology. Regardless of whether we dislike or agree with it, the technology we use every day collects information about us by tracking our Internet usage, our queries, the GPS on our cell phones, Google Maps, and Waze; credit card purchases (what we buy and where we buy it), traffic cameras, voice recognition systems (Siri and Cortana) on cell phones and personal assistants like Google Home and Amazon Alexa, and facial recognition systems at airports, sporting arenas, ATMs, and on social media sites such as Facebook. On a commercial airline flight, there is only seven minutes of human steered flight—at take-off and landing. The rest of the flight uses artificial intelligence—AutoPilot. It seems logical to conclude that if we are using technology, then we are inevitably tracked, traced, and databased. While the social and ethical issues regarding the topic of Big Data are important, they are not the focus of this post. In this post, the past has been examined to evaluate possible reasons why our culture feels the way it does with regard to data collection and artificial intelligence. Next, we’ll see how digital adaptive learning technology collects data to help students learn in the most efficient and effective manner possible.
ADAPTIVE LEARNING DEFINED
Edsurge defines digital adaptive learning as the educational tools that can respond to a student’s interactions in real-time by automatically providing the student with individual support. Common misconceptions of what adaptive learning is include (1) an instructional strategy, (2) the use of software, (3) differentiated instruction, (4) personalized instruction, and (5) individualized instruction. Digital adaptive learning deals with real-time data collection, automatic responses, and response or redirection for students based on their unique choices.
Note that digital tools that don’t collect data in real time are not adaptive. Tools that don’t provide support in real-time are not adaptive. Tools that mark answers correct or incorrect, then provide a single path for learning regardless of the response are not adaptive.
STUDENTS TAKE RESPONSIBILITY FOR THEIR LEARNING
Many teachers don’t want to change their ways, and many want to see evidence that digital adaptive learning technology really works. There are privacy and budgetary concerns, and questions about the viability of companies that produce and support the digital adaptive learning tools. On the other side of the scale is delivering engaging content that makes students more enthusiastic learners. Until teachers change the way they work and more evidence is collected, 21st century adaptive learning will touch only 20% of the nation’s K12 students.
DIGITAL ADAPTIVE LEARNING TECHNOLOGY

Adaptive learning happens in three places: in content, in sequencing, and in assessments. Look at the chart to see how adaptive learning technology respond differently to two students.

Adaptive learning technology collects data, analyzes the data, then adjusts the content the student will see next so students learn as efficiently and effectively as possible.
ARTIFICIAL INTELLIGENCE: WHAT IS IT AND HOW DOES IT WORK?
Artificial intelligence—called AI is defined as, “computer systems designed to interact with the world through capabilities (visual perception and voice recognition), and intelligent behaviors (taking the most sensible action to achieve a goal after assessing the available information) that we would think of as essentially human.” (Luckin, Holmes, Griffiths, & Forcier, 2016). People worry that AI will reach the point of singularity—the point where an AI-powered computer or robot could improve or redesign itself, and leading scientists, such as Stephen Hawking have expressed concerns about “the potential downsides of AI becoming too clever” (Luckin, et. al., 2016). While AI is becoming more sophisticated, general AI does not exist; only domain-specific or narrow AI exists.
For more than 30 years, the application of artificial intelligence to education (AIEd) has been the subject of academic research. AIEd is what gives adaptive learning technology its ability to adapt teaching and learning approaches and materials to the capabilities and needs of the individual learners. AIEd, sometimes called the ‘black box of learning’ is what provides the understandings of how learning actually occurred. The two parts of AIEd are (1) knowledge about the environment it is processing and (2) algorithms to intelligently process the knowledge.
The AIEd needs to know about the knowledge and expertise of teaching, or the pedagogical model (allowing a student to make a mistake before showing the right answer, feedback triggered by the student’s responses, and assessment to measure learning). The second model the AIEd needs to know is the domain model, which includes the rules and procedures for the specific subject (math, history, etc.). Finally is the learner model, which is data on the student’s previous attempts at this and prior work, and the student’s engagement in learning (time on task and other measurements). The learner’s responses are constantly fed back into the learner model, which makes the model richer. This is how AIEd ensures that the student’s learning experience effectively supports their learning. In order to do this, AIEd gathers large amounts of data to dynamically improve the pedagogy and domain models to help teachers refine the processes of teaching and learning.
From the explanation and model pictured, the data collection is essential input into all three models in the AIEd of adaptive learning technology. The AIEd, using the collected data, is how the “adaptive” happens! By collecting this data, even the data from the tracking discussed earlier in this post, we are creating an ocean of digital data. It is estimated that in the current year (2018) there will be 7.6 billion people with 25 billion internet connected devices (Luckin, et. al., 2016). Information from devices is communicated to applications discussed earlier in this post, and mothers. Adaptive learning technology collects data in a similar fashion, with respect to the individual items on an activity and time; more than traditional data collection of a duration of an activity and an activity score.
The last thing to mention is the teachers. AIEd can perform teacher activities such as grading and record keeping, but AIEd can not replace teachers. Instead, with adaptive learning technology, teachers are freed to dedicate their energy to be creative and take learning up a notch 
(Luckin, et. al., 2016). With adaptive learning technology and AIEd, there is no doubt the role of the teacher in the classroom will change. 


Next post topic: Data Analytics and the Dashboard.
The AIEd information in this blog is taken from PEARSON's publications listed.

Saturday, February 10, 2018

A Journey into Adaptive Learning Technology

Adaptive learning technology is a way to provide a personalized learning experience to each student.  The purpose of this article is to help you understand what adaptive learning technology is and how it works. Come on a journey with me back to 2007.

I used "pre" adaptive learning technology with my middle- and high school math students. At home, each student watched a video lesson, completed several practice problems, then completed a homework assignment. Students entered their answers into the software program, received immediate feedback (correct/incorrect), remedial video instruction after two incorrect answers were entered, and a grade for the homework assignment was stored in a protected gradebook. Class time was used to review and assess the learning objectives for the completed lesson, a collaborative activity to engage learners, and a quick preview of the next lesson and learning objectives. I was using a flipped classroom model before I knew what a flipped classroom was! Each student completed the same homework problems and the same chapter tests, entering their answers as they were calculated. The immediate feedback and remedial video instruction was an improvement for students compared to the several days it took me to grade, record, and return math homework assignments before the "pre" adaptive learning technology and flipped classroom model.
   
Most sources agree that adaptive learning technology arrived on the educational scene around 2011-2012. The first adaptive learning technology I interfaced was ALEKS by McGraw Hill Education.  It was love-at-first-sight! I watch over his shoulder as my son worked precalculus problems in ALEKS. The University of Delaware had determined that incoming freshman who strengthened their precalculus skills before attending the college-level precalculus course were more successful in math than those students who did not strengthen their precalculus skills. When my son answered correctly, ALEKS progressed him to the next learning objective. Two incorrect answers triggered an intervention--a guided instruction module--then ALEKS returned to the precalculus problems. Throughout the course, ALEKS would present review problems "to build confidence and learning momentum". Because of the cumulative nature of learning math, not to mention midterm and final exams, I am a proponent of reviewing math skills.

I don't know about you, but after watching this video, I was intrigued by ALEKS and adaptive learning. I tried to persuade the private schools I worked for to offer ALEKS to their middle- and high school math students. I researched the cutting-edge adaptive learning technology and presented information to school administration and parents. 


Alas, fate was against me. If you recall, the end of the world was predicted on May 21, 2011. My efforts to persuade parents and administrators to embrace ALEKS and adaptive learning technology were fruitless. The majority of parents and a few key administrators were resistant to change and uninterested in the benefits of the new adaptive learning technology, and were more in favor of using traditional teaching methods. When they heard "artificial intelligence" and "Markovian algorithms", folks thought computers would take over the world. Finally, a handful of parents expressed concerns such as, "I don't want my child to have more required screen time", "I want my child to complete their math assignments from a textbook", and "What happens if our WiFi goes down?"

In reality, adaptive learning technology is based on educational theory, cognitive science, and artificial intelligence (Posner, 2017).  The world was still spinning, and in 2015, I transitioned to teaching math at the college level using Pearson's MyLabsPlus adaptive learning technology.



Using MyLabsPlus for the math courses I teach, each student receives a personalized learning experience by completing a Diagnostic Quiz to assesses prior knowledge on a particular set of learning objectives for the upcoming unit. Students do not earn a grade for this quiz. MyLabsPlus generates particular homework problems based on the student's Diagnostic Quiz responses, so students are only presented with homework problems not yet mastered. This personalized path for assigning math homework to students is an efficient and effective method of learning (Posner, 2017).

Students are given three attempts to correctly answer each homework problem. If completed successfully, MyLabsPlus advances students to the next homework problem in the assignment. While completing the personalized homework problems, students have several resources to assist their learning and understanding. If students need help, the have access to the course eTextbook, video lectures, and three forms of online assistance. The first method of online assistance is called Help Me Solve This. MyLabsPlus walks the student through a step-by-step solution of the current homework problem, then presents the student with the same problem containing different numbers. The second method of online assistance is View An Example.  Using this help, students are shown a step-by-step solution to a similar problem, then return to the original problem to solve. The third method of online assistance is Ask My Instructor, where MyLabsPlus emails the instructor a link to the particular homework problem. This gives the instructor an opportunity to work one-on-one with their student to determine the misunderstanding or exact difficulty the student is experiencing. When my students use this option, I print the homework problem, complete the solution in great detail, take a cell phone picture of the problem and worked-out solution, then text the picture to my student. Most of the time, this is sufficient to help the student identify what they were doing wrong. I believe this method preserves the student's dignity by allowing them to compare my solution to theirs while in their environment. Using this method, students can simply enter the correct answer provided by the instructor.

One benefit of adaptive learning technology is that students can complete their assignments at their own pace. However, students are given deadlines to complete the assignments by so that the college can assign a course grade at the end of the block or semester. Assigning grades at the end of the semester is very important in college, and assigning grades keeps the Financial Aid office happy as well. Students progress through the homework assignments at their own pace with "this assignment is due by" also attached to each assignment. Homework assignments must be completed to a minimum score of 75% by the due date in order to unlock the formative assessments sprinkled throughout the course. 

Formative assessments are given, both in the classroom and using adaptive learning technology. In the classroom, formative assessment are administered using paper and pencil or digitally using Smart Lab, Kahoot, or Quizlet Live, and can be individual or collaborative. The institution usually determines how students in each course will be presented with a formative assessment; one or two quizzes per unit in MyLabsPlus. To support academic integrity during formative assessments, MyLabsPlus presents different numbers in the exact same problems and randomizes the problem order across each class. If a students does not complete the homework assignments associated with a formative assessment to the minimum 75% score by the assessment due date, MyLabsPlus records a zero score for the formative assessment. Remember, students are not given homework assignments and left completely on their own. They receive face-to-face instruction in the classroom and are encouraged to take notes. Students can take advantage of the various instructional components in MyLabsPlus such as the eTextbook, videos, and three different ways to get help.

Summative assessments are given using a combination of delivery methods, depending on the math course. Developmental math courses have multiple test attempts delivered in different methods. For example, the first unit test attempt is given in the traditional paper/pencil manner. If a student does not demonstrate mastery -- a score less than 75% -- the students has two weeks to complete a Study Plan in MyLabsPlus and complete the second unit test attempt in MyLabsPlus. The adaptive learning technology looks at the student's homework and quiz performance within each unit to determine the student's strengths and weaknesses with regard to the unit's learning objectives. If the student does not complete the unit Study Plan to 80% mastery within the two week window, no second attempt unit test grade is recorded and the student is required to take a paper/pencil final exam for the course. The final exam counts as a third attempt of the unit test, where a matrix is used to extrapolate a unit test grade for each unit from the final exam problems. For college-level math courses, summative assessments are administered on paper/pencil. Students have one attempt for each unit test and a cumulative final exam.

As students work through the course, adaptive learning technology has reporting that goes to the instructors and to the department chair. I will discuss the adaptive learning technology reporting in a future post. Suffice it to say that the adaptive learning technology reporting mechanism is where the instructor analyzes student performance overall and by assignment. 

MyLabsPlus Reporting Menu
It is imperative that instructors offer data-driven guidance by reaching out to struggling students by email, in a one-on-one discussion, or by text message (Reporting Dashboard, n.d). I contact all of my students and let them know what the adaptive learning technology reporting is saying about their performance. For example, to a student who is completing their work on time and is having little to no difficulty with the course, I send a note of encouragement by email to let them know that I appreciate their hard work and diligence. To the struggling student, I will outline which assignments are missing, which assignments can be made-up and which ones earned zeros; I will reiterate my office hours and encourage these students to spend one-on-one time with me in the Math Lab or to text me for help at their convenience during my office hours. Finally, I make sure to tell every student that their success is my goal. I ask each student to consider how I can help them better and to let me know. I want my students to know that I care, that I am flexible, and I am willing to work with them to provide the learning support they need.

I'd enjoy learning more from your experience with adaptive learning technology. Please share in the comments.




References

Flipped classroom. [Infographic]. (n.d.). Retrieved from  https://www.knewton.com/infographics/flipped-classroom/

How ALEKS works. [Video file]. (n.d.). Retrieved from https://www.youtube.com/watch?v=-1Q4jRbpODQ

Posner, Z. (2017, January 11). What is adaptive learning anyway? Retrieved from            https://www.mheducation.com/ideas/what-is-adaptive-learning.html

Reporting dashboard: Keep students on track. [Picture]. (n.d.). Retrieved from  https://www.pearsonmylabandmastering.com/northamerica/educators/features/reporting-dashboard/index.html

Research behind ALEKS. (n.d.). Retrieved from https://www.aleks.com/about_aleks/research_behind