Educational apps should provide information on whether students are progressing and whether they are learning. Teachers want to know how their students are doing and if they are benefitting. Teachers need to know if students are engaging and if they find it too difficult. Here are six key questions that all educational apps should answer for teachers. Examples of how these answers would look come from the Rocket Math Online Tutor (RMOT). This educational app answers these six key question in real time on the website and for download into spreadsheets.
(1) Are students engaging with the app?
Students only learn when they engage with an educational app. Teachers need information on how many of their students are using the app and how frequently. The RMOT has a page called “Review Progress” where this information is available. The first info centers on engagement with a chart showing what percentage of the students are completing how many sessions over the last 14 days. Students are rated “good” if they complete 12 sessions in 14 days. That translates in the last two weeks to a ten-minute session every day at school and a four times additionally as homework. That rates as “3 stars” or a grade of “B.” In the example above, 65% of the students in the class have completed that number of sessions or more. Also, 88% of the students are working at a steady pace, of 8 sessions over two weeks. So 88% of the students are engaged enough to see benefits.
(2) Who’s been making progress?
Educational apps should keep teachers aware of which students are working and making progress. RMOT teachers can enable a Daily Progress Report to be sent to their email. This shows for each individual student how many sessions they started and how many they completed the previous day. If students complete one ten-minute session at school, the teacher can see if any students completed an additional session at home. The Daily Progress Report also tells the teacher which students are making progress. Student progress shows when they pass one of the 26 A to Z levels in each learning track, such as Addition, Multiplication, or Fractions. Students can then celebrate their progress by coloring in that level on their Rocket Chart.
(3) How far have the students progressed?
Educational apps should show the teacher how far students have progressed in their learning objectives. RMOT makes progress clear to both students and teachers because each learning track is broken into 26 A to Z levels. As students pass levels on the way to Z, the app congratulates them and makes their progress obvious. In addition, the Review Progress page graphically displays how far students have progressed in each learning track. And of course, the students are encouraged to keep track of their progress on their individual Rocket Charts. These Rocket Charts are so important to the students, it’s where the app came to be named “Rocket Math.”
(4) Is there evidence of student learning?
An educational app like RMOT should show evidence of student learning, not just completing exercises. RMOT measures math fact fluency through giving students 1-minute races, or fluency tests, periodically as they work through learning tracks and whenever these are assigned by the teacher. This data is collected and is always available to export as an excel file. Above is an example of a class of 35 students who began the Addition learning track with an average fluency of only 5 correct problems per minute. The students who have completed the learning track have an average fluency of 17 problems per minute. This data is also shown in chart form on the top of the Review Progress page.
Teachers can also assign fluency tests periodically. The RMOT Review Progress page also shows the scores earned in the most recent two fluency tests so teachers can quickly see if students are actually improving in their math fact fluency. That’s why you have the education app, right?
(5) Who is making a good effort each day?
On the Review Progress screen the RMOT shows, for each student, the number of problems they answered during their 10-minute session. Students who are applying themselves will answer over 100 problems in that length of time. The teacher will be able to see which students are not applying themselves and not making a good effort. Some students may need closer supervision, or more motivation to get much benefit from their time on the app.
When students actually apply themselves, they see themselves making progress and are motivated to make more progress. All it takes is a session or two of good effort and they will realize this app is really helping them.
(6) Are students finding the app too difficult?
The RMOT app calculates a difficulty score for each student. The app counts each time students have to “Start Over” in a part because they aren’t at mastery. The app divides the number of “start overs” by the number parts passed. If a students score is over 3.0, that means they have to start each part over three times to pass it. That may be a little too difficult and they may need some help or intervention. Not all students do, but the app has options on how to make it easier for those who need it. On the other hand if a student has a difficulty score less than 3.0, then it is not too difficult and they just need to have some help in developing perseverance.
A good educational app provides clear answers to evaluate effectiveness
The answers to these key questions help a teacher evaluate the effectiveness of an educational app. The teacher needs to be able to answer these six questions.
- Are students engaging with the app?
- Who has been making progress?
- How far have students progressed?
- Is there evidence of student learning?
- Who is making a good effort each day?
- Are students finding the app too difficult?
When this information is available to teachers in an educational app, they can fairly evaluate its success and the benefits it is conferring on their students.