How to reward students for learning from mistakes without penalizing those who didn't make mistakes in the first place?
At face value, it seems clear that the issue is that you're trying to mix measurements of two very different kinds of performance. I think the REAL issue is deeper than this, but let's start with the two things you're mixing up:
- You want to measure outcomes. Did the group end up with "correct" results from the lab?
- You want to measure a specific (learning) process. Did the group learn from mistakes and questions?
The first measurement is usually the default in classroom settings because it's the most obvious. The second measurement has value, though: You're trying to prepare students for life, not just hand them a set of answers. Measuring their ability to learn, and encouraging them to be learners, is important.
That said, measuring outcomes has the advantage that it's not dependent on the process. It's easy to see if the lab result is correct or not. I don't think that's the focus of your question, so let's concentrate on the second concept - measuring the learning itself.
That brings us to the core issue with your proposed process: Measuring learning from mistakes and questions is very, very different from measuring learning in general. You hinted at this when you said,
For the majority of our students, there will be more than enough stuff in each lab to write about. However, this isn't universally true and some groups will do the lab just fine without asking any questions.
The issue here is that you've singled out a single type of learning to measure. The students who learned by failure and questioning are correctly being evaluated by your grading approach. This is good - you're encouraging that type of student to hone their skills. So let's look at the second group - the students who "did the lab just fine without asking any questions." The important thing to remember is that they weren't born knowing how to do the lab - they learned it too, just in a different way than the question-askers and mistake-makers. The reason why your new approach lacks fairness (as you identified yourself) is that it's only attributing value to one type of learning.
So - is it a bad idea to grade your students based on the questions they ask and the mistakes they make? If you're trying to grade them on their learning process, which is what I think you're trying to do, you need to make sure you're accounting for all types of learning not just the one style. This will be really challenging - people learn in multiple ways and transition between learning styles in a fluid manner, and many learning styles don't leave behind a "paper trail" you can measure after the fact. So let's get to your specific question:
How can I reward the students who learned from their mistakes without penalizing those who don't make any?
I may be frame-challenging your question, but if you allow me that liberty, I would rewrite it as:
How can I encourage students to be aware of, and work on improving, their learning skills, versus just rewarding them for getting the right answer to a specific assignment?
I think the answer to this will be much broader than a single stack exchange question, but some ideas to think about:
- Include a discussion/presentation during/after the lab where a selected group walks the other groups through how they approached the lab, with a focus on how they prepared or learned the material beforehand and how they dealt with issues/challenges.
- When a group asks questions during the lab, let the other lab groups answer it (instead of you). When an answer is given, have the answering group provide explanation of where they got the answer from.
- Include an entire lab session, or elements of a lab, that are not part of the graded solution and are deliberately "unanswerable" in that they cover material you haven't taught or are otherwise deliberately difficult. Have the students come up with their own way to resolve this. This could even be a lab where the process intentionally causes failure, which would "force" the students to use your "learning notebook" as a tool to document and explain the failure and their approach to solving it. Purposefully cause them to go off-script and respond to the failure with creativity.
Basically, you need something that accounts for multiple learning styles, and something that encourages accountability instead of just allowing students to "cheat the system" by pencil-whipping busywork in order to get a grade. Notice I left your word choice of "reward" out of my re-worded version of your question - I think awareness and demonstration are probably more important than a reward - at the least because the reward just causes students to focus on the end, rather than the means, which totally dodges your goal of getting them to focus on learning skills versus just a final result.
Edited to add:
Let me further add: I don't think the "learning notebook" is a bad idea. It actually sounds like a great way to encourage people to recognize failure and accept it as part of a (positive) learning process, versus being afraid of failure. It would be great to include along with my three suggestions above. That said, I do think it becomes cumbersome to try to include it as a graded item, and more importantly, regardless of whether you grade it or not, focusing on it (as a graded item) misses the larger opportunity to consider and encourage other learning styles.
You could use a "point recovery" system. I haven't seen anyone else describe it, and I don't know if there is a formal name for it. Anton's answer is somewhat similar in practice.
After each lab, students are offered an opportunity to recover a portion of the missed points from that lab. This opportunity can be a notebook review, a test/quiz on the lab material, a followup analysis on their previous lab work, or an optional lab exercise. It could even be a group project, similar to Michael's suggestions.
You can choose a proportionate cap (max XX% of missed points), an absolute cap (max score of XX), or both. Setting an absolute cap will deter stronger students from participating in the optional work, as they have less to gain. You decide whether that is desirable.
Setting the "right" caps on point recovery is a bit of trial and error. The best values will depend on how stringently your labs are scored and how much you want to encourage participation. If you chose to allow "up to 85% of missed points" with "no maximum on final score", you would allow any student to achieve a B with excellent followup work---even if they missed the lab entirely. (A reasonable way to accommodate absences, too.) In this case, even an A-level student could accrue a few extra points by participating.
Ideally, you would look for some evidence that the student grasps material which was not evident from their performance in the lab. This makes notebook reviews or self-analysis of their lab work better options; you can award points specifically for addressing issues with their original lab work. The self-comparison is key for improvement. Otherwise, you can expect to see a lot of students with 50-60% lab scores come in and get around 60% on a followup quiz without much real improvement. If you want improvement, you need to measure exactly that, and only that.
The biggest difference between this method and Anton's approach is that this method favors students who mastered the material initially---they will end up with the highest scores in the group most of the time. As before, you would have to decide whether this is desirable. Should their faster uptake or lesser need for instruction be a factor in their final grade? Is this program or field highly competitive in nature?
The confusion i see with this is that different groups are going to have different problems. This makes comparisonsense of responses difficult because of the variety in the responses. This is in addition to people being able to skip this altogether. I recommend the following.
** have a set of common problems that every group responds too. There are probably common mistakes that happen every year. Make everyone explain these whether they made the mistake or not. If they didn't make the mistake it reinforces proper behavior while preventing others from making the same mistake.
** for those who do make a real mistake set parameters for what to report. For example maybe they only have to share 2-3 mistakes rather than report everything. A criteria for judging the significance would be useful as well. For example if someone forgets to turn the power on maybe that shouldn't require an explanation.
** lastly a rubric that delineates exactly what is expected would eliminate the confusion and laziness. An actual example would further help the students as well.