Another dot in the blogosphere?

Posts Tagged ‘feedback

This teacher’s generous sharing is a good example of an open classroom practice.

It is also an example of Cuban’s description of practitioners often being experience or practice rich but theory poor.

The teacher shared some excellent ideas on how to go “gradeless”:

  • Poll students to see where they are at
  • Empathise with the mindsets of students
  • Stick with policies and model practices of going gradeless
  • Get buy-in and support from school leaders and peers
  • Communicate clearly with students and their parents

However, there are areas where experience, practice, and experimentation are not enough.

What the teacher describes are “gradeless” is actually a type of formative feedback; the former is somewhat intimidating while the latter is more mainstream. It is important to lower or remove barriers when trying something new. That principle is fundamental in managing change.

The teacher also had poll responses that puzzled me. For example, what is the difference between “learning biology and also getting a good grade” and “both learning and getting a good grade”? Is the latter about learning in general? If so, how is that option relevant?

Options in a poll or quiz should not be ambiguous or overlap conceptually. This is fundamental to poll and quiz design if you are not to confuse students and if you want to get a clear idea of where the learners are at.

No teacher or teaching is perfect. We need to take the roses and rotten tomatoes thrown in our direction in equal measure.

Far wiser and more articulate people have shared their thoughts on assessment, grading and feedback. So I reshare what they shared.

From these and the work of others, I distill some wisdoms into these image quotes.

Formative feedback

Quantitative grading ends learning. Quality feedback sustains learning.

Turnitin’s Feedback Studio (FS) is a useful tool, but it is not perfect. In fact, far from perfect. The developers attitude to feedback is far from desirable.

For two semesters I have experienced error messages while providing feedback and grading online assignments with FS. I use the latest versions of MacOS and the Chrome browser.

Last semester, the errors would start with this popup overlaying the assignment I am grading.

Turnitin Feedback Studio error message 1.

I have to close the window with the assignment to return to the LMS interface from which FS was launched. I cannot get back to the comment I am writing to attempt to salvage it.

The LMS frame which used to contain a list of student names and assignments contains this error message instead.

Turnitin Feedback Studio error message 2.

This happens consistently and almost predictably every 30 minutes. Even though I set a timer for 29min 45sec to try to refresh the LMS windows and reopen the assignment, I sometimes still get caught by this error.

This semester I have also come across a more elaborate error message.

Turnitin Feedback Studio error message 3.

I do not cancel anything or make any request. The FS system creates this popup and the effect is the same — I lose whatever I am working on and need to refresh the LMS window

The usability is poor not just because these errors disrupt the flow of providing feedback by way of comments in each assignment.

FS is also a pain to use because I cannot mouse scroll in an assignment. I have to use the up and down arrows or a scrollbar. Providing feedback and grading requires me to rapidly look at different parts of an assignment. It is not like reading a news article from start to end. The lack of non-mouse scroll slows me down and frustrates me every minute of using it.

If you think that my mouse or track pad are faulty, they are not. I can scroll just fine in the original LMS window. The fault lies with the FS window.

FS is useful because it leverages on Turnitin’s vast database to match for similar content. However, that feature is an anti-plagiarism measure. FS is, as its name implies, for feedback. While I can provide feedback on assignments, I have to put up with lousy usability and constant time-out and error messages.

How is Turnitin going to respond to my feedback? With a non-user-friendly error message perhaps?

Martin Weller recently wondered out loud if more personalised learning, greater flexibility in schooling, and increased feedback was better.

His thoughts were provocative as they usually are and well worth the read. He shared them because he felt that:

we shouldn’t let these unspoken assumptions pass unchallenged, because huge industries and major university strategies which will affect thousands of learners are based on them.

I agree.

However, I disagree with what seemed to be a focus on quantity. I do not think this was Weller’s intent, but he did use phrases like “more feedback” and “more flexibility”.

Imagine if adult learning institutes focused instead on strategic personalisation, meaningful flexibility, and timely feedback. These are about the quality of learning experiences.

More is not the issue. Better is.
 

After reading this piece on formative assessment by Steven Anderson, I decided to focus on formative feedback instead.

I sum up and oversimplify formative feedback in four broad and overlapping activities. These are driven by the questions:

1. Where is the learner now?
2. Where does s/he need to go?
3. Why does s/he need to go there?
4. How might s/he get there?

Three questions for formative feedback.

The problem with generalisations is that people start and end there. I do not share these questions to drive dogma. Instead they are distillations of the collective experiences and wisdoms of progressive educators everywhere.

Post production note: I originally had just three elements — I did not have the WHY at first. This might not seem like a logical formative question, but it is an important one to ask to keep the learner’s motivation up.

As much as I try to promote and model progressive forms of education, I am “old school” in some ways. I believe in being “cruel” to be kind.
 

 
I get a fair bit of my work done at public libraries. These libraries have a rule about not leaving personal property behind to reserve seats or tables.

Signs pasted on table tops inform patrons that abandoned property will be confiscated and put in special collection areas.

Librarians make their rounds to remind users not to reserve seats or leave belongings unattended. If patrons are absent, the librarians are authorised to remove the abandoned items. Instead, most librarians leave warning notes behind instead.

I have observed patrons return to the seats, see the notes, and nonchalantly crumple them up. The rule is not upheld and there is no consequence for their actions.

The librarians probably want to avoid confrontations with patrons. But by being considerate to such patrons, the librarians allow the inconsiderate behaviour of some patrons to persist.

It is better to be cruel to be kind. This adds teeth to the rules and takes a bite out of inconsiderate behaviour.

A peaceful reading alley in the #library at #orchardgateway #singapore.

A post shared by Dr Ashley Tan (@drashleytan) on

These libraries are one of my work spaces. I often provide feedback and grade assignments there.

In the earlier piece, I explained how and why I provide feedback that goes beyond content. I am particular about how my learners write and I am strict about the standards they need to achieve.

Like the upholding of library rules, I am “cruel” to be kind. I believe in providing encouragement, but I also know that errors and bad habits must be clearly and firmly pointed out.

If doing this bruises the egos of my learners, so be it. I am confident that they will grow and learn from the pain eventually. After all, we learn more from occasionally falling down than constantly staying up.

Yesterday I shared some thoughts on providing formative feedback on written assignments. Today I share some strategies I use to do so efficiently and effectively.
 

Get out of comfort zones
I try not to work at home. There are too many distractions there largely thanks to my fast Internet connection. I might get sidetracked by YouTube videos or social media alerts.

I make my way to a library or a coffee place. I do not have the comforts of home and I switch to my all-business frame of mind.

One benefit of being at a coffee place is that I cannot stay long. I cannot hog a table or I might have time-limited Internet access. The time limit is an incentive to work efficiently.
 

Block distractions
Being in a public place means it gets noisy much of the time. I counter this by donning a pair of noise-cancelling headphones.

I have different playlists to help drown out ambient noise or bad store music. Some music is calming if the work I am reviewing agitates me; some of the tunes are energetic if my human battery runs low.

I also remove my glasses as I do not need them for close up work. Doing this has the benefit of not being distracted by what appears in my peripheral vision.
 

Set a quota and stick to it
I use the number of scripts and the feedback due date to calculate how many assignments I need to process a day. Then I divide each day’s quota into a before-lunch and an after-lunch set.

The quota needs to be achievable. Some initial trial and error has built my experience up on this matter. Calculating the quota is the easy part.

The difficult part is keeping to the quota. By this I do not mean completing the AM or PM session’s amount. I do this consistently. I mean stopping when I seem to have gained momentum.

It is important to stop because I do not want to mentally exhaust myself. If I am tired, it will show in my feedback and this is not fair to my learners. I also need time to rest, play, or finish the now cold cup of coffee on the table.
 

Revisit earlier scripts
It is tempting to grade, provide feedback, and never want to see a piece of writing again. However, I find it useful to revisit earlier scripts to
to check for the consistency of my feedback.

I think that we operate like the tides when we process assignments. We seem to wash up consistently like waves crashing on a beach. But no two waves are identical and there is the overall ebb or flow of tides too.

This could be due to my energy, the time of day, the overall nature of the class, the behaviour and expectations of learners who submit at different times, and so much more.
 

Embrace subjectivity
I do not try to be a robot or strive to be absolutely objective. This is impossible.

I embrace subjectivity but do so professionally. By this I mean that I take into account how a group responded to one or more lessons, what strategies I used with them, what content we uncovered together, etc.

We might have a menu to follow, but each dish is a bit different from another. I acknowledge and respect that by seeing how it was prepared (focusing on the process), not what it looks like (focusing on the product).
 

Strive for timeliness
One thing that makes feedback effective is timeliness. Wait too long to provide it and all effort it lost because learners have forgotten what they wrote.

The assignments I grade and provide feedback on are submitted online. After the submission deadline, I process assignments in the order they were submitted. This means that the first person to submit gets feedback first.

I could resort to an administratively convenient alphabetical order, but this is not fair to students who might have Z surnames but A response times.

End note: I prepared much of this reflection after processing a day’s quota of assignments. My mind was still buzzing, so I put my energy into sharing some ideas.


http://edublogawards.com/files/2012/11/finalistlifetime-1lds82x.png
http://edublogawards.com/2010awards/best-elearning-corporate-education-edublog-2010/

Click to see all the nominees!

QR code


Get a mobile QR code app to figure out what this means!

Archives

Usage policy

%d bloggers like this: