I thought this was a lovely activity to end the course with! I think my cohort had the bad luck to be disrupted by the coronavirus outbreak, so not as many made it to the end, but I know the current and future presentations of this course are packed (including with my manager), so I hope to see their word clouds at the end of it!
It’s time to reflect and review this part of the course.
We are asked:
Consider how the feedback that has been provided so far in this programme lends itself to a particular kind of assessment.
Consider how a misalignment with feedback and assessment might impact transactional distance.
How would you assess what we have done in this module so far?
What types of feedback would I need to provide in my own course to support the type of assessment that is expected in my discipline?
So, can I answer?
I think the feedback on this program has been timely, low-pressure and informal. That would seem to lend itself to small, frequent, informal, low-key, non-compulsory assessments.
If the tone and expectation setting of assessment and feedback didn’t match, it would drive students away. For example, either a seemingly very low key, informal assessment that was followed by an onslaught of harshly judgemental criticism, or a strictly defined and substantial assessment task that was followed by vague, brief, non specific and casual seeming feedback, would definitely be quite demoralising.
I’m not sure what this question is asking: do I think it was a good module, or what would be a good way to tell what we have learned from it. So firstly, I think this whole course has been incredibly interesting and I wish I could do the MSc in Digital Education because it sounds fantastic. But it’s more likely I’m meant to think of a way to assess knowledge gained through study of this module, in which case, inventing an assessment task sounds like the most obvious choice!
That first thing that comes to mind is that ‘feedforward’ assessments would be most useful for the practical aspects of scientific courses. I also think peer review would be an authentic assessment practice for scientific work. Another idea, which I suggested in the course discussion was that I think it would be interesting if some of our Environmental Science / Ecology students could do an Open Educational Resource (OER) as a group project relating to local environmental or sustainability issues and interacting with relevant local groups and officials. I think this would also be an authentic and relevant activity, with plenty of opportunities for timely and actionable feedback.
The theory of Transactional Distance states that as the level of interaction between teacher and learner decreases, learner autonomy must increase.
When talking about distance education we are typically talking about a teaching environment where the separation between the teacher and learner is significant enough that special teaching-learning strategies and techniques must be used.
Even though there are clearly recognizable patterns, there is also enormous variation in these strategies and
techniques and in the behaviour of teachers and learners. Within the family of distance education programmes there are many different degrees of transactional distance.
In my case, apparently it’s only possible to write far too much.
However, if I were writing a how-to guide or manual, I know I should be making it as short and to the point as possible.
In some cases, the same point could be made of assessments. A word count is not a very meaningful metric in itself, but does a strict word limit make an assignment harder, because it takes more skill to be concise, or easier, because there’s less to write? Either way, larger word counts add more work for the teacher, without necessarily making the assignment any more meaningful.
As one of my fellow students put it, quoting Einstein,
‘If you can’t explain it simply, you don’t understand it well enough’.
Another quoted Antoine de Saint-Exupéry about the creative journey:
“Perfection is achieved, not when there is nothing more to add, but when there is nothing left to take away.”
Sharing a different perspective, a commenter from the art school discussed enabling constraints, which should be related more to project duration (how long will the work last?) or should detail what students can NOT do. They argued for the importance for art students of learning how to distinguish between enabling constraints and concepts.
Rather tn merely measuring performance, we should use a variety of assessment forms, including multimedia and interactive formats, to focus academic development and course design around building exceptional learning experiences. We want to encourage the students to develop masterful levels of knowledge and practice, while remaining engaged with their learning communities.
Interesting Assessment Examples
Here are some examples of interesting assessment activities from the course materials:
An online portfolio of student’s work collected at intervals over the duration of the course submitted with a covering letter discussing the rationale for its design.
I had not thought of it this way, but there are two different purposes to academic assesment:
Organisational Assurance: do the students know what we think they should know, and do they know it at a ‘masterful’ level?
Student-Centred Assessment: do the students themselves know what they do and don’t know?
These two aims may sometimes conflict and need to be balanced. An over-emphasis on organisational assurance could negatively impact on transactional distance, while an over-emphasis on the student-centred learning, might detract from engaged learning communities and engaged online teaching.
On the other hand, good digital assessments can have a positive effect on student motivation, achievement, and engagement, by encouraging the students to develop more robust self-regulatory approaches to learning.
“A digital assignment can live on. It can be iterative, public, risky, and multi-voiced,”
and so we are encouraged to create assessment practices that bring to life the regulations of the university (2019) in innovative ways (what?).
In practice, that means we should be creating assessments that:
are beneficial to both the student and the programme
actively foster learning
are fair, reliable and valid
are secure and transparent
are linked to an authentic context
Authenticity in Assessment
Authentic assessments would be task-based, requiring students to demonstrate practices, behaviours, and skills that are relevant to professional practitioners in their intended fields.
For example, authentic assessments could include practice-based projects to apply domain specific concepts, organisational scenarios, and even mock consultancies for organisations.
References and Links
Bettley, A., & Horrocks, I. (2018). Emergent Versus Planned Assessment and Tuition Strategies for Online Postgraduate Teaching of Technology and Innovation Management at the Open University, UK. In On the Line (pp. 55-73). Springer, Cham.
Hatziapostoulou T. & Paraskakis I. (2010). Enhancing the impact of formative feedback on student learning through an online feedback system. Electronic Journal of e-Learning, 8, 11–122.
Ibabe I., & Jauregizar J. (2010). Online self-assessment with feedback and metacognitive knowledge. Higher Education, 59, 243–258. doi:10.1007/s10734-009-9245-6.
Moore, M. G. (2013). The Theory of Transactional Distance. In Handbook of distance education (84-103). London: Routledge.
Would automation of teaching bring us enhanced efficiency with ‘teacher-light’ tuition, or should it be resisted as damaging to teacher professionalism and the humanistic values of education?
With Teacherbot, an experiment in automated teaching, Professor of Digital Education, Sian Bayne (2015) asked,
What about the spaces in between teaching? What if “the ‘teacher function’ might become less a question of living teacher presence and more a posthuman mash-up of video, algorithm and automated process?” Could that both broaden and improve the student and teaching experience of what it means to be at university online?