This checklist from the course materials is a great resource for managing time and time-based expectations in online courses.
Category: Learning Design Page 1 of 5
Engaged Online Teaching and Time Management
Because technology is often associated with flexibility and fast time, this can lead to assumptions that online learning is faster and better. Institutions need to provide education in ways that fit with the lives of individual learners, and that means restructuring teaching time in flexible and personalised ways. A key part of engaged online teaching is mitigating transactional distance by planning for how teaching can be structured in both synchronous and asynchronous ways.
Redefining Contact Time
Contact time generally refers to the tutor-mediated time allocated to teaching or providing guidance and feedback to students. There has to be a different way to define contact time online, taking into account student mobility, distance education and flexible patterns of study. Online contact time can be characterised by personalised tutor presence and input within a specified time-frame.
19 words submitted in total.
Your words were:
- engaged 5%
- multimodal 5%
- authentic 5%
I thought this was a lovely activity to end the course with! I think my cohort had the bad luck to be disrupted by the coronavirus outbreak, so not as many made it to the end, but I know the current and future presentations of this course are packed (including with my manager), so I hope to see their word clouds at the end of it!
Course: ‘An Edinburgh Model for Online Teaching‘. Licence for content: Creative Commons Attribution 4.0 International (CC BY 4.0)
As the course leaders say, it is no good coming up with creative and inventive assessment ideas if we don’t have, or can’t use, the technology to implement them.
I was interested to see these screenshots of assessment options available in the edX platform, and particular that there was an option for inputting Maths expressions:
It’s time to reflect and review this part of the course.
We are asked:
- Consider how the feedback that has been provided so far in this programme lends itself to a particular kind of assessment.
- Consider how a misalignment with feedback and assessment might impact transactional distance.
- How would you assess what we have done in this module so far?
- What types of feedback would I need to provide in my own course to support the type of assessment that is expected in my discipline?
So, can I answer?
- I think the feedback on this program has been timely, low-pressure and informal. That would seem to lend itself to small, frequent, informal, low-key, non-compulsory assessments.
- If the tone and expectation setting of assessment and feedback didn’t match, it would drive students away. For example, either a seemingly very low key, informal assessment that was followed by an onslaught of harshly judgemental criticism, or a strictly defined and substantial assessment task that was followed by vague, brief, non specific and casual seeming feedback, would definitely be quite demoralising.
- I’m not sure what this question is asking: do I think it was a good module, or what would be a good way to tell what we have learned from it. So firstly, I think this whole course has been incredibly interesting and I wish I could do the MSc in Digital Education because it sounds fantastic. But it’s more likely I’m meant to think of a way to assess knowledge gained through study of this module, in which case, inventing an assessment task sounds like the most obvious choice!
- That first thing that comes to mind is that ‘feedforward’ assessments would be most useful for the practical aspects of scientific courses. I also think peer review would be an authentic assessment practice for scientific work. Another idea, which I suggested in the course discussion was that I think it would be interesting if some of our Environmental Science / Ecology students could do an Open Educational Resource (OER) as a group project relating to local environmental or sustainability issues and interacting with relevant local groups and officials. I think this would also be an authentic and relevant activity, with plenty of opportunities for timely and actionable feedback.
It is apparently time to review what ‘transactional distance’ means:
Wikipedia tells us:
Transactional distance theory was developed in the 1970s by Dr. Michael G. Moore, Distinguished Professor Emeritus of Education at the Pennsylvania State University.
InstructionalDesign.org tells us:
The theory of Transactional Distance states that as the level of interaction between teacher and learner decreases, learner autonomy must increase.
When talking about distance education we are typically talking about a teaching environment where the separation between the teacher and learner is significant enough that special teaching-learning strategies and techniques must be used.
Even though there are clearly recognizable patterns, there is also enormous variation in these strategies and
techniques and in the behaviour of teachers and learners. Within the family of distance education programmes there are many different degrees of transactional distance.
In my case, apparently it’s only possible to write far too much.
However, if I were writing a how-to guide or manual, I know I should be making it as short and to the point as possible.
In some cases, the same point could be made of assessments. A word count is not a very meaningful metric in itself, but does a strict word limit make an assignment harder, because it takes more skill to be concise, or easier, because there’s less to write? Either way, larger word counts add more work for the teacher, without necessarily making the assignment any more meaningful.
As one of my fellow students put it, quoting Einstein,
‘If you can’t explain it simply, you don’t understand it well enough’.
Another quoted Antoine de Saint-Exupéry about the creative journey:
“Perfection is achieved, not when there is nothing more to add, but when there is nothing left to take away.”
Sharing a different perspective, a commenter from the art school discussed enabling constraints, which should be related more to project duration (how long will the work last?) or should detail what students can NOT do. They argued for the importance for art students of learning how to distinguish between enabling constraints and concepts.
Building exceptional learning experiences
Rather tn merely measuring performance, we should use a variety of assessment forms, including multimedia and interactive formats, to focus academic development and course design around building exceptional learning experiences. We want to encourage the students to develop masterful levels of knowledge and practice, while remaining engaged with their learning communities.
Interesting Assessment Examples
Here are some examples of interesting assessment activities from the course materials:
- An online portfolio of student’s work collected at intervals over the duration of the course submitted with a covering letter discussing the rationale for its design.
- A set of coding exercises submitted at intervals during the course using computational notebooks
- A simulation where students must make a series of choices through a decision tree with feedback provided at each decision.
- A multiple-choice quiz weekly or at the end of each section during the course. (Perhaps they could use Top Hat electronic voting)
- A Wikipedia entry on a new topic.
- An Open Educational Resource (OER) group authored on a blog around a topic of immediate relevance to a local community.
- A defined research proposal for submission to a PhD programme.
- A Padlet or Thinglink as a mindmap of course concepts and emerging thinking along with a design rationale.
- Using a browser based web annotation tool like Hypothes.is to annotate the internet as part of an assignment.
- Using Mediahopper to host podcasts created as assessments, or Soundcloud to host them and allow for peer feedback as comments.
- Open Educational Resource (OER) groups
- Wikipedia entries
- Decision trees
- Computational notebooks
- Top Hat electronic voting
What is the purpose of assessment?
I had not thought of it this way, but there are two different purposes to academic assesment:
- Organisational Assurance: do the students know what we think they should know, and do they know it at a ‘masterful’ level?
- Student-Centred Assessment: do the students themselves know what they do and don’t know?
These two aims may sometimes conflict and need to be balanced. An over-emphasis on organisational assurance could negatively impact on transactional distance, while an over-emphasis on the student-centred learning, might detract from engaged learning communities and engaged online teaching.
On the other hand, good digital assessments can have a positive effect on student motivation, achievement, and engagement, by encouraging the students to develop more robust self-regulatory approaches to learning.
We are reminded that The Manifesto for Teaching Online tells us,
“A digital assignment can live on. It can be iterative, public, risky, and multi-voiced,”
and so we are encouraged to create assessment practices that bring to life the regulations of the university (2019) in innovative ways (what?).
In practice, that means we should be creating assessments that:
- are beneficial to both the student and the programme
- actively foster learning
- are fair, reliable and valid
- are secure and transparent
- are linked to an authentic context
Authenticity in Assessment
Authentic assessments would be task-based, requiring students to demonstrate practices, behaviours, and skills that are relevant to professional practitioners in their intended fields.
For example, authentic assessments could include practice-based projects to apply domain specific concepts, organisational scenarios, and even mock consultancies for organisations.
References and Links
- Bettley, A., & Horrocks, I. (2018). Emergent Versus Planned Assessment and Tuition Strategies for Online Postgraduate Teaching of Technology and Innovation Management at the Open University, UK. In On the Line (pp. 55-73). Springer, Cham.
- Hatziapostoulou T. & Paraskakis I. (2010). Enhancing the impact of formative feedback on student learning through an online feedback system. Electronic Journal of e-Learning, 8, 11–122.
- Ibabe I., & Jauregizar J. (2010). Online self-assessment with feedback and metacognitive knowledge. Higher Education, 59, 243–258. doi:10.1007/s10734-009-9245-6.
- Moore, M. G. (2013). The Theory of Transactional Distance. In Handbook of distance education (84-103). London: Routledge.
- University of Edinburgh (2019). Taught Assessment Regulations Academic Year 2018/19. Available: https://www.ed.ac.uk/files/atoms/files/taughtassessmentregulations.pdf
- The Manifesto for Teaching Online
Researchers from the Near Future Teaching Project interviewed students to get their thoughts on automation in teaching, and they had some interesting thoughts: