Any views expressed within media held on this service are those of the contributors, should not be taken as approved or endorsed by the University, and do not necessarily reflect the views of the University in respect of any particular issue.

...in which I don't go up mountains

Category: An Edinburgh Model for Online Teaching, Module 4: Feedback and Assessment Page 1 of 2

Pedagogy Word Cloud

Pedagogy word cloud

Reading Time: < 1 minute

My pedagogy

Pedagogy Word Cloud

19 words submitted in total.

Your words were:

  • engaged 5%
  • multimodal 5%
  • authentic 5%

I thought this was a lovely activity to end the course with! I think my cohort had the bad luck to be disrupted by the coronavirus outbreak, so not as many made it to the end, but I know the current and future presentations of this course are packed (including with my manager), so I hope to see their word clouds at the end of it!

Course: ‘An Edinburgh Model for Online Teaching‘. Licence for content: Creative Commons Attribution 4.0 International (CC BY 4.0)

Technology for Assessment

Reading Time: 2 minutes

As the course leaders say, it is no good coming up with creative and inventive assessment ideas if we don’t have, or can’t use, the technology to implement them.

I was interested to see these screenshots of assessment options available in the edX platform, and particular that there was an option for inputting Maths expressions:

edX assessment options
 

Desktop cactus, book and pages

A review of the assessment module

Reading Time: 2 minutes

It’s time to reflect and review this part of the course.

We are asked:

  1. Consider how the feedback that has been provided so far in this programme lends itself to a particular kind of assessment.
  2. Consider how a misalignment with feedback and assessment might impact transactional distance.
  3. How would you assess what we have done in this module so far?
  4. What types of feedback would I need to provide in my own course to support the type of assessment that is expected in my discipline?
     

So, can I answer?

  1. I think the feedback on this program has been timely, low-pressure and informal. That would seem to lend itself to small, frequent, informal, low-key, non-compulsory assessments.
     
  2. If the tone and expectation setting of assessment and feedback didn’t match, it would drive students away. For example, either a seemingly very low key, informal assessment that was followed by an onslaught of harshly judgemental criticism, or a strictly defined and substantial assessment task that was followed by vague, brief, non specific and casual seeming feedback, would definitely be quite demoralising.
     
  3. I’m not sure what this question is asking: do I think it was a good module, or what would be a good way to tell what we have learned from it. So firstly, I think this whole course has been incredibly interesting and I wish I could do the MSc in Digital Education because it sounds fantastic. But it’s more likely I’m meant to think of a way to assess knowledge gained through study of this module, in which case, inventing an assessment task sounds like the most obvious choice!
     
  4. That first thing that comes to mind is that ‘feedforward’ assessments would be most useful for the practical aspects of scientific courses. I also think peer review would be an authentic assessment practice for scientific work. Another idea, which I suggested in the course discussion was that I think it would be interesting if some of our Environmental Science / Ecology students could do an Open Educational Resource (OER) as a group project relating to local environmental or sustainability issues and interacting with relevant local groups and officials. I think this would also be an authentic and relevant activity, with plenty of opportunities for timely and actionable feedback.
     
Distance education in Second Life

What is Transactional Distance?

Reading Time: < 1 minute

It is apparently time to review what ‘transactional distance’ means:

Wikipedia tells us:

Transactional distance theory was developed in the 1970s by Dr. Michael G. Moore, Distinguished Professor Emeritus of Education at the Pennsylvania State University.

InstructionalDesign.org tells us:

The theory of Transactional Distance states that as the level of interaction between teacher and learner decreases, learner autonomy must increase.

When talking about distance education we are typically talking about a teaching environment where the separation between the teacher and learner is significant enough that special teaching-learning strategies and techniques must be used.

Even though there are clearly recognizable patterns, there is also enormous variation in these strategies and
techniques and in the behaviour of teachers and learners. Within the family of distance education programmes there are many different degrees of transactional distance.

Haiku about Mars

Is it easier to write more or less?

Reading Time: < 1 minute

In my case, apparently it’s only possible to write far too much.

However, if I were writing a how-to guide or manual, I know I should be making it as short and to the point as possible.

In some cases, the same point could be made of assessments. A word count is not a very meaningful metric in itself, but does a strict word limit make an assignment harder, because it takes more skill to be concise, or easier, because there’s less to write? Either way, larger word counts add more work for the teacher, without necessarily making the assignment any more meaningful.

As one of my fellow students put it, quoting Einstein,

‘If you can’t explain it simply, you don’t understand it well enough’.

Another quoted Antoine de Saint-Exupéry about the creative journey:

“Perfection is achieved, not when there is nothing more to add, but when there is nothing left to take away.”

Sharing a different perspective, a commenter from the art school discussed enabling constraints, which should be related more to project duration (how long will the work last?) or should detail what students can NOT do. They argued for the importance for art students of learning how to distinguish between enabling constraints and concepts.

Links

Assessment mind map

Using assessment in building exceptional learning experiences

Reading Time: < 1 minute

Building exceptional learning experiences

Rather tn merely measuring performance, we should use a variety of assessment forms, including multimedia and interactive formats, to focus academic development and course design around building exceptional learning experiences. We want to encourage the students to develop masterful levels of knowledge and practice, while remaining engaged with their learning communities.

Interesting Assessment Examples

Here are some examples of interesting assessment activities from the course materials:

  • An online portfolio of student’s work collected at intervals over the duration of the course submitted with a covering letter discussing the rationale for its design.
  • A set of coding exercises submitted at intervals during the course using computational notebooks
  • A simulation where students must make a series of choices through a decision tree with feedback provided at each decision.
  • A multiple-choice quiz weekly or at the end of each section during the course. (Perhaps they could use Top Hat electronic voting)
  • A Wikipedia entry on a new topic.
  • An Open Educational Resource (OER) group authored on a blog around a topic of immediate relevance to a local community.
  • A defined research proposal for submission to a PhD programme.
  • A Padlet or Thinglink as a mindmap of course concepts and emerging thinking along with a design rationale.
  • Using a browser based web annotation tool like Hypothes.is to annotate the internet as part of an assignment.
  • Using Mediahopper to host podcasts created as assessments, or Soundcloud to host them and allow for peer feedback as comments.

Links

Assessment

Beginning Assessment

Reading Time: 2 minutes

What is the purpose of assessment?

I had not thought of it this way, but there are two different purposes to academic assesment:

  1. Organisational Assurance: do the students know what we think they should know, and do they know it at a ‘masterful’ level?
  2. Student-Centred Assessment: do the students themselves know what they do and don’t know?

These two aims may sometimes conflict and need to be balanced. An over-emphasis on organisational assurance could negatively impact on transactional distance, while an over-emphasis on the student-centred learning, might detract from engaged learning communities and engaged online teaching.

On the other hand, good digital assessments can have a positive effect on student motivation, achievement, and engagement, by encouraging the students to develop more robust self-regulatory approaches to learning.

We are reminded that The Manifesto for Teaching Online tells us,

“A digital assignment can live on. It can be iterative, public, risky, and multi-voiced,”

and so we are encouraged to create assessment practices that bring to life the regulations of the university (2019) in innovative ways (what?).

In practice, that means we should be creating assessments that:

  • are beneficial to both the student and the programme
  • actively foster learning
  • are fair, reliable and valid
  • are secure and transparent
  • are linked to an authentic context

Authenticity in Assessment

Authentic assessments would be task-based, requiring students to demonstrate practices, behaviours, and skills that are relevant to professional practitioners in their intended fields.

For example, authentic assessments could include practice-based projects to apply domain specific concepts, organisational scenarios, and even mock consultancies for organisations.

References and Links

  • Bettley, A., & Horrocks, I. (2018). Emergent Versus Planned Assessment and Tuition Strategies for Online Postgraduate Teaching of Technology and Innovation Management at the Open University, UK. In On the Line (pp. 55-73). Springer, Cham.
  • Hatziapostoulou T. & Paraskakis I. (2010). Enhancing the impact of formative feedback on student learning through an online feedback system. Electronic Journal of e-Learning, 8, 11–122.
  • Ibabe I., & Jauregizar J. (2010). Online self-assessment with feedback and metacognitive knowledge. Higher Education, 59, 243–258. doi:10.1007/s10734-009-9245-6.
  • Moore, M. G. (2013). The Theory of Transactional Distance. In Handbook of distance education (84-103). London: Routledge.
  • University of Edinburgh (2019). Taught Assessment Regulations Academic Year 2018/19. Available: https://www.ed.ac.uk/files/atoms/files/taughtassessmentregulations.pdf
  • The Manifesto for Teaching Online
Robots and humans

Video Reflections on Automation in Teaching

Reading Time: < 1 minute

Researchers from the Near Future Teaching Project interviewed students to get their thoughts on automation in teaching, and they had some interesting thoughts:

Woodcut illustration of a teacher and students

Teachers, Bots, and the Teacher Function Online

Reading Time: 6 minutes

Is it good when times keep changing?

Would automation of teaching bring us enhanced efficiency with ‘teacher-light’ tuition, or should it be resisted as damaging to teacher professionalism and the humanistic values of education?

With Teacherbot, an experiment in automated teaching, Professor of Digital Education, Sian Bayne (2015) asked,

What about the spaces in between teaching? What if “the ‘teacher function’ might become less a question of living teacher presence and more a posthuman mash-up of video, algorithm and automated process?” Could that both broaden and improve the student and teaching experience of what it means to be at university online?

Feedback and speech bubbles

Discussion: Assessment and feedback

Reading Time: 5 minutes

  1. What concerns would you imagine people having with feedback and assessment online who were new to this form of teaching? (for example, uncertainty about how much time to spend giving feedback).
  2. Imagine you are an online student. How much feedback would you want? How many times per course would you want to be assessed?

Page 1 of 2

Powered by WordPress & Theme by Anders Norén

css.php

Report this page

To report inappropriate content on this page, please use the form below. Upon receiving your report, we will be in touch as per the Take Down Policy of the service.

Please note that personal data collected through this form is used and stored for the purposes of processing this report and communication with you.

If you are unable to report a concern about content via this form please contact the Service Owner.

Please enter an email address you wish to be contacted on. Please describe the unacceptable content in sufficient detail to allow us to locate it, and why you consider it to be unacceptable.
By submitting this report, you accept that it is accurate and that fraudulent or nuisance complaints may result in action by the University.

  Cancel