Location: Role of the VLE and associated learning systems in supporting summative e-assessment

Discussion: Policy on role of VLE in supporting summative e-assessmentReported This is a featured thread

Category: Discussion Forum / General Discussion
Showing 8 posts
Richard_Walker
Richard_Walker
Policy on role of VLE in supporting summative e-assessment
Oct 28 2009, 6:35 AM EDT | Post edited: Oct 28 2009, 6:35 AM EDT
The VLE can be used by academics 'under the radar' for high stakes assessment, without central support actually knowing what is going on. This has prompted the following draft policy, which is currently being discussed at York, which places the onus on course leaders to address contingency measures if they are planning to use the VLE in this way. Link to draft policy: http://tinyurl.com/yfxkoau
I would welcome the opportunity to see howe other HEIs are tackling this issue. Do you find this valuable?    
Keyword tags: None
FionaStrawbridge
FionaStrawbridge
1. RE: Policy on role of VLE in supporting summative e-assessment
Oct 29 2009, 6:52 AM EDT | Post edited: Oct 29 2009, 6:52 AM EDT
Presumably you offer an alternative (such as Questionmark Perception or similar)?

I can accept the performance risk you outline.
For the others I feel that there may be measures you could take to address them:
Could a secure browser be used to address the problem of access to inappropriate resources?
For the impersonation and split sessions, I guess these are going to be relevant for a 'secure e-assessment' system just as much as for the VLE.

We are struggling with these very issues at the moment... Do you find this valuable?    

peteobee
2. RE: Policy on role of VLE in supporting summative e-assessment
Oct 29 2009, 7:53 AM EDT | Post edited: Oct 29 2009, 7:53 AM EDT
One approach I've used to preventing 'under the radar' summative assessment is ensure that the booking of any computer room for this purpose has to come from central support (ideally) or that central support is informed as part of that process.
I'm sure I have heard of some institutions including e-assessment policies in the work of the exams office, so that any summative assessment that does not adhere to these processes can not be run. I suspect that is largely dependant on the strength of the exam office within the institution however. Do you find this valuable?    
farzana_khandia
farzana_khandia
3. RE: Policy on role of VLE in supporting summative e-assessment
Oct 29 2009, 12:42 PM EDT | Post edited: Oct 29 2009, 12:42 PM EDT
We are in the same pridicament whereby the official line has been use QMP for high stakes. We have since introduced a VLE with a Quiz engine (never had that before as our VLE was home grown) and now academics are using the VLE, which is forcing us to re-look at our policies and accept the fact that this is happening and look at ways of supporting it, rather than forcing them down certain routes and putting them off altogether. Do you find this valuable?    
FionaStrawbridge
FionaStrawbridge
4. RE: Policy on role of VLE in supporting summative e-assessment
Oct 29 2009, 5:42 PM EDT | Post edited: Oct 29 2009, 5:42 PM EDT
As it happens am now in the midst of a debate with the exams office over visibility of VLE quiz questions to multiple tutors and administrators on a VLE course. This is in contrast to conventional exams which are protected under lock and key (but of course probably actually carried around on laptops and left on buses...) Do you find this valuable?    
PatrickCraven
PatrickCraven
5. RE: Policy on role of VLE in supporting summative e-assessment
Nov 2 2009, 3:55 AM EST | Post edited: Nov 2 2009, 3:55 AM EST
An ongoing debate in the high stakes world of e-assessment. It does appear at times that the bar is raised when debating security issues with e-assessment but I do appreciate that impact of security breaches can be far faster and more wide-reaching in an e-world. I would be interested to know if the high stakes assessment activties described still require invigilation. Good invigilation can still be better than a whole array of complex technology options. Do you find this valuable?    
FionaStrawbridge
FionaStrawbridge
6. RE: Policy on role of VLE in supporting summative e-assessment
Nov 2 2009, 4:32 AM EST | Post edited: Nov 2 2009, 4:32 AM EST
I absolutely agree about the importance of careful invigilation! Do you find this valuable?    
martyjacobs
martyjacobs
7. RE: Policy on role of VLE in supporting summative e-assessment
Nov 5 2009, 10:41 AM EST | Post edited: Nov 5 2009, 10:46 AM EST
Yeah, nothing can replace good invigilation proceedures. An e-assessment should be treated in the same manner as a paper based one, or you run the risk of both staff and students perceiving the exam as less important/serious.

A controversial idea would be to remove the feature from your VLE if it is being abused in this way (this is possible with Moodle), then users would have to use the more secure alternative. However, this would force all users to use the other system, even if they were delivering formative tests. Do you find this valuable?