1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
|
IVLE Design - Misc
==================
Author: Steven Bird, Matt Giuca
Date: 4/12-7/12/2007
Tutorial page
-------------
Tutorials need to be able to include and submit not just Python code, but any
arbitrary HTML form (such as option buttons to answer multiple choice
questions, or non-EditArea text fields).
Specification
-------------
* includes marking scheme
Submission
----------
* student: commits against a tag specific to a project
* we do an svn rm of whatever is there; then an svn copy
* we do a checkout of this tag on the submission deadline
* this creates a working copy that the individual student and the
staff members can see
* student can navigate to their submission to verify it
Verification
------------
* to permit automated verification of an interactive submission, need
to design the project specification so that we can make assumptions
about field names, so we can test the submission using a GET request
* response could be HTML; easy to capture
* response could be a redirect to an image (won't follow img tags)
* unresolved issue re printing
* public tests that everyone can see; additional tests only seen by assessors
Workflow for assessor
---------------------
* sees a page of links, each for some test case
* sees peer reviews of this submission to help find issues
* sees peer reviews by this student which are assessed
* marking scheme and comment boxes, and mark boxes available
Peer review
-----------
* just another marking scheme (less detailed, more comment field-based)
* possibility of peer review in a multi-stage project; first stage can
be assessed and fully exposed to peer reviewer, later stages can use
anyone's implementation of the earlier stages
Tutorial exercises
------------------
* permit comment thread on each exercise
* other students permitted to score comments for usefulness
Relationship between verification and checking tutorial exercises:
* want to categorize mistakes and give hints
|