You can open the assignments in teacher mode. This allows you to see any content that is for teachers' eyes only. This includes hidden content and teacher solutions auto-graded assessments.
From the Courses screen, click on your course to open it in teacher mode (where the background is white and the pencil icon does not have a line through it). If your teacher account is read only you will be in teacher mode.
You will see the assignments you have assigned to your course. To open the assignment to preview it, click the blue triple dot icon to the right of the unit name, and choose Preview
Important: Each time you preview the assignment it opens as new. i.e. anything you may add as notes to your preview is not saved
Overview of student progress
You can monitor student progress and time spent on individual assignments.
Video: Viewing Student Work and Adjusting Individual Due Dates
- From the Courses screen, click on your course to open it.
- Click on the Students tab, top centre of your screen.
- You will see all students in your course displayed on this screen. You will see progress data for assignments started and assignments completed alongside their names.
- To see an individual student's progress in more detail click on their name. You will then see an individual breakdown of auto-graded assessment results, along with time spent on each assignment.
- To see a more detailed breakdown of each assignment the student has attempted, click on the assignment name. You will be able to view a breakdown of the challenges attempted along with corresponding results.
Download CSV summary
You can also download a CSV file of your students progress. You can do this for individual assignments to see all your students by clicking on the blue triple dot icon to the right of the assignment name:
or you can download a CSV file for the Course module to see all your students progress in all the assignments in a Module by selecting Download CSV:
or you can export all the data from a course (including the students workspaces) by exporting course data. See export course data for more details
Accessing student work
As a teacher you have access to your students cloud area within Codio. This allows you to view and access any work your students have completed at any time.
- From the Courses area, click on your course to open it.
- Click on the Students tab, top centre of your screen.
You will see all students in your course displayed on this screen. By default they will show sorted alphabetically by first name but you can also sort them by last name, number of started or number of completed assignments if preferred.
To view/access an individual students work click on their name. On the far right of the screen, under the heading Open, click the blue arrow to open the students work.
When accessing a students assignment, all active users in a project/assignment will be shown with a color in an icon showing in the menu bar when files are being accessed/edited
Clicking on the icon will change focus to show what that user is currently editing highlighted in that color and will show the users cursor. Hovering over the icon will show the filename and line currently being edited.
This can be very useful if a student needs assistance as you can see what they are doing, real time and if you need to demonstrate something to them, they can see what you are doing
Teachers have access to all of the files that students produce on Codio. In order to see how these code files were built, teachers can use Code Playback. If your cursor is in the code file you want to see the playback of, simply select Tools->Code Playback menu. If you are looking into a multi-file program or did not have the file you want to investigate in-focus, search for the student’s file by clicking on the folder icon.
To watch the code be built, click the play button. You can change the speed using the Speed drop down which is in changes per second. To walk through the changes manually, you can use the “Previous change” and “Next change” buttons. You can drag along the playback slider to find points of interest.
Auto-graded assessments will appear in the teacher dashboard.
Assignment creators create the assignment with Jupyter notebook files for the assignment.
Any user configurations required should be stored in a
.codio-jupyter file exists in a project we assume it is jupyter based grader, and therefore only nbgrader can be selected for the assessment scripts in the assignment
If the assignment is updated in the future, when published it will overwrite all tests and read only cells with the new version and the release version for the students will be updated.
When the student submits the assignment by marking the assignment as complete, it will be autograded automatically.
Manual grading is also available if required
Extend Timeout period
To extend the time required for completion (to 90 seconds in this example), you can add
nbgrader: ExecutePreprocessor.timeout: 90
Lock all cells
To lock all cells (Default: False)
nbgrader: LockCells.lock_all_cells: True
Lock all grade cells
To lock all grade cells (Default: True) where grade cells are locked (non-deletable)
nbgrader: LockCells.lock_grade_cells: True
Lock all read-only cells
To lock all grade cells (Default: True) where read only cells are locked (non-deletable and non-editable)
nbgrader: LockCells.lock_readonly_cells: True
Lock all solution cells
To lock all solution cells (Default: True) where solution cells are locked (non-deletable and non-editable)
nbgrader: LockCells.lock_solution_cells: True
Execute preprocessor on timeout
If execution of a cell times out, interrupt the kernel and continue executing other cells rather than throwing an error and stopping.
nbgrader: ExecutePreprocessor.interrupt_on_timeout: True
To run custom grading with jupyter
To avoid execution of autograder with nbgrader and allow codio script autograder to be executed. When set this will not show jupyter files as assessments in codio and will not submit through nbrader after mark as completed, so not assessments and points set in the assignment.
codio: grader: false
If you require any assistance at all, or would like us to consider adding additional functions, please don't hesitate to contact us
Grading project work
Codio's grading features address four important aspects when grading student projects.
- Assign grade - manually reviewing student projects and then assigning a grade.
- Grading moderation - having other lecturers review grades already assigned in order to monitor consistency of grading.
- Grading rubric - This provides a grading guideline framework for teachers. Please click here for details.
- LMS gradebook sycnhronization - This feature ensures that when teachers release grades, the data is passed automatically to any LTI enabled LMS platform such as Moodle, Blackboard and Canvas.
The grading process
Once students have completed their assignments, they should notify the teacher of completion by going to the Education->Mark as Completed menu item within the IDE. The teacher is then able to see whose project is ready to be graded (see below image with completion status circled left).
The teacher is also able to filter either finding specific students or to view students based on the status of the assignment.
Students can be filtered by:
- Any Status
- Not Started
- Has Final Grade
- No Final Grade
- Needs Grading
You can access the student's project from the same screen by clicking on the 3 blue dots on the extreme right (see below image with dots circled right). You can then review the project.
The teacher can also mark the assignment as complete going to the Education->Mark as Completed menu item within the IDE and if already marked as complete, can change the status to incomplete
There are two ways to assign the grade.
- Either you can grade from within the IDE itself from the Education menu item. You need to have a student project open in the IDE.
- Or you can grade from the course dashboard. You must first have selected the assignment associated with the project and then press the grading icon.
Also see Autograding
To grade from the course dashboard, you should first select the assignment. You can see the check mark next to those students who have completed the assignment.
To assign comments or a grade, Teachers Grading needs to be enabled. When it is click on the Grade icon (see image above with grading icons circled center) and select 'Add Grade' button. You can then modify the comments and grade fields for any individual student. Due to the weighting feature, we only allow numeric grades. If you are using a Rubric Template, this will present as you click on the grade field.
If the students assignment has already been graded, any other teacher in the course can edit the grade with additional comments if required selecting the 'Override Grade' button.
If required, anonymous grading can be set for the course so that students will not see the names of the teachers who graded their work. For more information and how to enable this click here
Teachers can also comment on code within students files.
To do this, open the students project and open the file. Hover over the left hand side of the gutter bar and click the
+ to open the comment window and enter the comments as required. This comment will be visible to the student when they next view the file
Multiple lines of code can be selected and the teacher can also edit/delete or add additional comments (from the 3 dots to the right of the comment window when the comment is saved) if required.
When actioned by the student, the comment will be marked as resolved but will still be available for review in the Education -> Code Comments menu item or from the Guides settings area.
Students can also go to this to see all comments and click to open the neccessary file.
Video: Releasing Grades to Students and LMS
By default students are not shown the grades until you decide to release them to the course. This allows you to hold back until you have completed the entire grading process and then release them in one go. If you want the students to see the grades as you go you can:
- enable this for the course in the Course>Admin area
- set this at the organisation level so any courses created will have this enabled automatically. See organisation release grades for more information.
- You can also release grades from the main assignment view flipping the switch in the Release grades column for the assignment(s) you wish to release the grades for.
Students are able to see their grades either from their Course view or by opening the assignment and going to Education->Feedback
Grading free text questions
Free text questions will normally require a manual grading process. In order to grade these questions, you should first select the assignment. You will then be shown the student list, as you can see below.
You can now select a student. You will then be shown the list of all assessments for that student within the assignment. Free text questions are denoted by the icon highlighted below.
Note that if a student has started to answer a question but not submitted the answer, then you will see DRAFT written next to it. Once they submit, you will see GRADE indicating that the question has been submitted and is ready to be graded.
Partial Point Rubric
Partial point assessments, where full points have not been awarded, will show the icon:
Where an answer is set to allow partial points, a rubric is provided to allow graders to dynamically deduct points from the maximum score. A grader can add an item, change an item weight or remove an item at any time in grading. The change will be applied for all students in this assignment, and any changes in rubric will upgrade already graded students to implement changes. The rubric is dynamic for each assignment, and every new assignment starts with an empty rubric.
Every rubric item is 2 fields, first is the rubric item weight and the second one line item name.
- If an item is selected, then the weight is deducted from students score.
- The grader can select multiple items.
- The total score can't be negative even if sum of rubric items weights is more than maximum points.
Editing is allowed while grading so the teacher can:
- add a new item into the form
- remove an item. As this action will effect all students already graded and their total score updated, a warning is shown for confirmation
- edit the weight or name. If weight is changed a warning will be shown for confirmation
A rubric can be cloned from another assignment if required in preference to creating manually. Select the gear icon (circled in image above) to select the assignment.
The points adjust field allows the teacher/instructor to manually adjust (ie reduce) the students total score if required without having to edit/change the rubric
A comments field is provided to allow teacher/instructors manual feedback
If a course deadline is reached, then you can grade questions that are set to DRAFT and where the student may have forgotten to submit the answer fully.
You can also see the date and time for each submitted answer as well as the date that the assignment was marked as complete by the student.