Summary
Remark is computer software that works in conjunction with the Scantron OpScan 4ES machine housed in CIRT. The Remark system is designed for quick score scans that produce a variety of reporting and analysis options. Exams are scored and converted into reports, which can be exported to a comma delimited (CSV) file and then opened with Excel or uploaded to Canvas for posting.
The directions below walk through the steps of scanning and scoring test forms and generating reports. Click through the PowerPoint file for a visual walk-through or continue scrolling for a step-by-step text guide of the processes.
Scantron Step-By-Step Guide
Step 1: Prep the Instructor Folder and Create an Excel Roster
Export the Canvas Gradebook/Roster
- Open the folder on the desktop labeled “Temporary.”
- Create a new folder inside of the “Temporary” folder, and title it with the instructor’s last name.
- Export the Canvas Gradebook to retrieve student names and N-numbers.
- From the Canvas course gradebook, click the “Actions” dropdown menu and select “Export.” (This will download a CSV file.)
Format the Excel File
- Format the N-number column to remove the N-Number:
- Remove all columns except for the student names and N-number.
- Highlight the column with the N-numbers.
- Select the Data tab.
- Click Text to Columns. A dialogue box will open.
- Deliminated should be selected.
- Click Next. Uncheck “Tab” and check “Other”, type “n” in the textbox.
- Click Next, then Finish.
Step 2: Insert the Test Forms into the Scantron machine and Scan
- Place Scantron sheets into tray face-up with the answer keys on top.
- Push “Press to Load” at the top of the machine to align the document into the OpScan feeder.
- Double click on the appropriate icon from the desktop to launch the program.
- Select “Scantron Single Key” to score a test with one answer key.
- Select “Scantron Multi Key” to score a test with multiple versions.
- Click Read and select Next in the dialog box.
- Make sure that “Multiple responses” and “Database lookup regions” are checked. (If multiple test versions/answer keys are in use, make sure that “Required Item” has also been checked.)
- Click Read.
- The reader will read all documents and only stop if the document requires review. (Note – it will flag the answer key(s) for review.)
- If no action is needed (such as when it flags the answer key), click End Review and Save Page to continue.
- If the box flagged for review is highlighted gray or purple, then the student either did not fill in the N-number correctly or left it blank and the database could not find them.
- If the full N-number is present, type it in the first highlighted box. Set the test form aside for review, make a note of the line number from the excel sheet, and select End Review and Save Page to continue with the scanning.
- If the N-number is not present or appears wrong, type the student’s name into the first highlighted box. Set the test form aside for review, make a note of the line number from the excel sheet, and select End Review and Save Page to continue with the scanning.
- If the box flagged for review is highlighted green, then the student possibly marked multiple answers. If the intended answer choice can be determined, select the student’s marked response from the drop-down menu within the corresponding cell.
- If the box flagged for review is highlighted yellow with blanks for all questions, then the student used a pen instead of a pencil and the OpScan reader could not scan the document properly. Hand key the scores and student information.
- After scanning all documents is complete, select No to stop scanning.
- To recheck N-numbers or student names that were highlighted for review, click Rerun Database Lookup in the left-hand menu.
- If the N-number does not return a name, the student’s name can be hand-keyed, and the student’s scores can be matched during the Gradebook upload into Canvas.
- Save the document as an EXCEL file (97-2003.xls) to the instructor’s folder within the temporary folder on the desktop. (This document is what we use if we need to retrieve additional information or make edits after the scoring session is ended.)
Step 3: Format the Answer Key(s) and Score the Test
- Start by clicking Advanced Grade.
For a Single Answer Key
- Select Answer Key in the left-hand menu. Click the “Import answer key from” dropdown menu.
- Select Data Set (Grid) Row.
- Make sure “1” is selected in the corresponding box.
- Click Import key.
- Select Question Properties in the left-hand menu. All answers default to 1 point. To adjust point values, click to highlight Ans_ in the left “All Questions” column (hold Shift to select multiple questions). Change the point values in the “Correct Points” textbox within the right “Scoring” menu box. (See Appendix A for adding Extra Credit and Partial Credit.)
- Once the Answer Key and Questions Properties have been appropriately adjusted, click Grade.
- Click Yes to save the answer key.
- Save to the instructor’s folder within the Temporary folder on the desktop.
For Multiple Answer Keys
- Select Test Versions in the left-hand menu.
- Click to select Define multiple test versions.
- Select Test Form from the first dropdown menu.
- Click the “Import answer key from” dropdown menu.
- Select Data Set (Grid) Row. Make sure that “1” is selected in the corresponding box.
- Click Import Key. The key will populate in the “Key 1” column.
- To import additional keys, click the Create Version button. Change “1” to “2” and click Import Key. The key will populate in the “Key 2” column. Repeat steps to add all additional keys.
- Select Question Properties in the left-hand menu. All answers default to 1 point. To adjust point values, click to highlight Ans_ in the left “All Questions” column (hold Shift to select multiple questions). Change the point values in the “Correct Points” textbox in the right “Scoring” menu box. Select different test versions by clicking on the correct test version at the top of the dialog box and repeat. (See Appendix A for adding Extra Credit and Partial Credit.)
- Once the Answer Keys and Questions Properties have been appropriately adjusted, click Grade.
- Click Yes to save the answer key.
- Save to the instructor’s folder within the Temporary folder on the desktop.
Step 4: Export Grades to Canvas and Generate Reports
Select Export to Gradebook.
- Choose “Canvas LMS” from the Gradebook format dropdown menu.
- Choose “ID” from the Student name dropdown menu. Click Export.
- Save the file as a Canvas LMS CSV file to the instructor’s folder within the Temporary folder on the desktop.
- (Optional) Upload to the Canvas Gradebook. From the Canvas course gradebook, click the Actions dropdown menu and select Import. Select the CSV file that was just exported and follow the prompts.
Reports are automatically generated and there are many options to choose from. Click Reports and select from the provided lists. Commonly requested reports:
- 100 – Test Analysis
- 103 – Class Frequency
- 150 – Student Grade
- 201 – Detailed Item Analysis
- 206 – Condensed Test Report
Once a report is selected, click Export Report to save it to the instructor’s folder within the Temporary folder on the desktop.
Step 5: Transfer Saved Items and Delete Student Data from the Desktop
Save the contents of the instructor’s folder to a permanent location. Options include:
- Upload all items to an unpublished folder within the Files of the corresponding Canvas course.
- Upload all items to the instructor’s UNF OneDrive.
- Move all items to a USB drive supplied by the instructor.
Important Note: CIRT does not recommend sending the files via email because they contain student grades and N-numbers which are classified as non-directory information.
- Move the instructor’s folder from within the Temporary folder to the Recycle Bin. Double check to make sure there are no other files with student data saved elsewhere on the computer (such as in the Downloads folder). Right click on the Recycle Bin and select Empty Recycle Bin.
- Delete the student names and N-numbers from the “Student Database Template” file on the desktop and click Save. (Important: Do not delete this file, only the content that was copied and pasted into it!)
Appendix A: Awarding Partial or Extra Credit
Partial Credit
- After you have clicked Advanced Grade and have assigned the answer key(s) to the scan, click Question Properties.
- Select the individual question that needs partial credit, and under “Grade Settings” on the right, click the icon next to “Partial Credit” and click Define.
- A new window should appear. In the left-hand table, identify which is the correct, full credit answer and corresponding point value.
- Identify the correct, partial credit answers and their corresponding point values in the proceeding boxes.
- If a student must select multiple answers to receive full credit, list them in one box at a time.
- Note: if a student must select multiple answers to receive full credit, they will not receive partial credit if they only select one answer choice.
- Preview the grading combination before submitting.
- Repeat steps for multiple partial-credit questions and for multiple versions of the test.
Extra Credit
- After you have clicked Advanced Grade and have assigned the answer key(s) to the scan, then proceed to Question Properties.
- Select the question(s) that are to be counted as extra credit and click Extra Credit Question under the Grade Settings menu.
- Repeat steps for multiple versions of the test.
Appendix B: Retrieving a Test Report to Generate/Rerun Scores
Note: You must have access to the EXCEL data file from the initial session.
- Open the appropriate Remark app on the desktop.
- Click Open Data on the top banner menu, locate the Excel data file that is needed, and upload to the Remark system.
- Make whatever changes needed and save a new file – do not overwrite the old file in case an error is made, or you need to retrieve that file again.
- Repeat Advanced Grading steps to re-grade and generate new reports.
