Child pages
  • Teaching Evaluations 1.4 - TQ Test Fest
Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 19 Next »

The TQ Test Fest is designed to get people involved with Functional Testing for the Teaching Evaluations 1.4 release. Everyone is welcome, from sysadmin to developer to student. 

Please read the information below to get started. 

When: Tuesday, February 21st starting at 7:00am EST

How do I get involved?

  1. Create an account at to be able to create JIRA Issues.
  2. Create an account here (on confluence) to be able to add your information to the Sign Up sheet below.
  3. Sign up in the Resources section below and start testing.

Test Fest JIRA

All issues found during the Test Fest should be created as Sub-Tasks in JIRA for the following version 1.4.0-B10 at
Throughout the Test Fest, all sub-tasks will be triaged. Duplicates and issues document expected functionality will be closed. Anything remaining will be assigned as appropriate.


  • The QA5 server is available for testing can be found here.
    Quick link:
  • Test Cases - Test cases for many of the functional areas of OAE can be found here. Not all of the test cases have been updated for the 1.1 release but they should still give the tester a good overview of the functionality. In addition, each section is linked to the corresponding test page in the sign up sheet below. 
  • Creating a bug in JIRA for the OAE Test Fest

Sign Up Sheet

If you are able to help with the test effort, please enter your name into the sheet below. Once the Test Fest starts and testing is under way please enter JIRA ticket numbers for any issues you create, the Operating System (eg, Windows 7, Mac OS 10.6) and Browser (eg, Internet Explorer 9.0, Firefox 7 you used to test with and any other pertinent information you have into the Notes section.

If someone has already entered their info in the functional area you are looking at that is ok, more than one set of eyes on each area is valuable. You could use a different OS, a different browser or just exercise that area in your own way. 

Sign Up Before You Start Testing

Before you start testing, sign up for the task(s) you plan to test.  If someone else has already signed up for a specific task, look for a different one to do.  That way we'll cover as much of the application as possible with a small group. 

All of the functional testing tasks are listed in the Google workbook named TQ 1.4 Release - Test Plan.  Each worksheet (tab)  contains one more sets of tasks as described below:

  • Jira Verification -  this is a list of bug fixes and enhancements that need to be verified.  To sign up to verify one or more of these, add your name to the Tester Name column for the items you plan to test. 
  •  Create Items - test scripts that focus on creating, modifying and removing Items. These are the questions or statements which the evaluator responds to.
  • Samigo Question Pools - regression test scripts that focus on creating and manipulating question pools.  Find the first empty column and fill out the requested information (Name, Date, Tag, Browser, OS) in Row 2.
  • Samigo AssessAuthor - regression test scripts that focus on authoring assessments.  Find the first empty column and fill out the requested information (Name, Date, Tag, Browser, OS) in Row 2.
  • Samigo Delivery - regression test scripts that focus on authoring assessments.  This set of tests is very long.  Each major section has a light blue background.  Sign up for one section at a time.

General Information

The Evaluation System is used to conduct formative and summative (end of term) evaluations and review the results. An evaluation consists of a series of scaled and/or free text questions, which are delivered to students over a fixed time period (typically a few days). This guide will explain how to create items (questions), templates, and evaluations, deliver the evaluation and view the results. Permissions have been assigned for the "maintain" and "access" roles.  Instructors with the maintain role can create a template, assign an evaluation to a template, and be evaluated in an evaluation.  Students with the access role can complete and submit an evaluation.

Overview of Evaluation Process

The process of using the Evaluation Tool involves the following general steps:
1. Create your items (this is optional as you can also create items while creating a template)
2. Create a template
3. Add items to your template
4. Create an evaluation
a. Set the parameters for the evaluation
5. Run the evaluation
6. View the results

Each of these steps are explained in the following sections. Click on the link in the Content table to view test conditions for each step.


If you are new to QA testing for Sakai, there are some things that you learn about and do before the Test Fest begins:

Creating test accounts and sites on the Sakai QA servers

On the Sakai QA servers, each user creates his or her own test accounts and sites*.

Login to the Qa5 server:  UserID = admin    Password = (traditional Sakai login)

Navigation for Teaching:  Click on "More Sites" at the top of the page > "TQ-test" site > Evaluation System tool

Evaluation Dashboard

The Evaluations Dashboard provides a summary of group information and the current status of your evaluations. Links at the top of the page when selected will display the following:

  • My Evaluations
  • My Templates
  • My Items
  • My Scales
  • My Email Templates
    • + Add Template
    • + Add Evaluation

You'll also see two boxes on the screen which are described below:

  • Site/Group Listing: displays the groups that the instructor can be evaluated in and the groups they can evaluate.
  • Evaluations I am creating or administering: displays the Title, Status and Date of the instructor's evaluations
    • Clicking on the Title of the evaluation will bring up a preview of the evaluation.
    • The Status column will indicate whether an evaluation is active or if the results are viewable. You can click on the View Report link to gain direct access to the report for that particular evaluation.
    • The Date column will indicate the due date of the evaluation or the date of the when results become viewable.

T2. Sign Up and Log In






T2.1 Sign up


T2.2 Log in widget



T2.3 Log out




T7. Content and Media






Create template and add/remove items



B. Test drag and drop re-ordering



C. Test drop-down menu re-ordering



T7.4 Share content overlay



T7.5 Content profile
(comments, related content, content metadata)



T7.6 File previews


Currently cannot be tested due to blocker bug

T7.7 File permissions



T7.8 Delete content



T7.9 Upload a new version



T7.10 Revision History



T7.11 Link previews



T7.12 Sakai Documents (viewing, adding, page titles)



T 7.13 IMSCP Import


KERN-2295, KERN-2352



T8. Page Editing

Creating test accounts and sites on the Sakai QA servers

On the Sakai QA servers, each user creates his or her own test accounts and sites*.

  • No labels