Child pages
  • Teaching Evaluations 1.4 - TQ Test Fest

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

The 1.1 OAE TQ Test Fest is designed to get people involved with Functional Testing for the OAE Teaching Evaluations/Questionnaires 1.1 4 release.  Everyone is welcome, from sysadmin to developer to studentconsultant

Please read the information below to get started. 

Table of Contents
maxLevel3
typeflat

When:

...

Tuesday,

...

February 21st starting at

...

7:00am EST

How do I get involved?

  1. Create an account at https://jira.sakaiproject.org/ to be able to create JIRA Issues.
  2. Create an account here (on confluence) to be able to add your information to the Sign Up sheet below.
  3. Sign up in the Resources section below and start testing.

Test Fest JIRA

Note

All issues found during the Test Fest should be created as Sub-Tasks to in JIRA for the following JIRA: http:version 1.4.0-B10 at https://jira.sakaiproject.org/browse/SAKIII-4314 EVALSYS
Throughout the Test Fest, all sub-tasks will be triaged. Duplicates and issues document expected functionality will be closed. Anything remaining will be assigned as appropriate.

The pie chart below shows the number of issues by component that have been created as part of the OAE Test Fest. (Currently uses a sample JIRA with sub-tasks)

Gadget
preferencesprojectOrFilterId=filter-13076&statType=components&isConfigured=true&refresh=30
urlhttps://jira.sakaiproject.org/rest/gadgets/1.0/g/com.atlassian.jira.gadgets:pie-chart-gadget/gadgets/piechart-gadget.xml

Resources

...

General Information

The Evaluation System is used to conduct formative and summative (End of Term) evaluations and review the results. An evaluation consists of a series of scaled and/or free text questions, which are delivered to students over a fixed time period (typically a few days). This guide will explain how to create items (questions), templates, and evaluations, deliver the evaluation and view the results. Permissions have been assigned for the "maintain" and "access" roles.  Instructors with the maintain role can create a template, assign an evaluation to a template, and be evaluated in an evaluation.  Students with the access role can complete and submit an evaluation.  Test IDs were created for an Instructor and Students to assist the tester with this effort.

Overview of Evaluation Process

The process of using the Evaluation Tool involves the following general steps:
1. Create your items (this is optional as you can also create items while creating a template)
2. Create a template
3. Add items to your template
4. Create an evaluation
a. Set the parameters for the evaluation
5. Run the evaluation
6. View the results

Each of these steps are explained in the following sections.

Preparation

If you are new to QA testing for Sakai, there are some things that you do before the Test Fest begins:

Creating test accounts and sites on the Sakai QA servers

  • The QA5 server is available for testing and can be found here.
    Quick link: httpshttp://qa20qa5-us.sakaiproject.org:8088
  • Test Cases - Test cases for many of the functional areas of OAE can be found here. Not all of the test cases have been updated for the 1.1 release but they should still give the tester a good overview of the functionality. In addition, each section is linked to the corresponding test page in the sign up sheet below. 
  • Creating a bug in JIRA for the OAE Test Fest/portal
  • Login to the Qa5 server: 
    • UserID = admin
    • Password = (traditional Sakai login)  contact Cathy Crouch if you need additional information (crouch@umich.edu)
  • On the Sakai QA servers, each user can create his or her own test accounts and sites.
  • Test accounts have been setup for the following IDs:  Instructor01, Student01, and Student02.  See the Information page of the test plan for details.
  • Navigation for Teaching Evaluations:  Click on "More Sites" at the top of the page > "TQ-test" site > Evaluation System tool

Evaluation Dashboard

The Evaluations Dashboard provides a summary of group information and the current status of your evaluations. Links at the top of the page when selected will display the following:

  • My Evaluations
  • My Templates
  • My Items
  • My Scales
  • My Email Templates
    • + Add Template
    • + Add Evaluation

You'll also see two boxes on the screen which are described below:

  • Site/Group Listing: displays the groups that the instructor can be evaluated in and the groups they can evaluate.
  • Evaluations I am creating or administering: displays the Title, Status and Date of the instructor's evaluations
    • Clicking on the Title of the evaluation will bring up a preview of the evaluation.
    • The Status column will indicate whether an evaluation is active or if the results are viewable. You can click on the View Report link to gain direct access to the report for that particular evaluation.
    • The Date column will indicate the due date of the evaluation or the date of the when results become viewable.

Sign Up Sheet

If you are able to help with the test effort, please enter your name Name and the Feature that your testing into the sheet below. An example of a Feature would be "Create Templates."  Once the Test Fest starts and testing is under way please enter JIRA ticket numbers for any issues you create, the Operating System (eg, Windows 7, Mac OS 10.6) and Browser (eg, Internet Explorer 9.0, Firefox 7 10.0.2) you used to test with and any other pertinent information you have into the Notes section.

Note

If someone has already entered their info in the functional area you are looking at that is okOK, more than one set of eyes on each area is valuable. You could use a different OS, a different browser or just exercise that area in your own way. 

T1. Core UI features

...

Feature

...

Tester

...

Issues

...

OS/Browser

...

Notes

...

T1.1 Top Navigation

...

 

...

 

...

T1.2 Footer

...

 

...

 

...

 

...

T1.3 404/401/500 

...

 

...

 

...

 

T2. Sign Up and Log In

...

Feature

...

Tester

...

Issues

...

OS/Browser

...

Notes

...

T2.1 Sign up

...

Jon Hays

...

 

...

OS X/Chrome 15.0.874.121

...

Looks good.  It is definitely odd that 2 users can still have the same username with only slight variations in case (see SAKIII-3063)  Seems like KERN-2211 should resolve this issue.

...

T2.2 Log in widget

...

Jon Hays

...

 

...

OS X/Chrome 15.0.874.121

...

Looks good.

...

T2.3 Log out

...

 

...

 

...

 

T3. Browse and explore

...

Feature

...

Tester

...

Issues

...

OS/Browser

...

Notes

...

T3.1 Explore page

...

SAKIII-4319, KERN-2376

...

 

...

 

...

T3.2 All categories page

...

 

...

 

...

 

...

T3.3 Category and subcategory page

...

 

...

 

...

 

T4. Search

...

Feature

...

Tester

...

Issues

...

OS/Browser

...

Notes

...

T4.1 Search all

...

 

...

SAKIII-4319

...

 

...

T4.2 Search content

...

 

...

SAKIII-4319

...

 

...

T4.3 Search people

...

 

...

KERN-2376

...

 

...

 

...

T4.4 Search worlds

...

 

...

KERN-2376

...

 

...

 

T5. Personal space

...

Feature

...

Tester

...

Issues

...

OS/Browser

...

Notes

...

T5.1 My Dashboard

...

 

...

 

...

T5.2 Carousel widget

...

 

...

 

...

T5.3 My Messages

...

 

...

 

...

T5.4 My Library

...

SAKIII-4266SAKIII-4104

...

 

...

T5.5 My Contacts

...

SAKIII-4274KERN-2299

...

 

...

T5.6 My Membership

...

SAKIII-4281SAKIII-4282

...

 

...

T5.7 My Profile

...

 

...

 

...

T5.9 Change profile picture

...

 

...

 

...

T5.10 Account preferences

...

 

...

 

T6. Someone else's personal space

...

Feature

...

Tester

...

Issues

...

OS/Browser

...

Notes

...

T6.1 User contacts

...

 

...

 

...

T6.2 User library

...

 

...

 

...

T6.3 User profile

...

 

...

 

...

T6.4 User memberships

...

 

...

 

T7. Content and Media

...

Feature

...

Tester

...

Issues

...

OS/Browser

...

Notes

...

Create template and add/remove items

...

 

...

 

...

B. Test drag and drop re-ordering

...

 

...

 

C. Test drop-down menu re-ordering |
| |
| |

...

T7.4 Share content overlay

...

 

...

 

...

T7.5 Content profile
(comments, related content, content metadata)

...

 

...

 

...

T7.6 File previews

...

KERN-2325

...

Currently cannot be tested due to blocker bug

...

T7.7 File permissions

...

 

...

 

...

T7.8 Delete content

...

 

...

 

...

T7.9 Upload a new version

...

 

...

 

...

T7.10 Revision History

...

 

...

 

...

T7.11 Link previews

...

 

...

 

...

T7.12 Sakai Documents (viewing, adding, page titles)

...

 

...

 

...

T 7.13 IMSCP Import

...

Kent

...

KERN-2295, KERN-2352

...

 

...

 

T8. Page Editing

...

Feature

...

Tester

...

Issues

...

OS/Browser

...

Notes

...

T8.1 Editor

...

 

...

 

...

T8.2 Adding widgets

...

 

...

 

...

T8.3 Discussion widget

...

KERN-2348

...

 

...

T8.4 Comments widget

...

 

...

 

...

T8.5 Google Maps widget

...

 

...

 

...

T8.6 Files and documents widget

...

 

...

 

...

T8.7 Remote content widget

...

 

...

 

...

T8.8 JISC content widget

...

 

...

 

...

 

...

T8.9 RSS feed reader widget

...

SAKIII-4312

...

 

...

 

...

T8.10 Google Gadget widget

...

 

...

 

...

 

T9. Networks related

...

Feature

...

Tester

...

Issues

...

OS/Browser

...

Notes

...

T9.1 Sending a message

...

 

...

 

...

T9.2 Adding to contacts

...

 

...

 

T10. Worlds

All of the functional testing features are listed in the Google workbook named TQ 1.4 Release - Test Plan*.  Each worksheet identifies a feature to test and contains one more sets of tasks as described below. Click on a feature's link to view test conditions for each step.

  • Instructions - Instructions for completing the test plan and preliminary steps that are necessary to complete before testing features in the test plan.
  • Create Items - Test scripts that focus on creating, modifying and removing items.  These are the questions or statements which the evaluator responds to.
  • Create Templates - Templates store items in a layout and are used to create evaluations.  This page contains test scripts for creating and editing templates.
  • Create Evaluations - Test scripts that focus on authoring assessments. The conditions will focus on creating new and updating previously creating evaluations.

Sign Up and Log Issues/Comments

Feature

Tester

Issues

OS/Browser

Notes



T10.1 Selecting a template

 





 



 

T10.2 Creating a world


 





 





 





T10.3 Viewing a world

 





 

 

T10.4 Editing world pages

 

 

 

T10.5 Adding/removing areas

 

 

 

T10.6 Area permissions

 

 

 

T10.7 World settings

 

 

 

T10.8 Adding/removing participants

 

SAKIII-4278SAKIII-4302

 

Cannot currently be tested due to SAKIII-4278

T11. Other

...

Feature

...

Tester

...

Issues

...

OS/Browser

...

Notes

...

T11.1 Acknowledgments page

...

 

...

 

...

 

...

 

...

T11.2 Emails

...

SAKIII-4304

...

 

...

 

T12. Hybrid

Feature

Tester

Issues

OS/Browser

Notes

T12.1 Hybrid1

 

 

 

Currently not testable on server while configurations are changed