This guide includes information on:

• Overview
• Key points to note
• Creating Assessment Forms and Questions
  • Assessment forms
  • Add Question Groups
  • Adding questions
    • Question Bank
  • Adding Questions to the Form
    • Examples:
• Adding a Form to a Job
• Candidate queries: resetting Groups of Tests and Special Adjustments
  • Resetting Groups of Tests
  • Special Adjustments
• Reviewing answers and reporting
  • Candidate record
  • Reporting

Overview

Grouped Scored & Timed Assessment Forms are used to create candidate tests that are attached to application forms as part of the online application form process (as opposed to following at a later stage).

These can be automatically scored and time limits set for candidates to answer the questions.

Key points to note

• There is no limit on the number of questions per group, or groups per form
• Only one form can be attached per role, so if you wish to put candidates through multiple tests, these tests will typically take the form of groups
• This feature is only available in standard (1st) stage application currently.  It is not possible to use this feature in 2nd stage application
• 
  
• Time limits can be set up to each group, but not in forms or questions. Again, this fits with groups equating to tests
• Additional time can be granted to candidates who require special adjustments. In both cases time limits are optional
• Each group can include its own introductory text and image, and each question have its own text and image. Images should be JPG/PNG format
• The range of questions and answer formats are as follows: 
  • Multi-Choice (One Answer)
  • Multi-Choice (More than one Answer)
  • Multi-Choice (One Answer in each column)
  • Multi- Choice (One Answer in each row)
• Candidates complete the assessment as part of the job application process at initial application
• For candidates, a timer is displayed on screen that counts down the remaining time
• Candidates can review and change answers to questions within a group, prior to completing the group (assuming the time limit has not been reached).
   If the time limit has been reached, or they have completed the group (a) and moved to the next group (b), they will be able to review or amend their answers to questions in that group.
• Candidates cannot amend their answers once the assessment has been completed. They're also unable to submit their application without completing the assessment first
• Client users can reset candidates’ completed groups if they wish to grant the candidate another attempt. This will wipe/overwrite any previously answered questions
• Client users can view answers and scores in a candidate’s record - both in a dedicated tab and within the history. Each time a candidate completes a question, the date and time is captured for reporting purposes as well as the duration spent on the entire assessment.
• Client users can access reports that provide answers submitted by candidates as well as their scores. These can be measured against Equality and Diversity data. The standard report suite also has two dedicated reports.

Creating Assessment Forms and Questions

Assessment forms

• Select Settings > Assessment Forms.

• Select the Grouped & Timed Forms tile, then New Timed Forms in the left menu.
• A new window will open:

• Add the form name, pass marks (if required), total score and instructions, then press Save.

Pass marks is the score a candidate must meet to be successful, whereas total score is the total amount of points that can be achieved if all questions were answered correctly.

Add Question Groups

 Complete all information in the fields that will now be displayed:

When you have completed the required information press Save in the left-hand corner of the screen.

Adding questions

Questions can be added in the Assessment form itself or within the Question Bank and then copied into the Assessment form. 

Using the New Question option within the Assessment form will not save the question to the question bank.  For those questions you intend to use regularly, create them in the Question Bank first.

Question Bank

The Question Bank is the same as it is for all assessment forms and can be found in Settings > Assessment Forms > Question Bank.

The following two matrix question types cannot be created in the question bank as they can only be used for Grouped Scored & Timed Assessments:

• Multi-Choice (One Answer in each column)
• Multi- Choice (One Answer in each row)

These would need to be created in the assessment form itself by selecting 

New Matrix Question. 

Tip: To avoid adding duplicate questions, we recommend searching the question bank before adding a new question.  The search bar within the question bank searches the question text to help you easily identify any existing questions. It’s also useful if you are updating any existing questions.

Adding Questions to the Form

The next step is to add questions. Choose from the following options:

Questions not created in the Question Bank will not be saved to there. For questions you intend to use regularly, create them in the Question Bank first. 

The Question Bank is the same as it is for all assessment forms and can be found in Settings > Assessment Forms > Question Bank. 

The following two matrix question types cannot be created in the question bank as they can only be used for Grouped Scored & Timed Assessments: 

1. Multi-Choice (One Answer in each column) 
2. Multi- Choice (One Answer in each row)

These would need to be created in the assessment form itself by selecting New Matrix Question.

 The example below is Multiple Choice Single Answer Per Column:

When setting up any of the options, the screen is the same for each - and the same as for normal assessment form questions, except for the additional option of adding an image.

• Question no= The system will automatically give your question a number in the order you create them, if creating from the assessment form itself. This number is the order the questions will be presented in.
• Question type = Select the desired question type
• Word limit = This can be left blank as it’s not applicable for scored matrix questions.
• Instruction = Here you can add in guidance for candidates
• Question Text = Add in the question you are asking the candidate.
• Maximum points = Add in the maximum points that can be achieved in answering this question.
• Possible correct answers = Add in the total number of correct answers.

Once you have added in the relevant information, press Save. 

For any Multi-choice questions, you then need to proceed to the Options tab and populate the option answers for candidates to select from. This page will vary dependent on the type of question you have added.

For non-matrix questions the Options page will display as follows:

• Option Column = Add in the wording for the answer option
• Point = Add in how many points are scored for selecting this answer
• Correct order = here you can specify the order that the answers appear in
• Correct = toggle this to yes against the correct answers

For matrix questions the Options page will display as follows:

• Option = Add in the options answers.
• In the column headers = Add in the criteria/options you are asking the candidate to select from.
• Under each column header option use the toggle to mark the correct answers and add in the score which will be given for each option.
• There is also a text box for adding in additional wording, dependent on the question type. 

Examples:

If you were creating the below verbal reasoning questions in Screenshot A, then Screenshot B illustrates how you would build this question.

Screenshot A: 

Screenshot B:

Saving and editing 

Save any additions and amendments by pressing Save.

Edit or remove groups by selecting Edit or Remove at the top of each group of questions.

Groups can be reordered by selecting Edit, changing the group number, then exit. This should only be done before the form is made live to candidates, otherwise the reporting will be affected.

To edit a question by selecting the Edit pencil adjacent to each question.

Adding a Form to a Job

1. Select Jobs then edit against the job you wish to add the form to.
2. Click on the Assessments tab and scroll to the Do you want to add Assessment Forms section.
3. Against Assessment Form – A or Assessment, select your form by either using the search as you type functionality or by clicking the spyglass icon, selecting your chosen form and pressing OK.

When the required form has been added select Save & Continue at the bottom of the page.

Candidate queries: resetting Groups of Tests and Special Adjustments

Resetting Groups of Tests

Navigate to the candidate's record and select Reset Test in the left menu.

All groups can be reset at once in the top right - or adjacent to each test a specific group can be reset.

Note: The language is test, owing to the commonality of Groups being used for tests.

Ideally you should only reset the test for incomplete candidates. However, it is possible to reset them for candidates who have completed the declaration and submitted their application. In such cases the declaration and submission will be reversed. 

If the candidate(s) subsequently re-takes the tests and submits a second time, the completion of the declaration will be counted twice in some reports or dashboards.

Special Adjustments

If a candidate highlights an impairment to taking the tests, you may wish to grant them a special adjustment.

To do so click Assess and then Special Adjustment. 

 Selecting the Special Adjustment button will display this screen:

Toggle on Special Adjustment and in the Reason field, add the details of who agreed it and why. When complete, press Save.

The candidate record will now be denoted with a red egg timer icon. The additional time (if any) set in the test will be added when the candidate begins the test(s).

Reviewing answers and reporting

Candidate record

Users can view answers and scores in a candidate’s record both in a dedicated tab, and within history.

Each time a candidate completes a question the date and time is captured for reporting purposes.

Displayed in the Assessment Tab is a summary of the groups at the top and a breakdown for each group follows below showing details of answers as well as the duration spent on the whole assessment.

Reporting

Included in the Jobtrain reporting suite are these two reports:

The Timed Assessment Report provides scores for each question by candidate ID, along with key Equal Ops data for that candidate. This can be useful for analysing diversity versus test performance.

The Timed Assessment by Group Report provides scores for each group (test) by candidate ID, along with key Equal Ops data for that candidate.

To run either report you must select an assessment form in the configuration screen.