Evaluation Plans are for gathering feedback for your submitted sessions by outside evaluators (i.e. committees) using a rating/grading scale.
Create Evaluation Plans
Within the Sessions module, select "Evaluation" > "Evaluation Plans"
To create a plan click the orange "Add Plan" button to the right of the page.
Within the pop-up window, you will edit five areas:
Configuration
Name: Evaluation Plan Name. This plan name will be visible to your evaluators.
Instructions: Instructions can include rich text/HTML formatting such as bulleted lists, bold text, and hyperlinks.
Set the plan as open once it has been created: If enabled, you can establish a due date. If this remains disabled/closed, you can open the plan after it has been created and establish a due date.
Enable Anonymized Review: All speaker details will be removed from submissions. Evaluators will only be able to review and grade submissions based on session data received.
Enable Weekly Reminders: Send an email to evaluators when there are sessions to review in their plan. Send frequency is weekly on Mondays and 1 day before the due date.
Include Uploaded Content: If you have enabled "Content Upload", then any content that was submitted by the speaker(s) will be included in the evaluation plan.
Evaluators
For evaluators to be added to an evaluation plan, they must first be added as an Evaluator or Evaluator Session Manager to the event.
Use Tags to easily view segmented users and assign them to your plans.👉🏾 Learn how to create tags & assign tags to users.
NOTE: An evaluation plan must be closed to add OR remove users from the plan.
Grading Options
Rating Icon: Rating values can be adjusted between a scale of 2-5 (The heart and star icons can increase to a scale of 20).
NOTE: Rating icons CAN NOT be edited once the evaluation plan is open.
Enable Rubric: The character count for each criterion may not exceed 255 characters.
NOTE: Rubrics CAN NOT be edited once the evaluation plan is open.
Enable Feedback: Sessionboard is limited to up to two feedback boxes. These can be used to collect additional feedback from your evaluators or ask open-ended questions.
Display Fields: Choose the session and speakers fields that should be visible to evaluators when grading submissions.
Session Filters
You can filter your evaluation plan by levels, languages, tracks, tags, format, and status.
Evaluator View
Below, is the view that your evaluators will see when they log into Sessionboard.
An abstain option is now provided so evaluators can choose not to rate sessions where they have a conflict of interest. These sessions will be marked as complete in the evaluation plan but excluded from rating calculations.
Learn more about the evaluator view within Sessionboard.
Open Evaluation Plans
If you have chosen to keep the evaluation plan closed during setup, you can open it at a later day by clicking the three ellipse dots to the right of the evaluation plan and selecting "Open".
Opening the plan gives your evaluators access to start grading the submissions. Closed evaluation plans show the submissions in a 'view only' mode.
You will be prompted with two options:
Open and notify evaluators
Evaluators will receive the below email once this button is selected.
Open and do not send notifications: If you select this option, you will be required to notify your evaluators that they can begin completing their evaluations.
Additional Actions:
Export Evaluation Plans: Event admins can export detailed information from graded evaluation plans.
Choose which version you want to export:Individual Grades Report - This provides a breakdown of session grading by the evaluator, including their comments and criteria rankings with weighted scores
Cumulative Grades Report - This provides a summarized view of grades per session, including data from the session submission and session owner information.
Delete Evaluation Plans: Deleting an evaluation plan removes the plan completely from the admin user as well as the evaluators assigned. Deleted plans can not be recovered.
Duplicate Evaluation Plans: Duplicating an evaluation plan will create a copy of the plan you duplicated. All plan settings (i.e. name, instructions, evaluators assigned, rubric, rating icons, and filters) will be cloned with the ability to edit them before the cloned plan is saved.
Notify New Evaluators To Grade Submissions: Choose to either send an invitation email to all evaluators or newly assigned evaluators informing them that they can log into Sessionboard and grade submissions.
👉🏾NEXT STEPS: Notify Accepted & Declined Sessions
Once you have received feedback from your evaluators on sessions, you can update the submission status and send an email notifying the submission speakers.