TO BE EDITED BY ALEX
THE BELOW INFORMATION is framework the Baseline Survey is based on – taken from the VLF Grant Application – not be included in the final draft o the Course:
The evaluation of the online training will be both formative and summative:
- Formative evaluation is the testing of training materials during the development process in order to make improvements prior to release. This will be done during the co-design consultations, specific focus groups with community workers, rapid prototyping of the online training and piloting of the online training with Barwon Health Social Workers. Refining local referral pathways available to community workers, and adapting our service model to manage any increase in demand for our services is also an example of formative evaluation.
- Some examples of rapid prototyping are to create a minimum viable product, or to show community workers prior examples of what has already been done and then ask if it will work for them as a user. For this we can use an example of a finished product (cf: https://frontlineworkers.esafety.gov.au/mod/page/view.php?id=135 ) and facilitate some quick decision making.
- Summative evaluations test the success of learners and business results after a training product has been implemented. This will be in-built into the online training and we will survey participants after they have completed the training to inform the program and incorporate feedback going forward.
The success of the project will be measured against the following evaluative outcomes:
- Meets Audience Needs: The pilot program and resources created is meets the needs of the target audience as identified in through co-design activities
- Adoption by local stakeholders: Target audience integrates the content created into their own organisational on-boarding and/or training programs.
- Real and relevant content: Content contains real life examples relevant to the local context
- Framework for future training: Content that is created provides a foundation or framework for the development of further training modules
- Action oriented: Content created educates audiences on how to connect to legal and encourages participants to take action.
- High level of participation in pilot training – High level of engagement received from Health social work team in pilot of e-learning resources.
- Increased referrals from Barwon Health social work team – as a result of our training we receive an increase in referrals connecting vulnerable clients to legal help.
In order to assess the achievement of the identified outcomes the following evaluative tools will be used:
- Statistics from Learning Management System – number of users, number of community workers accessing content; number of downloads etc
- Survey of co-design participants – the survey will assess their input into the creation of resources, the relevance of resources and their intention for using the content online training program.
- Evaluation survey of pilot program participants – focus on assessing the effectiveness of the content created and whether or not participants are more confident to make referrals following the completion of training.
- Interviews with community workers using our resources – to assess effectiveness and capture impact on community workers (and potentially clients) achieved as a result of the training.
Review of referrals and secondary consults from Barwon Health – 3 months post participation – to track whether there is an increase following participating in training program.