Project overview
This project reviewed the Inspire Maths evaluation with a view to providing a judgement on the quality and robustness of the work undertaken and the overall strength of evidence. We looked at the full process of evaluation, including measures and instruments used, sampling, data collection processes, statistical analysis and reporting, using a three-part quality framework to judge each element of the report. This consists of three elements:
1. Methodological Transparency – clear information provided about all aspects of the study
2. Methodological Congruence – coherence between research question(s), methodology, methods and data analysis processes.
3. Methodological robustness – rigour, reliability and robustness of the research process, instruments and analysis
Each of these three framework constituents were judged as either totally met, partially met, or not met, for each of the following elements of the evaluation: sampling method, research design, measures used, analytical strategy, and presentation of results. Overall, the evaluation was deemed rigorous and well conducted.
The overall transparency of the research is strong, and there is every reason to feel confident of the robustness of the findings. Presentation of the findings was deemed appropriate, with both strengths and weaknesses duly acknowledged. Overall, the balance of findings reported above suggests that the quality of evidence provided in the valuation was extensive.
1. Methodological Transparency – clear information provided about all aspects of the study
2. Methodological Congruence – coherence between research question(s), methodology, methods and data analysis processes.
3. Methodological robustness – rigour, reliability and robustness of the research process, instruments and analysis
Each of these three framework constituents were judged as either totally met, partially met, or not met, for each of the following elements of the evaluation: sampling method, research design, measures used, analytical strategy, and presentation of results. Overall, the evaluation was deemed rigorous and well conducted.
The overall transparency of the research is strong, and there is every reason to feel confident of the robustness of the findings. Presentation of the findings was deemed appropriate, with both strengths and weaknesses duly acknowledged. Overall, the balance of findings reported above suggests that the quality of evidence provided in the valuation was extensive.
