Specification of Project Design, Evaluation Design, and Evaluative Research Questions for Educational Technologies
AbstractThis presentation is a work-in-progress report about a multi-year research and development project, funded by the U.S. National Science Foundation, on improved models of evaluation and research for educational technologies. The premise is that the evaluation of educational technology in education is hampered by oversimplified, underspecified models of the project designs and evaluations. Important aspects of the project designs are often left out of the evaluation designs, or the relationships between project components are misrepresented in the evaluation designs. These problems could be solved, at least in part, by applying basic causal modeling ideas from data analytic techniques like path analysis and structural equation modeling. The presentation will cover the rationale for the current study, brief examples of work we have done over the past few years, and preliminary findings from the first projects we have reviewed.