To identify impact evaluations on the effectiveness of ICTD interventions, the authors conducted a systematic search and screening that identifed 253 studies. They present results in an evidence map that shows the amount of evidence for each of 11 intervention categories across nine development sectors and find large amounts of evidence for some intervention categories and little to no evidence in others.

Roughly 80% of the ICTD impact evaluations use randomized assignment, suggesting a relatively low risk of bias across the evidence base. At the same time, roughly 80% evaluate pilot implementations instead of programs, raising questions about how useful the evidence is for informing programs at scale. Less than 20% of studies report costs, limiting ability to assess cost effectiveness. Four recommendations are made to improve the evidence base.

Click here for full report.