"I don't think that is necessary to be effective. I believe that it can be used to put summary scores (M/SD) onto a single metric as well, but I would also like to hear any other members weigh in before endorsing that as an official…"
Great question! It's a big problem, because there is never agreement on a single best standard measure for any construct in behavioral science. I think you may be helped by converting all the scores from across studies that use…"
"As long as both types of studies use the same two-group design, my understanding is that you could combine them. It sounds like you anticipate heterogeneity of effect size from this a priori so random effects assumptions would be indicated and…"
I would like to open a discussion on the calculation and reporting of interrater reliabilty. First, what degree of importance is currently placed on this facet of meta-analysis in the peer-reviewed literature? Is there a gold standard for calculating, or do all commonly employed methods enjoy equal regard? How are these typically reported in the literature: to present a reliability score on every coded characteristic seems far too cumbersome, yet to generalize across codes risks obscuring…See More