{"id":2518,"date":"2016-03-01T00:00:00","date_gmt":"2016-03-01T08:00:00","guid":{"rendered":"https:\/\/carnegie25live.wpenginepowered.com\/?p=2518"},"modified":"2025-12-17T02:18:41","modified_gmt":"2025-12-17T10:18:41","slug":"do-randomized-controlled-trials-meet-the-gold-standard","status":"publish","type":"post","link":"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/","title":{"rendered":"Do Randomized Controlled Trials Meet the \u2018Gold Standard\u2019?"},"content":{"rendered":"
\n
\n\n
\"\"<\/figure>\n\n\n\n
<\/div>
<\/div>
<\/div><\/div>\n\n\n
\n\n

Purchase<\/a><\/p>\n\n<\/div>\n\n\n

<\/div>
<\/div>
<\/div><\/div>\n\n\n\n

March 2016 | Written by\u00a0In Memoriam: Marshall \u201cMike\u201d Smith<\/a>, Alan Ginsburg\u00a0| Published by American Enterprise Institute<\/h2>\n\n\n\n

A Study of the Usefulness of RCTs in the What Works Clearinghouse<\/h2>\n\n\n\n

The What Works Clearinghouse, which identifies studies that provide credible and reliable evidence of intervention effectiveness, gives its highest rating of confidence only to randomized controlled trials (RCTs). But is an RCT the best way to provide useful information to consumers about complex interventions like curricula?<\/p>\n\n\n\n

In this American Enterprise Institute report, Alan Ginsburg and Carnegie Foundation Senior Fellow Marshall (Mike) Smith analyze 27 RCT mathematics curriculum studies contained in the What Works Clearinghouse, and they find serious threats to the usefulness of all 27. They suggest a more nuanced approach to evaluating curricula that is more timely and takes into consideration the complex context in which curricula are implemented.<\/p>\n\n\n\n

Download the Appendix (XLS)<\/a>.<\/p>\n\n<\/div>\n<\/div>\n\n\n

<\/div>
<\/div>
<\/div><\/div>\n\n\n
\n\n
<\/div>
<\/div>
<\/div><\/div>\n\n\n
\n\n

You Might Like<\/h2>\n\n\n
\n
\n\n
\n
<\/a>\n
\n
\"\"<\/figure>\n<\/div>\n\n
\n

Carnegie Foundation and ETS Release Skills Progressions for Collaboration, Communication and Critical Thinking\u00a0<\/h2>\n\n

Read more<\/a><\/p>\n<\/div>\n<\/div><\/div>\n<\/div>\n\n<\/div><\/div>\n\n

\n\n
\n
<\/a>\n
\n
\"\"<\/figure>\n<\/div>\n\n
\n

Rising Demand for Career Education Prompts College Board to Expand Its Footprint<\/h2>\n\n

Read more<\/a><\/p>\n<\/div>\n<\/div><\/div>\n<\/div>\n\n<\/div><\/div>\n\n

\n\n
\n
<\/a>\n
\n
\"\"<\/figure>\n<\/div>\n\n
\n

Opportunity Colleges and Universities Series: University of Illinois Chicago Profile<\/h2>\n\n

Read more<\/a><\/p>\n<\/div>\n<\/div><\/div>\n<\/div>\n\n<\/div><\/div>\n\n

\n\n
\n
<\/a>\n
\n
\"\"<\/figure>\n<\/div>\n\n
\n

Podcast: The Next 50 Years of Higher Ed \u2013 What Leaders Need to Know<\/h2>\n\n

Read more<\/a><\/p>\n<\/div>\n<\/div><\/div>\n<\/div>\n\n<\/div><\/div>\n<\/div>\n<\/div>\n\n\n

<\/div>
<\/div>
<\/div><\/div>\n\n<\/div>","protected":false},"excerpt":{"rendered":"

Purchase March 2016 | Written by\u00a0In Memoriam: Marshall \u201cMike\u201d Smith, Alan Ginsburg\u00a0| Published by American Enterprise Institute A Study of … Read more<\/a><\/p>\n","protected":false},"author":3,"featured_media":2519,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"ghostkit_customizer_options":"","ghostkit_custom_css":"","ghostkit_custom_js_head":"","ghostkit_custom_js_foot":"","ghostkit_typography":"","footnotes":""},"categories":[13],"tags":[],"client_controls":[],"class_list":["post-2518","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-recommended-readings"],"acf":[],"yoast_head":"\nDo Randomized Controlled Trials Meet the \u2018Gold Standard\u2019? - Carnegie Foundation for the Advancement of Teaching<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Do Randomized Controlled Trials Meet the \u2018Gold Standard\u2019? - Carnegie Foundation for the Advancement of Teaching\" \/>\n<meta property=\"og:description\" content=\"Purchase March 2016 | Written by\u00a0In Memoriam: Marshall \u201cMike\u201d Smith, Alan Ginsburg\u00a0| Published by American Enterprise Institute A Study of ... Read more\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/\" \/>\n<meta property=\"og:site_name\" content=\"Carnegie Foundation for the Advancement of Teaching\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/carnegie.foundation\/\" \/>\n<meta property=\"article:published_time\" content=\"2016-03-01T08:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-12-17T10:18:41+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.carnegiefoundation.org\/wp-content\/uploads\/2025\/12\/rct-263x350-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"263\" \/>\n\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"DCTeamMember\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@CarnegieFdn\" \/>\n<meta name=\"twitter:site\" content=\"@CarnegieFdn\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"DCTeamMember\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/\"},\"author\":{\"name\":\"DCTeamMember\",\"@id\":\"https:\/\/www.carnegiefoundation.org\/#\/schema\/person\/786b3dfd6e33675205fc8c0c7265ac97\"},\"headline\":\"Do Randomized Controlled Trials Meet the \u2018Gold Standard\u2019?\",\"datePublished\":\"2016-03-01T08:00:00+00:00\",\"dateModified\":\"2025-12-17T10:18:41+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/\"},\"wordCount\":149,\"publisher\":{\"@id\":\"https:\/\/www.carnegiefoundation.org\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.carnegiefoundation.org\/wp-content\/uploads\/2025\/12\/rct-263x350-1.png\",\"articleSection\":[\"Recommended Readings\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/\",\"url\":\"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/\",\"name\":\"Do Randomized Controlled Trials Meet the \u2018Gold Standard\u2019? - Carnegie Foundation for the Advancement of Teaching\",\"isPartOf\":{\"@id\":\"https:\/\/www.carnegiefoundation.org\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.carnegiefoundation.org\/wp-content\/uploads\/2025\/12\/rct-263x350-1.png\",\"datePublished\":\"2016-03-01T08:00:00+00:00\",\"dateModified\":\"2025-12-17T10:18:41+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/#primaryimage\",\"url\":\"https:\/\/www.carnegiefoundation.org\/wp-content\/uploads\/2025\/12\/rct-263x350-1.png\",\"contentUrl\":\"https:\/\/www.carnegiefoundation.org\/wp-content\/uploads\/2025\/12\/rct-263x350-1.png\",\"width\":263,\"height\":350},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.carnegiefoundation.org\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Do Randomized Controlled Trials Meet the \u2018Gold Standard\u2019?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.carnegiefoundation.org\/#website\",\"url\":\"https:\/\/www.carnegiefoundation.org\/\",\"name\":\"Carnegie Foundation for the Advancement of Teaching\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.carnegiefoundation.org\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.carnegiefoundation.org\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.carnegiefoundation.org\/#organization\",\"name\":\"Carnegie Foundation for the Advancement of Teaching\",\"url\":\"https:\/\/www.carnegiefoundation.org\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.carnegiefoundation.org\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.carnegiefoundation.org\/wp-content\/uploads\/2025\/12\/Logo-Edit-MC.svg\",\"contentUrl\":\"https:\/\/www.carnegiefoundation.org\/wp-content\/uploads\/2025\/12\/Logo-Edit-MC.svg\",\"width\":249,\"height\":46,\"caption\":\"Carnegie Foundation for the Advancement of Teaching\"},\"image\":{\"@id\":\"https:\/\/www.carnegiefoundation.org\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/carnegie.foundation\/\",\"https:\/\/x.com\/CarnegieFdn\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.carnegiefoundation.org\/#\/schema\/person\/786b3dfd6e33675205fc8c0c7265ac97\",\"name\":\"DCTeamMember\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.carnegiefoundation.org\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d08ce85f35a162321f61ed6a0119f1614b1ff9d50ca535d4dc58e85430ae60d6?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d08ce85f35a162321f61ed6a0119f1614b1ff9d50ca535d4dc58e85430ae60d6?s=96&d=mm&r=g\",\"caption\":\"DCTeamMember\"},\"url\":\"https:\/\/www.carnegiefoundation.org\/author\/dcteammember\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Do Randomized Controlled Trials Meet the \u2018Gold Standard\u2019? - Carnegie Foundation for the Advancement of Teaching","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/","og_locale":"en_US","og_type":"article","og_title":"Do Randomized Controlled Trials Meet the \u2018Gold Standard\u2019? - Carnegie Foundation for the Advancement of Teaching","og_description":"Purchase March 2016 | Written by\u00a0In Memoriam: Marshall \u201cMike\u201d Smith, Alan Ginsburg\u00a0| Published by American Enterprise Institute A Study of ... Read more","og_url":"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/","og_site_name":"Carnegie Foundation for the Advancement of Teaching","article_publisher":"https:\/\/www.facebook.com\/carnegie.foundation\/","article_published_time":"2016-03-01T08:00:00+00:00","article_modified_time":"2025-12-17T10:18:41+00:00","og_image":[{"width":263,"height":350,"url":"https:\/\/www.carnegiefoundation.org\/wp-content\/uploads\/2025\/12\/rct-263x350-1.png","type":"image\/png"}],"author":"DCTeamMember","twitter_card":"summary_large_image","twitter_creator":"@CarnegieFdn","twitter_site":"@CarnegieFdn","twitter_misc":{"Written by":"DCTeamMember","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/#article","isPartOf":{"@id":"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/"},"author":{"name":"DCTeamMember","@id":"https:\/\/www.carnegiefoundation.org\/#\/schema\/person\/786b3dfd6e33675205fc8c0c7265ac97"},"headline":"Do Randomized Controlled Trials Meet the \u2018Gold Standard\u2019?","datePublished":"2016-03-01T08:00:00+00:00","dateModified":"2025-12-17T10:18:41+00:00","mainEntityOfPage":{"@id":"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/"},"wordCount":149,"publisher":{"@id":"https:\/\/www.carnegiefoundation.org\/#organization"},"image":{"@id":"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/#primaryimage"},"thumbnailUrl":"https:\/\/www.carnegiefoundation.org\/wp-content\/uploads\/2025\/12\/rct-263x350-1.png","articleSection":["Recommended Readings"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/","url":"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/","name":"Do Randomized Controlled Trials Meet the \u2018Gold Standard\u2019? - Carnegie Foundation for the Advancement of Teaching","isPartOf":{"@id":"https:\/\/www.carnegiefoundation.org\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/#primaryimage"},"image":{"@id":"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/#primaryimage"},"thumbnailUrl":"https:\/\/www.carnegiefoundation.org\/wp-content\/uploads\/2025\/12\/rct-263x350-1.png","datePublished":"2016-03-01T08:00:00+00:00","dateModified":"2025-12-17T10:18:41+00:00","breadcrumb":{"@id":"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/#primaryimage","url":"https:\/\/www.carnegiefoundation.org\/wp-content\/uploads\/2025\/12\/rct-263x350-1.png","contentUrl":"https:\/\/www.carnegiefoundation.org\/wp-content\/uploads\/2025\/12\/rct-263x350-1.png","width":263,"height":350},{"@type":"BreadcrumbList","@id":"https:\/\/www.carnegiefoundation.org\/do-randomized-controlled-trials-meet-the-gold-standard\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.carnegiefoundation.org\/"},{"@type":"ListItem","position":2,"name":"Do Randomized Controlled Trials Meet the \u2018Gold Standard\u2019?"}]},{"@type":"WebSite","@id":"https:\/\/www.carnegiefoundation.org\/#website","url":"https:\/\/www.carnegiefoundation.org\/","name":"Carnegie Foundation for the Advancement of Teaching","description":"","publisher":{"@id":"https:\/\/www.carnegiefoundation.org\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.carnegiefoundation.org\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.carnegiefoundation.org\/#organization","name":"Carnegie Foundation for the Advancement of Teaching","url":"https:\/\/www.carnegiefoundation.org\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.carnegiefoundation.org\/#\/schema\/logo\/image\/","url":"https:\/\/www.carnegiefoundation.org\/wp-content\/uploads\/2025\/12\/Logo-Edit-MC.svg","contentUrl":"https:\/\/www.carnegiefoundation.org\/wp-content\/uploads\/2025\/12\/Logo-Edit-MC.svg","width":249,"height":46,"caption":"Carnegie Foundation for the Advancement of Teaching"},"image":{"@id":"https:\/\/www.carnegiefoundation.org\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/carnegie.foundation\/","https:\/\/x.com\/CarnegieFdn"]},{"@type":"Person","@id":"https:\/\/www.carnegiefoundation.org\/#\/schema\/person\/786b3dfd6e33675205fc8c0c7265ac97","name":"DCTeamMember","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.carnegiefoundation.org\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/d08ce85f35a162321f61ed6a0119f1614b1ff9d50ca535d4dc58e85430ae60d6?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d08ce85f35a162321f61ed6a0119f1614b1ff9d50ca535d4dc58e85430ae60d6?s=96&d=mm&r=g","caption":"DCTeamMember"},"url":"https:\/\/www.carnegiefoundation.org\/author\/dcteammember\/"}]}},"_links":{"self":[{"href":"https:\/\/www.carnegiefoundation.org\/wp-json\/wp\/v2\/posts\/2518","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.carnegiefoundation.org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.carnegiefoundation.org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.carnegiefoundation.org\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.carnegiefoundation.org\/wp-json\/wp\/v2\/comments?post=2518"}],"version-history":[{"count":0,"href":"https:\/\/www.carnegiefoundation.org\/wp-json\/wp\/v2\/posts\/2518\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.carnegiefoundation.org\/wp-json\/wp\/v2\/media\/2519"}],"wp:attachment":[{"href":"https:\/\/www.carnegiefoundation.org\/wp-json\/wp\/v2\/media?parent=2518"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.carnegiefoundation.org\/wp-json\/wp\/v2\/categories?post=2518"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.carnegiefoundation.org\/wp-json\/wp\/v2\/tags?post=2518"},{"taxonomy":"client_controls","embeddable":true,"href":"https:\/\/www.carnegiefoundation.org\/wp-json\/wp\/v2\/client_controls?post=2518"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}