you're reading...
Poverty

Deceptive expositions on the virtues of randomized evaluations

Academics often try to educate the public at large, by explaining important stuff in an accessible way. This can be socially valuable. But that is not so clear if they oversimplify, or even get it wrong, in their expository zeal. Then bad ideas can get perpetuated, and have excessive influence.

For example, all of the following “expository” claims one hears about randomized control trials (RCTs) are deceptive, if not wrong:

  1. “Any difference between the treatment group and the comparison group can be confidently attributed to the treatment.”
  2. “Because it is unbiased an RCT will necessarily get you closer to the true impact than a biased observational study.”
  3. “For reliably inferring impact the best way to assign treatment status based on the things you can observe is randomly.”

My paper, “Should the randomistas (continue to) rule” gives other examples, and tries to explain, in reasonably transparent terms, why all this matters to sound development policy making.

Please tell me if you think I have oversimplified anything!

Discussion

No comments yet.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

Enter your email address to follow this blog and receive notifications of new posts by email.