What do you think?
Rate this book
Randomistas: How Radical Researchers Changed Our World
Across medicine, business and government, there’s no simpler or more powerful tool for finding out what works than a randomised experiment. Investigating everything from jails to ad campaigns, philanthropy to schools, the randomistas are building evidence and busting myths.
Randomised tests are carried out on us every by supermarkets, search engines, online dating sites and direct marketers. Political parties use randomised trials to win elections. But how do these tests work? Are there any ethical issues? And what do they reveal about our choices?
In Randomistas , Andrew Leigh tells the stories of radical researchers who overturned conventional wisdom in medicine, politics, economics, law enforcement and more. From finding the cure to scurvy to discovering what policies really improve literacy rates, randomistas have shaped life as we know it – but they often had to fight to conduct their trials and have their findings implemented.
In the tradition of Malcolm Gladwell, Randomistas is a brilliant and entertaining exploration of a hidden but vital foundation of modern life.
‘The subject of this book could hardly be more are we humble enough to admit we may be wrong, and do we care enough to learn? Randomistas is rigorous, impassioned and tremendous fun. Everyone should read it.’ —Tim Harford, author of The Undercover Economist and Fifty Things That Made The Modern Economy
‘ Randomistas is a tour de force – an engaging, passionate, how-to account of randomised experiments. After reading Leigh’s book, you’ll be baffled at the many businesses and governments yet to catch on. Fortunately, Leigh also offers a simple guide that anyone can follow. If the next generation of policymakers follows his advice – and let’s hope they do - this book will literally change the world.’ —David Halpern, head of the UK’s Behavioural Insights Team, author of Inside the Nudge Unit
‘ Randomistas takes the reader on a great journey about how data and experiments can make the world a better place, one policy at a time.’ —Dean Karlan, professor of economics at Yale
Andrew Leigh is the federal member for Fraser and the Shadow Assistant Treasurer. Before being elected in 2010, he was a professor of economics at the Australian National University. His books include Disconnected (2010), Battlers and Billionaires (2013) and The Economics of Just About Everything (2014).
Randomised tests are carried out on us every by supermarkets, search engines, online dating sites and direct marketers. Political parties use randomised trials to win elections. But how do these tests work? Are there any ethical issues? And what do they reveal about our choices?
In Randomistas , Andrew Leigh tells the stories of radical researchers who overturned conventional wisdom in medicine, politics, economics, law enforcement and more. From finding the cure to scurvy to discovering what policies really improve literacy rates, randomistas have shaped life as we know it – but they often had to fight to conduct their trials and have their findings implemented.
In the tradition of Malcolm Gladwell, Randomistas is a brilliant and entertaining exploration of a hidden but vital foundation of modern life.
‘The subject of this book could hardly be more are we humble enough to admit we may be wrong, and do we care enough to learn? Randomistas is rigorous, impassioned and tremendous fun. Everyone should read it.’ —Tim Harford, author of The Undercover Economist and Fifty Things That Made The Modern Economy
‘ Randomistas is a tour de force – an engaging, passionate, how-to account of randomised experiments. After reading Leigh’s book, you’ll be baffled at the many businesses and governments yet to catch on. Fortunately, Leigh also offers a simple guide that anyone can follow. If the next generation of policymakers follows his advice – and let’s hope they do - this book will literally change the world.’ —David Halpern, head of the UK’s Behavioural Insights Team, author of Inside the Nudge Unit
‘ Randomistas takes the reader on a great journey about how data and experiments can make the world a better place, one policy at a time.’ —Dean Karlan, professor of economics at Yale
Andrew Leigh is the federal member for Fraser and the Shadow Assistant Treasurer. Before being elected in 2010, he was a professor of economics at the Australian National University. His books include Disconnected (2010), Battlers and Billionaires (2013) and The Economics of Just About Everything (2014).
353 pages, Kindle Edition
Published March 1, 2018
37 people are currently reading
536 people want to read
About the author
Andrew Leigh
12 books48 followersAndrew Leigh is a member of the Australian Parliament. He holds a PhD from Harvard University, and is a fellow of the Academy of Social Sciences in Australia. Before being elected in 2010, he was a professor of economics at the Australian National University. His books include The Shortest History of Economics, The Luck of Politics and Randomistas.
Ratings & Reviews
Friends & Following
Create a free account to discover what your friends think of this book!
Community Reviews
Displaying 1 - 30 of 32 reviews
August 5, 2018
Randomised controlled trials are usually associated with science or clinical trials. But for a while they have been used in the field of social sciences. Something, as a scientist who has recently converted to the field of social sciences, I found intriguing.
How can you possibly conduct a randomised controlled trial in the social science field when it usually involves ensuring the people involved in the trial, including those administering the intervention, do not know whether they are getting a placebo or the actual intervention?
The answer is a variation on the process. It might not have the same rigour considered from the perspective of a science-related trial, but this can be developed to accommodate the very messy world of social science research, which has to be conducted with the types and amounts of variables which would make a science researcher lose their grasp on reason.
Andrew Leigh has tried to bring together as many examples as possible in order to provide the reader with a description of as many different experimental approaches used by researchers in social science and education-related projects as possible. Using these examples, he is also able to discuss the problems and the advantages of the process.
In many cases the more conventional social science research approach has failed to identify particular problems, whereas the randomised control trial has revealed them in all their glory and as a result made it possible for the intervention to be adjusted. In other words, a randomised control trial approach has the capacity to increase awareness of the potential ‘blind spots’ in social science research.
There is no doubt that this, like every research approach, has its flaws and Leigh’s balanced approach addresses this. But it is certainly a book that makes you think and pull yourself out of complacency when it comes to considering how to study society’s problems and change policies for the better through this new approach to social research.
Although I did receive a copy of Randomistas courtesy of Yale University Press via NetGalley, I have actually gone out and purchased the hardback version for further study.
How can you possibly conduct a randomised controlled trial in the social science field when it usually involves ensuring the people involved in the trial, including those administering the intervention, do not know whether they are getting a placebo or the actual intervention?
The answer is a variation on the process. It might not have the same rigour considered from the perspective of a science-related trial, but this can be developed to accommodate the very messy world of social science research, which has to be conducted with the types and amounts of variables which would make a science researcher lose their grasp on reason.
Andrew Leigh has tried to bring together as many examples as possible in order to provide the reader with a description of as many different experimental approaches used by researchers in social science and education-related projects as possible. Using these examples, he is also able to discuss the problems and the advantages of the process.
In many cases the more conventional social science research approach has failed to identify particular problems, whereas the randomised control trial has revealed them in all their glory and as a result made it possible for the intervention to be adjusted. In other words, a randomised control trial approach has the capacity to increase awareness of the potential ‘blind spots’ in social science research.
There is no doubt that this, like every research approach, has its flaws and Leigh’s balanced approach addresses this. But it is certainly a book that makes you think and pull yourself out of complacency when it comes to considering how to study society’s problems and change policies for the better through this new approach to social research.
Although I did receive a copy of Randomistas courtesy of Yale University Press via NetGalley, I have actually gone out and purchased the hardback version for further study.
December 20, 2018
This is a pretty good but not great introduction to the wonders of random assignment in policy evaluation. Starts with medical trials, and has a good history of the increasing use of RCTs in social science. Not sure why he felt the need to dump on lab experiments, but that seems to be a thing that happens these days. He mostly hits only the high points, recounting the papers and stories of the most prominent researchers in the area, which is also not surprising but slightly disappointing.
February 21, 2025
Overall this was a good review of RCT in almost all domains. I think this is an interesting read for both field specialists and by assers :)
February 18, 2019
I really enjoyed this and particularly liked learning more about the use of randomised trials in social contexts. The only quibble I have is that it got a bit preachy at the very end about using randomised trials and I felt that the examples used earlier were enough to get the message across.
September 26, 2020
Somewhat disappointing book that although has numerous examples of randomized control trials in practice, from education, medical, to web 2.0 operations, does not go into any functional detail on either the mathematical apparatus, or the statistical analysis/interpretation of this data. Some may counter that this is a layman book, and exorcising the author of any responsibility to put these details in his text. This is true, however, that just means that the book is effectively the knowledge equivalent of “empty calories”.
There have been many books in the mathematics and science layman nonfiction genre that also include meaningful commentary on the mechanism of the subject as well as including conceptual content, these include, “The Drunkard’s Walk”, for basic probability, “The Dance of the Photons” for Quantum Information, “Chancing It” for basic statistics, and “Through Two Doors at Once”, for the analysis of basic interferometers, and a historical survey on theories of quantum phenomena, to name just a few books I’ve read recently, so it is definitely possible to achieve both functional instruction in conceptual writing.
What this book does well is provide some historical context of RCTs, and why people, especially in the medical fields viewed it as either amoral, or with suspicion. Similarly, this skepticism has recently extended to the field of development studies and development economics, although the most recent Nobel prize in the field (2019), Abhijit Banarjee, Esther Duflo, & Michael Kremer won on work that applied experimentation, primarily via RCT to poverty/development, so perhaps that skepticism will be short lived. Likewise, two of those co-recipients have an excellent set of MOOCs on EdX on this topic, and they go into fairly decent functional detail on it’s application, which seems very worthwhile if you are coming to this book, and find yourself wanting more details on the apparatus.
Overall, I found the book somewhat forgettable, but I can’t say the content is bad, just incomplete. If there were more content dedicated to the practice of RCTs, and not just an endless series of high-level detail case-studies of it, I think this book would have been amazing. As is, it’s a easy pass for most, with a conditional recommendation for those who need some extra conceptual motivation (and historical context) on the subject of RCTs.
There have been many books in the mathematics and science layman nonfiction genre that also include meaningful commentary on the mechanism of the subject as well as including conceptual content, these include, “The Drunkard’s Walk”, for basic probability, “The Dance of the Photons” for Quantum Information, “Chancing It” for basic statistics, and “Through Two Doors at Once”, for the analysis of basic interferometers, and a historical survey on theories of quantum phenomena, to name just a few books I’ve read recently, so it is definitely possible to achieve both functional instruction in conceptual writing.
What this book does well is provide some historical context of RCTs, and why people, especially in the medical fields viewed it as either amoral, or with suspicion. Similarly, this skepticism has recently extended to the field of development studies and development economics, although the most recent Nobel prize in the field (2019), Abhijit Banarjee, Esther Duflo, & Michael Kremer won on work that applied experimentation, primarily via RCT to poverty/development, so perhaps that skepticism will be short lived. Likewise, two of those co-recipients have an excellent set of MOOCs on EdX on this topic, and they go into fairly decent functional detail on it’s application, which seems very worthwhile if you are coming to this book, and find yourself wanting more details on the apparatus.
Overall, I found the book somewhat forgettable, but I can’t say the content is bad, just incomplete. If there were more content dedicated to the practice of RCTs, and not just an endless series of high-level detail case-studies of it, I think this book would have been amazing. As is, it’s a easy pass for most, with a conditional recommendation for those who need some extra conceptual motivation (and historical context) on the subject of RCTs.
March 23, 2018
This book should be required reading for all who design and administer public policy.
July 15, 2018
Such an important book with lots of examples about the importance of randomised control trials. It shows that it’s so easy to “demonstrate” that a program works, but without a RCT, we don’t really know.
All policy makers and program funders should read this book, along with program managers who I hope will be brave enough to be committed to what works, not just what they’ve been working hard on.
All policy makers and program funders should read this book, along with program managers who I hope will be brave enough to be committed to what works, not just what they’ve been working hard on.
September 13, 2021
Terrific summary of key RCTs build into a coherent story. Biggest blind spot is that evidence for RCTs effect on policy is always observational.
October 27, 2021
3.5 rounded down. Lots of interesting examples, but sometimes it just felt like a list of examples. I really liked the parts about gun control and crime, and financial aid.
August 26, 2018
Randomistas : How radical researchers changed our world (2018) by Andrew Leigh looks at how useful randomised trials are and how their expanding use in economics and other social sciences is developing.
The book first provides a history of how randomised trials developed in medicine, with examples of scurvy treatment and the importance of surgery. Then the book looks at how randomisation has been applied in interventions for very disadvantaged people in rich countries and the how randomisation was incorporated into economic and social research.
Randomised trial use in education, crime, development studies, business and politics is also looked at. Leigh then describes how randomisation can be used by anyone reading the book, how to provide quicker feedback and the expansion of randomised trials that is part of modern economics. He also includes 12 rules for creating randomised trials.
Randomistas is a very strong non fiction economics books. Leigh writes well, has lots of well researched subject matter, knows his subject well and includes a plethora of interesting facts about randomised trials.It also includes enough stories and human interest to make it a very easy and enjoyable read. The book is very much worth reading for anyone interested in how economics and social studies is changing.
The book first provides a history of how randomised trials developed in medicine, with examples of scurvy treatment and the importance of surgery. Then the book looks at how randomisation has been applied in interventions for very disadvantaged people in rich countries and the how randomisation was incorporated into economic and social research.
Randomised trial use in education, crime, development studies, business and politics is also looked at. Leigh then describes how randomisation can be used by anyone reading the book, how to provide quicker feedback and the expansion of randomised trials that is part of modern economics. He also includes 12 rules for creating randomised trials.
Randomistas is a very strong non fiction economics books. Leigh writes well, has lots of well researched subject matter, knows his subject well and includes a plethora of interesting facts about randomised trials.It also includes enough stories and human interest to make it a very easy and enjoyable read. The book is very much worth reading for anyone interested in how economics and social studies is changing.
December 26, 2020
Andrew Leigh is an Australian economist-turned politician. This book is all about randomised controlled trials (RCTs) and why we should use them more often in making evidence-based decisions around public policy. I think the examples he provides are incredibly compelling but giving lots of examples of RCTs across different areas eg education, crime, becomes a little repetitive towards the end. The main points I retained from the book were that we should consider using RCTs in testing social policies because resources are limited and randomisation is the fairest way to allocate limited resources, at least until we have the evidence to show programs are effective. It’s nice that a politician wrote this - gives me some confidence that not all politicians are clueless - just hope that more than one have read it!
August 25, 2021
I came across this book by way of attending a talk given by the author at a statistical conference. Andrew Leigh is that rarest of birds, a university lecturer and statistical analyst who became a member of parliament. In Randomistas he talks about the strengths of random trials, and their many, many applications in science, medicine, and public policy.
The book itself is quite readable, though not particularly compelling. I read it in parallel with a number of other books, reading a chapter or two, then putting it aside to read other things.
The book itself is quite readable, though not particularly compelling. I read it in parallel with a number of other books, reading a chapter or two, then putting it aside to read other things.
February 18, 2019
A book on how to do social science and the importance of RCTs and experimentation. This book doesn't offer anything new, rather, it hammers the same, albeit important point, page after page until it's fully ingrained in your head.
This book should be a must read for all those in business or government without a background in data; sadly, I suspect those who most need this book will never read it.
This book should be a must read for all those in business or government without a background in data; sadly, I suspect those who most need this book will never read it.
March 17, 2019
Excellent. What could have been a dry subject was fascinating. The author details the use of randomised trials in different areas - health, crime, politics etc. using real-world examples. His passion for his subject shines through as he discusses the need for high quality research and decisions made based on data rather than emotion, opinion or politics. A fascinating look at the mechanics of scientific endeavour through experiments based on randomly selected treatment and control groups.
July 27, 2020
Good overview for the non-expert
While I am not personally an expert on randomised controlled trials (RCTs), I am familiar with the methodology. This book provides a really nice review of the history of RCTs. While it is clear the author is a fan of RCTs, the book gives a relatively balanced look at the benefits and downsides of using a RCT methodology for program evaluation. A really good book for policymakers and others interested in learning about RCTs.
While I am not personally an expert on randomised controlled trials (RCTs), I am familiar with the methodology. This book provides a really nice review of the history of RCTs. While it is clear the author is a fan of RCTs, the book gives a relatively balanced look at the benefits and downsides of using a RCT methodology for program evaluation. A really good book for policymakers and others interested in learning about RCTs.
March 4, 2023
Clearly written and comprehensible, it’s engaging enough that I’d think most would enjoy this read and not just policy wonks like me. I would have liked more depth into the design of experiments and trials mentioned, and not just the highlights and key finding of each. It was a great context setter, but I’m not sure what I learnt from it - a little bit of preaching to the converted with me reading this.
September 8, 2018
A great read; however, I think that the author disproves his title as the book progresses.
The researchers can no longer be 'radical' where random testing becomes normative. To read, for instance, that Google, Amazon and Facebook are constantly doing random trials indicates that random testing is a fundamental proposition of such organisation's business processes.
The researchers can no longer be 'radical' where random testing becomes normative. To read, for instance, that Google, Amazon and Facebook are constantly doing random trials indicates that random testing is a fundamental proposition of such organisation's business processes.
August 28, 2022
A book in praise of random controlled trials in all sorts of places and circumstances.
There is nothing wrong with the book; I just felt like I had heard it all before and there was nothing new or interesting added.
There is nothing wrong with the book; I just felt like I had heard it all before and there was nothing new or interesting added.
March 20, 2018
An informative, easy to read book, great for gaps between classes and on the train/tram. Thanks Andrew :)
March 30, 2018
An easy read on random trials and the importance of objective evidence. This book highlights how wrong we can be and how to make better decisions.
July 19, 2018
Nothing wrong with the idea, but hardly worth a whole book.
March 1, 2019
Terrific book and his best written to date full of excellent anecdotes and stories
September 2, 2020
An overview of how randomized controlled trials have revolutionized many fields, with examples from medicine, public policy, policing and many others.
Well written, and with a fairly wide scope.
Well written, and with a fairly wide scope.
January 4, 2021
Fascinating reading that has given me a lot to think about, especially the idea that it might be more unethical to not do a randomised trial than to do one.
March 3, 2021
A good overview - doesn't go into much depth, but a great introduction or launching pad for anyone seeing to learn more about these ideas!
May 24, 2021
My only critique is that it's a bit forgettable
January 25, 2024
This felt like a very fast and easy read - I found it a totally fascinating collection of anecdotes and relevant facts about medicine, development and education
May 5, 2023
If you’ve never taken a research class and want to know why randomized studies are important this book is for you! If you are in your masters degree and have done many a research course/project/paper etc then this book is purely a recap and also kind of boring…
February 5, 2023
3 star. I’m not quite sure who the target audience is for this book. It covers a lot of different areas of research & broadly what RCTs observe in various fields (…data is also included from non-RCT studies and it makes me question some of their data vs points they’re trying to make)- so general public might find it interesting, but probably not that exciting and researchers should already the methods covered….
November 17, 2019
Save yourself some time and just write the phrase "Randomized trials" on a chalkboard 1000 times.
Displaying 1 - 30 of 32 reviews