Cookies on this website
We use cookies to ensure that we give you the best experience on our website. If you click 'Continue' we'll assume that you are happy to receive all cookies and you won't see this message again. Click 'Find out more' for information on how to change your cookie settings.

Blog by Piero Olliaro, Professor of Poverty-Related Infectious Diseases and ISARIC Director of Science, following the publication - and retraction - of scientific articles about the risks of treating COVID-19 with (hydroxy)chloroquine. This calls for the reflection on how decisions are made, how the underlying ‘evidence’ is generated and disseminated, and how exposed and vulnerable to manipulation the system we rely upon is.

A recent article on the risks of treating COVID-19 with (hydroxy)chloroquine and a related article on cardiovascular risk and COVID-19 had a snowball effect involving the scientific community, the media (TheScientist, The Guardian and ScienceMag), and regulators.

Whether we trust or doubt these papers, the case calls for us to reflect on how (public health) decisions are made, how the underlying ‘evidence’ is generated and disseminated, and how exposed and vulnerable to manipulation the system we rely upon is.

The process revolves around three fundamental steps:

  • how information is obtained, analysed and interpreted, and by whom;
  • how it is communicated and shared;
  • how it is used –what does one do with it.

When any of these building blocks of evidence-based policy making falters, the whole process risks collapsing, including people’s trust in science and policy making. For the process to arrive at the best possible decisions and be trustworthy, it requires singular public-health purpose and transparency and accountability at each step.

As the hydroxychloroquine example illustrates, we have an increasingly opaque system of data generation and ownership. In this case, a for-profit organization enters into agreements with “governments, countries and [ostensibly public and private] hospitals” – through which the latter give away information about their citizens and patients on exclusive and secretive terms, as raw material for business. At the same time, the for-profit organization has agreements with highly-respected academia for analysis and publication – raising the question as to whether they were fully informed of the underlying third-party agreements, and knowingly and unreservedly signed off on their duty of transparency and integrity.

We also have very influential publishers, which carry a lot of weight and are expected to be guarantors of the robustness of the presented evidence, but which tolerate or fail to see fallacies and shortcomings in the material submitted, and forego their own very commitment to transparency and data sharing (see also). Public scrutiny proved way more efficient in pinpointing deficiencies in the publications that were missed by the journals’ peer-review system. With mounting pressure, some authors have now withdrawn, and journals retracted the papers (see also).

All this occurs within a profit-driven, extractive business model that monetizes medical information and academic research, which has long been condoned and is here being exposed. Publishers of scientific journals are fundamentally themselves money-generating enterprises, often owned by large corporations, driven by the need to be market leaders. Increasingly, also academia is subjected to commercial pressures. COVID-19 is just amplifying these anomalies. It is absolutely critical to question the legitimacy of such a system, where vital evidence to inform decisions about our health is controlled by opaque alliances between data users and providers: data-mining companies, publishers, hospitals and researchers.  

And finally we have the international and country policy makers and regulators (the World Health Organization and national ministries of health and regulatory agencies) under close scrutiny and immense societal and political pressure, which, without close examination of the facts, are swayed by conflicting information to first halting (the lowest-risk option) and then within days reopening enrolment into trials. They will now be compelled by hard evidence to stop (hydroxy)chloroquine treatment arms altogether. 

Public health decision making has direct impact on people’s lives, including the difference between life and death. It deserves the utmost level of scrutiny, transparency and accountability in terms of methodology and potential conflicts of interest. The secrecy and lack of verifiability associated with commercial data-mining business models, and the commercialization of medical information more broadly, are incompatible with those principles.

Alternatives exist, and prove to work. ISARIC (the International Severe Acute Respiratory and Emerging Infection Consortium) collects, analyses and reports on clinical information of hospitalized COVID-19 cases. Currently this has ~67,000 individual patient’s data from 407 sites across 37 countries; contributors sign terms of submission which stipulate what we can and cannot do with the data; the data belong to the contributing institutions which act on behalf of their patients; analyses are agreed upon with contributors, and all contributors are acknowledged in the reports; all this is publicly available; we are now moving towards terms of submission whereby contributors may agree to have their primary data made available for third-party use and analyses through data access terms and conditions. All that is done in full transparency, through voluntary contributions in the public interest and without financial transactions – as one should expect to be the case for public health.


Blog by Piero Olliaro, Professor of Poverty-Related Infectious Diseases and Director of Science, ISARIC Global Support Centre (International Severe Acute Respiratory and emerging Infection Consortium)
Centre for Tropical Medicine and Global Health, University of Oxford, Old Road Campus, Roosevelt Drive, Oxford OX3 7BN, UK

Competing interests: I am Director of Science of ISARIC (the International Severe Acute Respiratory and Emerging Infection Consortium) Global Support Centre, hosted by the Centre for tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford. I am also one of the signatories of the open letter to the Lancet, and an investigator of a trial of prevention of COVID-19 infection with (hydroxy)chloroquine.

Similar stories

Risks of serious adverse events following treatment for visceral leishmaniasis

OCGHR Publication Research

This large-scale systematic review and meta-analysis aimed to collate all reported serious adverse events in visceral leishmaniasis clinical trials and quantify the incidence of mortality during the first 30 days of therapy. The analyses, which included clinical data from more than 35,000 patients, found that mortality following treatment was an extremely rare event and serious adverse events following treatments were poorly reported.

The RECOVERY Trial: One year on

OCGHR Research

The Randomised Evaluation of COVid-19 thERapY (RECOVERY) trial was officially launched on 23 March 2020. It is the world's largest COVID-19 drug trial. Thanks to the ground-breaking work of RECOVERY, clinicians treating patients hospitalised with severe COVID-19 now have two treatments that are known to improve survival.

Researchers call for access to Ivermectin for young children

OCGHR Publication Research

Millions of children weighing less than 15kg are currently denied access to Ivermectin treatment due to insufficient safety data being available to support a change to the current label indication. The WorldWide Antimalarial Resistance Network’s new meta-analysis provides evidence that supports removing this barrier and improving treatment equity.

Gender imbalance in visceral leishmaniasis clinical trials

OCGHR Publication Research

Researchers have found that despite an ongoing trend for a decreasing proportion of males being enrolled in antileishmanial therapeutic efficacy trials over time, there are still 1.8 times as many males as females involved in clinical trials. A new systematic review and meta-analysis suggests that existing knowledge on drug efficacy is derived from a study population that is heavily skewed towards adult males. At the same time, substantially less is known about the optimal treatment response in female patients.

New report highlights growing concern of vaccine falsification


The Medicine Quality Research Group has published a new Medical Product Quality Report focussing on increasing issues around substandard and falsified (SF) COVID-19 vaccines. With the implementation of the key innovations of COVID-19 vaccines, there have been growing numbers of reports of SF vaccines in the public domain. Given the vital role they will play in ending the pandemic and protecting the global population but severe issues with equitable access, SF vaccines are highly likely to be a growing problem.

RECOVERY trial closes recruitment to colchicine treatment for patients hospitalised with COVID-19

OCGHR Research

Established to test a range of potential treatments for COVID-19, the RECOVERY trial has included a comparison of colchicine, an anti-inflammatory drug that is commonly used to treat gout, vs. usual care alone. There has been no convincing evidence of the effect of colchicine on clinical outcomes in patients admitted to hospital with COVID-19, and recruitment to the colchicine arm of the RECOVERY trial has now closed. Recruitment to all other treatment arms – aspirin, baricitinib, Regeneron’s antibody cocktail, and dimethyl fumarate – continues as planned.