What is the scientific approach?

“The function of the expert is not to be more right than other people, but to be wrong for more sophisticated reasons."David Butler

In this essay, I illustrate through the science of medicine what it means to take the scientific approach to a discipline of human inquiry. The central point I wish to make is that what we now call Science is nothing but the culmination of our base desire to ensure that our conclusions about the real world are not wrong. Or, rather, is as right as possibly can be within human limitations. In any discipline of inquiry, we have a similar desire and is, ipso facto, amenable to a scientific approach. Consequently, Science is dynamic, self-correcting and constantly improving. This essay is a small effort to show this in action with a concrete example.

An illustration through medicine

No discipline of science is plagued more by pseudoscience than medicine. Even in the realm of modern evidence-based medicine, there is still a lot of contention. Mayo clinic found that one out of five second opinions to their clinics end up with an entirely different diagnosis!

One main reason for the prevalence of pseudoscience in medicine is that our intuitive understanding of medicine is disastrously wrong. This leads to a tension between our naive perceptions and the conclusions reached by researchers after careful scrutiny. Common sense in India is that being in the cold increases the chances of catching a cold. It would be highly unusual for Indian parents to expose their child to the cold winter breeze. On the other hand, common sense in Norway is that fresh air, no matter how cold, is essential for good health! It is quite common for infants to be left outdoors to sleep even in sub-zero temperatures! These vast differences in cultural practices might have some underlying reasons but what it is can be understood only after rigorous study and analysis. On the other hand, it is also possible that some cultural differences are completely accidental and have no deeper underlying reason. Even in this case, it is only rigorous study and analysis that can give definitive answers. Failure to engage in this most fruitful endeavor has resulted in the vast number of systems of medicine. There is no such thing as a system of medicine! It is a myth perpetuated not always out of greed but most often out of failure of the practitioners of “alternative medicine” to subject their naive ideas to the razor-sharp tool of reason.

One major aim of the field of medicine is the following:

Given an illness $I$, devise an effective treatment $T$ for $I$.

Before any progress can be made, we must first understand what it means for a treatment to be effective. At this juncture, common sense and scientific rigour diverge. To most people, it is utterly obvious what effective means! If the treatment $T$ “cures” the illness $I$ then it is an effective treatment. With a little thought, we realise that this answer is nothing more than a restatement of the question! After further analysis, some might say: if there is an immediate improvement in the symptoms of the illness $I$ then treatment $T$ is an effective treatment. There are a host of problems with this answer as well. For instance, common symptoms of most illnesses are pain and fatigue. It is by no means obvious that our subjective reporting of pain and fatigue is accurate enough to determine whether the symptoms have improved. This is immediately fixed by the following suggestion: why not observe whether the treatment $T$ works after administering it for several days at which point whether it has been effective or not is apparent? Another obstacle reveals itself. Many illnesses, even dangerous ones, often go away in due course without any intervention! A classic example is Hepatitis-B which gets cured in 99% of the cases with nothing but rest. If it takes one month of treatment with the famous medication Liv-52 for Hep-B to be cured, how exactly does one determine whether the treatment had any role at all? A more pertinent question, how do we know that Liv-52 is actually effective in the 1% of cases where treatment is necessary for a cure?

Furthermore, there is the not completely understood placebo effect. The very fact that one is aware that one is being treated has a profound effect on the course of the illness. Endorphins are released in the brain when one is aware that one is being treated. In fact, the very fact that one is going to be treated results in a release of Endorphins. This has the immediate effect of relieving pain, increasing energy, etc. All this could give the impression that the treatment is very effective when in reality it is the Endorphins that are the cause of improvement. It is also possible that the placebo effect could have more profound effects. It is hopeful that one day, again through rigorous study and analysis, we might be able to properly and systematically exploit the placebo effect in conventional medicine. Nevertheless, there is substantial evidence that the placebo effect is not all-powerful. One should be very cautious of outrageous claims being made by practitioners of alternative medicine who claim organs can be regenerated and Cancer can be “canceled” through sheer will. It is highly unlikely that the placebo effect will have any significance in treating Cancer or even Malaria. Be that as it may, any “system of medicine” that fails to take into consideration the existence of the effect is bound to advocate cures that are not cures at all. Why is this a problem when the placebo effect is, after all, a positive effect? Three problems spring to mind:

  1. For any given illness, it makes sense to treat it with the absolute best treatment we have at our disposal unless there are strong reasons not do so. For many illnesses, we have treatments that are demonstrably far better than placebo.
  2. Not all medicines sold by alternative medicine practitioners are safe. For instance, many Ayurvedic medicines have been found to have dangerous concentrations of heavy metals. Apart from this, many of the most potent poisons like Hemlock are derived from herbs. As regulations for alternative medicine is a lot less restrictive than conventional medicine, what is the guarantee that a supposed harmless sugar pill does not contain some potentially dangerous drug? It is inadvisable to take a potentially dangerous treatment whose effects could be got by far safer treatments.
  3. Even for those illnesses for which conventional medicine has no answer, it is still a very good idea to subject alternative treatments available to scientific study. Why? Simply because an alternative medicine that can be demonstrated to work becomes, well, medicine! Furthermore, while many alternative treatments have tremendous testimonials in their favour, rigorous study of such treatments show very contrasting results. Take for instance the case of a nurse who performed Reiki on Cancer patients to alleviate the nausea, fatigue and pain caused due to chemotherapy. It turns out that another nurse who had no knowledge of Reiki pretending to perform Reiki had the same effect on patients! The bigger lesson is the fact that a therapeutic massage had a reportedly better effect.

What we have done in the last few paragraphs is essentially engage ourselves in the ritual of Science. Centuries of concerted efforts by thousands of scientists who asked themselves some of the very same questions and performed tens of thousands of experiments to answer them have culminated in the central tool to test effectiveness of a treatment: The double-blind, randomised, placebo-controlled trial. Here is a simplified description of a double-blind RCT. To test the effectiveness of a medicine, we split the group of patients into two sets randomly. To one set, we give the medicine. To the other, we give a placebo, a pill that contains no active ingredient. Both groups are monitored for improvements and the medicine is considered to be effective only if it is demonstrably better than placebo in the trial. Sometimes, there is a third group which is given nothing but just monitored or the third group is given the current best treatment so that a comparison can be made. What does double-blind mean? Well, both the patients as well as the researchers are unaware who gets the placebo and who gets the “real medicine”. The reason why the researchers are kept in the dark is to ensure that their biases do not influence the outcome of the experiments. Several experiments have conclusively demonstrated that a “single-blind” test is likely to be coloured by the biases of the researchers. It is an interesting exercise to devise experiments to detect such biases.

Does the existence of the method of double-blind randomised control trials mean that there is no way a better way testing effectiveness ? No! It is quite possible that a better method can emerge after accumulation of more evidence. There are several scenarios in which it is impossible to devise a double-blind, randomised, placebo-controlled trial. For example, to determine whether something like the ever-controversial coconut oil is good or bad for health. Or whether exercise a better treatment for depression than medication. Many practitioners of alternative medicine argue that the existence of such scenarios and the possibility of the emergence of better methods is a death-knell to double-blind, randomised, placebo-controlled trials. But this is needless nitpicking. The inadequacy of the current best tool does not mean that we abandon its use! In fact, we must always use the best tool available at any given point if we want to decrease our chances of being wrong. It seems to me that the alternative medicinal practitioners oppose double-blind studies because they a priori believe that their treatment works. This could be either because of the cognitive biases, the same biases the RCTs were designed to counter, or sometimes outright greed. In fact, if any alternative medicine practitioner can give a compelling argument as to how a treatment can be effective and yet fail a controlled trial then I wager that the scientific community would be quite interested in the argument. What we must guard against is dogmatism. When eventually, researchers produce a better tool and provide compelling evidence that the new tool is indeed better, we must shift our allegiance. To be a scientist is to be a slave to the twin masters of reason and empirical evidence.

The reader might get the impression that the I am completely against research into alternative medicine. Absolutely not! Rather, research into alternative medicine must adhere to the same set of standards as conventional medicine. If evidence for an alternative treatment reaches the standards required by Science then it actually becomes a medicine in the conventional sense! Many are not aware of this fact. This might prompt many to say that substantial research funding in medicine is to be diverted to Ayurveda, Siddha and Homeopathy. This is again taking an “unscientific” approach. The evidence against Homeopathy is so overwhelming that any further spending of money on it is completely unjustifiable. On the other hand, it is not productive to check each and every treatment of Ayurveda or Siddha or any other alternative medicinal system. On the database PubMed, there are already 83 papers studying the herbal preparation Liv 52 and a whopping 1105 papers studying the herb Ashwagandha! To the best of my knowledge, neither has been rigorously shown to be an effective treatment for any condition. This is all the more bizarre because Liv 52 has been consistently one of top selling medicines for decades. Himalaya, the company that manufactures it, has an annual revenue of around 2500 Crores out of which Liv 52 contributes around 300 Crores. The formulation was introduced 64 years ago and still there is no undisputed evidence that it is effective! A more scientific approach might have resulted in clearer picture. In an ideal scenario, medical researchers should sit down with the prominent alternative medicinal doctors and first substantiate the treatments that are most likely to be effective. There is no doubt tremendous scope in exploiting the huge catalogue of herbs that have been passed on for generations. But it would be asinine to waste money checking whether sugar pills can cure diabetes!

Coming to the issue of safety that was briefly discussed earlier. It is quite common for conventional medicines to be banned if some serious safety issue arises. The same standards should be applied to alternative medicines. As far as I am aware, the Ayurvedic practice of “Rakthamoksha” or bloodletting is not banned. Bloodletting is an effective treatment only for a handful of extremely rare illnesses but was used extensively in Ayurveda. This treatment has fallen out of favour but is still practiced by a few (as can been seen by a search on the Internet) and this needs to stop. In a similar vein, many Siddha treatments contain high-levels of Mercury which is dangerous. Many of the spinal manipulations that chiropractors engage could cause paralysis and sometimes even death! What is more disturbing is when chiropractors engage in such spinal manipulations in infants. There is absolutely no reason to allow such treatments until the practitioners can rigorously prove that the treatment is safe and effective. If one is sufficiently liberal to argue that ultimately it is one’s choice to take these treatments then there is no sense in banning even conventional medicines that are dangerous. This double standard is unacceptable. An effective intermediary between the extremes could be statutory warnings (as seen in most conventional medicine covers or cigarettes) making it clear that the treatment has not been shown to be effective as per the current standards of medicinal research.

The upshot of this prolonged discussion is to convince the reader that when we subject our naiveté to the razor-sharp scalpel of reason, it is tattered to bits. But what emerges from this painful surgery is worth pursuing. Apart from utility, there is a paradoxical elegance and beauty in cold reason that kindles the heart of the most apathetic stoic. Many a scientist enamoured by the beauty of science has compared science to poetry and art. For what does a scientist do other than to understand the greatest work of art ever? The universe!

Jaikrishnan Janardhanan
Jaikrishnan Janardhanan
Assistant Professor

My research area is several complex variables and more specifically