Disciplined Thinking: The Scientific Method

October 1998

Science is not only a body of knowledge but a "way of knowing." How science is different from other ways of knowing is the essence of the "scientific method." Science is a way of processing information to get to the facts without the interference of personal biases or emotions.

To humans, emotions are the spice of life. Emotions give meaning and purpose to an otherwise boring existence, but emotions are not an indicator of truth and were never meant to be so. Just because an emotion is good or pleasant doesn't mean the action that caused the emotional response is some form of "truth'." Neither are bad or unpleasant feelings indicators for "lies" or "falsehoods."

Just because you passionately feel, with every fiber of your being, that thunder is the result of chariot races by the Gods in the clouds doesn't make it factual.

What about the other ways of knowing? There are only two other ways besides the scientific way. The first is RELIGION or belief-based. Religion is based on "dogma." Dogmatism assumes rightness because of someone's authority and not necessarily on that person's use of reason and logic. How do authorities come by their conclusions? By what means were they guided? What may have influenced them?

A second way of knowing is PHILOSOPHY or commonsense. Philosophy uses reason and logic in trying to explain a set of circumstances. No empirical evidence or testing is required to back up philosophical explanations.

SCIENCE is the use of reason and logic, verified as much as is possible by empirical evidence and testing. This method not only explains systems, but also allows prediction of future activities of the system. Science is not infallible but it's greatest strength lies in its ability for self-correction.

So what exactly is this magical way of science that not only helps strip away emotions and bias, but also helps potential shortcomings of one's own conclusions to be recognized? This methodology, condensed into steps for easy teaching, is "The Scientific Method." These steps have also become a good "checklist" to see if a procedure was followed to "good science" standards. The steps are commonly taught as:

  1. Observations and stating of a problem. All science begins with observations: observations of similarities and observations of differences among objects or events in the physical world. A scientist must clearly write down exactly what she/he observed. Questions about those observations become the springboard for investigation.
  2. Hypothesis. Hypothesis is often described as an educated guess. This seems contradictory to the essence of the scientific method--a guess being fraught with biases and emotion--however, a hypothesis is really just a focusing tool the scientist uses in developing an experiment. A hypothesis must be one that can be tested with some kind of experiment.
  3. Controlled Experiment. During the hypothesis step, a scientist will consider all possible things that may affect the system in which he/she is curious. These possibilities are called "variables." Listing these variables requires thought, information gathering, and a study of the available facts relating to the problem or question. A properly controlled experiment will test those variables independently so that the observed effects match the proper causes. The exact sciences (physics and chemistry) use numbers to measure and calculate results while other sciences may use descriptions and inferences to arrive at results.
  4. Gather and Record Data and observations. Data are often plotted on graphs. Graphs can then be used to derive equations that are then used for making predictions. Data for soft sciences may be recorded interviews that are related to other interviews. The important part here is abundance of documented data. The more data obtained, the more solid the conclusions drawn from them.
  5. Conclusions. It is strongly emphasized that one must make conclusions that correctly arise from the data obtained during the experiment. Good scientists will also summarize any difficulties or problems they had and any possible sources of error. Many of these errors, suggestions and untested variables then become springboards for many more experiments. In this way scientific knowledge builds and builds.

A THEORY is a conclusion or "story" that covers and explains each and every fact obtained from experiments; it defines a system. Predictions can then be tested against the theory. If the theory holds, great! If the theory does not hold up during subsequent testing, then the scientific method not only allows for but also demands changing or altering the theory to match the new set of facts. Some people like Einstein are smart enough to jump the experimental step and go right to theory statements. But even the theory of relativity has had to stand up under the rigors of experimental testing since Einstein uttered it.

  • Repeatability. This is an extremely important step. Not only should the scientist re-do his own experiment to check the results, but all scientists have the free reign and responsibility to repeat the experiments and check the results against their own hypothesis and data. This repeatability step is an extremely powerful tool for weeding out biases and unfounded claims. Repeatability is the single most serious problem with pseudoscience, which literally means "false science." Because the conclusions of those studying UFO's, ESP and such are not repeatable under controlled conditions, those conclusions cannot be called "scientific" truths.

A theory that has withstood the tests of repeatability and has remained a constant over many years, can be elevated to the distinction of being called a LAW. But even a law, to a scientist, is not dogma. If contradictory evidence is found, one of two things must occur:

  1. Re-check the work that led to the new explanation. Most often that's where the error is found, OR
  2. The law itself must be revised to explain those new events.

This is a rare event but has happened (e.g. law of gravity--Newton vs. Einstein). Theories and laws cannot rest on a supernatural explanation. The main reason for this again is that there is no testable evidence for any supernatural powers. And as Carl Sagan stated, "Extraordinary claims require extraordinary evidence." This scientific method or process has many built-in checks and balances. This helps to ensure that personal emotions and unverified opinions are out and only the verifiable facts are in. Scientific study has led us to a literal explosion of knowledge, to a more factual and predictable understanding of our physical world no matter how unpleasant some of those facts and predictions may be.

Quotes:

It is a capital mistake to theorize before one has the data. Insensibly one begins to twist facts to suit theories, instead of theories to suit facts.

--Sir Arthur Conan Doyle

First get your facts; then you can distort them at your leisure.

--Mark Twain

Suggested Website:

Experimental Science Projects

Suggested Books:

Feynman, Richard. 1974. Surely You're Joking, Mr. Feynman!: Adventures of a Curious Character. Edward Hutchings (Editor), New York: W.W. Norton.

Feynman, Richard and Leighton, Ralph. 1988. What Do You Care What Other People Think?: Further Adventures of a Curious Character. New York: Norton.

Shermer, Michael. 1997. Why People Believe Weird Things. New York: W.H. Freeman and Co.

--Brenda Wright