Monday, May 07, 2007

This word, “Consensus,”
I do not think it means
what you think it means.

And “Peer review”---pffft.

Peer Review, Publication In Top Journals, Scientific Consensus, And So Forth by Robert Higgs from the History News Network of George Mason University
Peer review, on which lay people place great weight, varies from important, where the editors and the referees are competent and responsible, to a complete farce, where they are not.

As I have always counseled young people whose work was rejected, seemingly on improper or insufficient grounds, the system is a crap shoot. Personal vendettas, ideological conflicts, professional jealousies, methodological disagreements, sheer self-promotion and a great deal of plain incompetence and irresponsibility are no strangers to the scientific world; indeed, that world is rife with these all-too-human attributes. In no event can peer review ensure that research is correct in its procedures or its conclusions.
It is always dangerous to talk about consensus as if it proves anything in science. Remember, there was a consensus at one time that the Earth was the center of the Universe and the Sun, Moon and stars revolved about little old Terra Firma.
At any given time, consensus may exist about all sorts of matters in a particular science. In retrospect, however, that consensus is often seen to have been mistaken. As recently as the mid-1970s, for example, a scientific consensus existed among climatologists and scientists in related fields that the earth was about the enter a new ice age. Drastic proposals were made, such as exploding hydrogen bombs over the polar icecaps (to melt them) or damming the Bering Strait (to prevent cold Arctic water from entering the Pacific Ocean), to avert this impending disaster. Well-reputed scientists, not just uninformed wackos, made such proposals. How quickly we forget.
So, how did we get so many Chicken Littles screaching about the latest coming catastrophe? (Doesn’t there seem to be a new one every six months or so? Sometimes they over lap—like avian flu and Climate Change As Caused by Man.)
Research worlds, in their upper reaches, are pretty small. Leading researchers know all the major players and what everybody else is doing. They attend the same conferences, belong to the same societies, send their grad students to be postdocs in the other people's labs, review one another's work for the NSF, NIH, or other government funding organizations, and so forth. If you do not belong to this tight fraternity, it will prove very, very difficult for you to gain a hearing for your work, to publish in a "top" journal, to acquire a government grant, to receive an invitation to participate in a scientific-conference panel discussion, or to place your grad students in decent positions. The whole setup is tremendously incestuous; the interconnections are numerous, tight, and close.
So it’s a little daisy chain of folks working up to a feeding frenzy. It’s publish or perish time.
…these two contexts are themselves tightly linked: if you don't get funding, you'll never produce publishable work, and if you don't land good publications, you won't continue to receive funding.
But, what are they to feed upon? Where is the funding going to come from? Why government grants, of course! Ah, but how to insure the much needed cash will flow your way?
When your research implies a "need" for drastic government action to avert a looming disaster or to allay some dire existing problem, government bureaucrats and legislators (can you say "earmarks"?) are more likely to approve it. If the managers at the NSF, NIH, and other government funding agencies gave great amounts of money to scientists whose research implies that no disaster looms or no dire problem now exists or even that although a problem exists, no currently feasible government policy can do anything to solve it without creating even greater problems in the process, members of Congress would be much less inclined to throw money at the agency, with all the consequences that an appropriations cutback implies for bureaucratic thriving. No one has to explain all these things to the parties involved; they are not idiots, and they understand how the wheels are greased in their tight little worlds.

But don’t these scientists know what they are talking about? Maybe, maybe not. There are limits to their knowledge. No one is qualified or knowledgeable enough to hold forth on everything at once. Although they will try.
Finally, we need to develop a much keener sense of what a scientist is qualified to talk about and what he is not qualified to talk about. Climatologists, for example, are qualified to talk about the science of climatology (though subject to all the intrusions upon pure science I have already mentioned). They are not qualified to say, however, that "we must act now" by imposing government "solutions" of some imagined sort. They are not professionally knowledgeable about what risk is better or worse for people to take; only the individuals who bear the risk can make that decision, because it's a matter of personal preference, not a matter of science. Climatologists know nothing about cost/benefit considerations; indeed, most mainstream economists themselves are fundamentally misguided about such matters (adopting, for example, procedures and assumptions about the aggregation of individual valuations that lack a genuine scientific basis). Climate scientists are the best qualified people to talk about climate science, but they have no qualifications to talk about public policy, law, or individual values, rates of time preference, and degrees of risk aversion. In talking about desirable government action, they give the impression that they are either fools or charlatans, but they keep talking―worst of all, talking to doomsday-seeking journalists― nevertheless.
But the UN issued a report and countries around the world are listening to it. Shouldn’t we?
In this connection, we might well bear in mind that the United Nations (and its committees and the bureaus it oversees) is no more a scientific organization than the U.S. Congress (and its committees and the bureaus it oversees). When decisions and pronouncements come forth from these political organizations, it makes sense to treat them as essentially political in origin and purpose.
So, is the current hysteria science or politics? And if it is science, is it good science or just a lot of folks looking for a gravy train to ride? (Politicians are always looking for that gravy train.)

No comments: