Sunday, May 16, 2010

Underdetermination and truth


We say that a statement is underdetermined by available facts when it and an alternative and different statement or theory are equally consistent with that body of facts. It may be that two physical theories have precisely the same empirical consequences -- perhaps wave theory and particle theory represent an example of this possibility. And by stipulation there is no empirical circumstance that could occur that would distinguish between the two theories; no circumstance that would refute T1 and confirm T2. And yet we might also think that the two theories make different assertions about the world. Both statements are underdetermined by empirical facts.

Pierre Duhem further strengthened the case for the underdetermination of scientific theories through his emphasis on the crucial role that auxiliary hypotheses play in the design of experiments in The Aim and Structure of Physical Theory.  Individual theoretical hypotheses -- "light is a wave," "people behave on the basis of their class interests" -- do not have definite empirical implications of their own; rather, it is necessary to bring additional assumptions into play in order to design experiments that might support or refute the theoretical hypothesis.  And here is the crucial point: if an experimental result is inconsistent with the antecedent theory and auxiliary hypotheses, we haven't demonstrated that the hypothesis itself is false, but rather that at least one among the premises is false. And it is possible to save the system by modifying the theory or one or more of the auxiliary assumptions.  As W. V. O. Quine put the point, scientific knowledge takes the form of a "web of belief" (The Web of Belief).  

On the extreme assumption that both statements have precisely the same consequences, we might infer that the two theories must be logically equivalent, since the logical content of a theory is the full range of its deductive consequences and the two theories are stipulated to have the same deductive consequences. So it must be possible to derive each theory from the other. And if T1 and T2 are logically equivalent, then we wouldn't say that they really express different assertions about the world.

A more problematic case is one where two theories have distinct bodies of deductive consequences; but where the subset of deductive consequences that are empirically testable are the same for the two theories. In this situation it is no longer the case that the two theories are logically equivalent but rather "empirically equivalent." And here it would be credible to say that the two make genuinely different assertions about the world -- assertions that cannot be resolved empirically.

A third and still weaker case is one in which T1 and T2 have distinct consequences for both theoretical statements and a specific subset of empirical statements; but they overlap in their consequences for a second body of empirical statements. And consider this possibility: Because a given level of instrumentation and inquiry limit the types of empirical statements that can be evaluated, this body of data does not permit us to differentiate between the theories. So we can distinguish between "currently testable" and "currently not testable". For this third case, we are to imagine that T1 and T2 have distinct implications for theoretical statements and for currently not testable empirical statements; but they have the same consequences for currently testable statements. In this case, T1 and T2 are currently underdetermined -- though advances in instrumentation may result in their being empirically distinguishable in the future.

It is worth noting how heroic is the notion of "determination" of theory by evidence. If we thought that science should issue in theories that are determined by the empirical evidence, we would be committed to the idea that there is one uniquely best theory of everything. This assumption of ultimate theory uniqueness might be thought to follow from scientific and metaphysical realism: the world has a specific and determinate structure and causal properties; this structure gives rise to all observations; well-supported theories are approximately true descriptions of this hidden structure of the world; and therefore there is a uniquely best scientific theory -- the one that refers to this set of entities, processes, and structures. And if an existing theory is false in description of this unobservable reality, then there must be observational circumstances where the false assumptions of the theory give rise to false predictions about observation.  In other words, well-confirmed theories are likely to be approximately true, and the hidden structure of the world can be expected to create observations that refute out false theories.

However, this foundational approach is implausible in virtually every area of science.  Our theories rarely purport to describe the most fundamental level of reality; instead, they are meso-level descriptions of intermediate levels of phenomena. Take the effort to understand planetary motion.  The description of the orbits of the planets as ellipses generated by the gravitational attraction of the planet and the sun turned out to be only approximately true.  Did this refute the pure theory of gravitation? Certainly not; rather, it raised the possibility of other causal processes not yet identified, that interfere with the workings of gravitational attraction.

So how do these general considerations from the philosophy of science affect the situation of knowledge claims in the social sciences?

It would seem that social science claims are even more subject to underdetermination than the claims of mechanics and physics. In addition to the problem of unidentified interfering causes and the need for auxiliary hypotheses, we have the problems of vagueness and specification.  We commonly find that social science theories offer general statements about social causes and conditions that need to be further specified before they can be applied to a given set of circumstances. And there are almost always alternative and equally plausible ways of specifying the concept in a particular setting.

Take the idea of class conflict as a theory of political behavior.  The theory may assert that "workers act on their material interests." Before we can attempt to evaluate this statement in particular social settings, we have to specify several things: how to characterize "material interests" in the setting and how to represent the cognitive-behavioral models the worker uses as he/she deliberates about action.  Is retaining support from City Hall a material interest? Or are material interests restricted to wages and the workplace? Are workers thought to be rational maximizers of their interests, or do they also embody social commitments that modulate the dictates of maximization? And here is the crucial point: different specifications lead to different predictions about political behavior; so the general theoretical assertion is underdetermined by empirical observation.

This discussion seems to lead us into surprising territory -- not the limited question of underdetermination but the large question of truth and correspondence and the question of the rationality of scientific belief. Do we think that social assertions are true or false in the semantic sense: true by virtue of correspondence to the facts as they really are; or do we think that social assertions are simply ways of speaking about complexes of social phenomena, with no referential force? Is the language of class or ideology or ressentiment just a way of encompassing a range of social behaviors, or are there really classes and ideologies in the social world? And if we affirm the latter possibility, does the evidence of social observation permit us to unambiguously select the true theories?

I suppose one possible approach is to minimize the scope of "truth" when it comes to the social sciences. We might say that there is a limited range of social statements that are unambiguously true or false -- Jones robbed a store, Jones robbed a store because he was economically desperate, people sometimes commit crimes out of economic necessity -- but there is a broader class of statements that have a different status.  These are more akin to interpretive schemes in literary criticism or to a set of metaphors deployed to describe a complex social situation.  The language of class may fall in this category.  And we might say that these statements are not truth claims at all, but rather interpretive schemes that are judged to do a better or worse job of drawing together the complex phenomena to which they are applied.  And in this case, it seems unavoidable that statements like these are radically underdetermined by the empirical facts.

(See Kyle Stanford's essay on underdetermination in the Stanford Encyclopedia of Philosophy.)

2 comments:

Larry Hamelin said...

Other than restating a survey of philosophical opinions about underdetermination, it's difficult to see what point you're making.

In general, I find philosophical concerns about underdetermination at best parochial. Science does not give us the One True Theory of anything. So what? Even narrowing things down is of incalculable value. Science does not and will never gives us certainty, but the desire for certainty is itself arguably a vice.

"I suppose one possible approach is to minimize the scope of "truth" when it comes to the social sciences."

One can suppose most anything. I enjoy and apprehend the social power of literary fiction, but one expects more from a discipline that labels itself a science.

I think it's clear that the social sciences, despite a domain vastly the vastly more complex than that of the physical sciences, has done an admirable scientific job, especially when social scientists ignore postmodernist hand-wringing. The job is not giving us the One True Theory of social behavior, but rather slowly but surely falsifying the more foolish and fantastical imaginations, especially of religion, Modernism, and exceptionalism.

As Sherlock Holmes said, "When you have eliminated the impossible, whatever remains, however improbable, must be the truth." It may take a thousand years to eliminate just the most egregious social fantasies, but where would be the fun if it were too easy?

Donald Pretari said...

That's why I said the following about this paper...

Summerhill, William (2010): Colonial Institutions, Slavery, Inequality, and Development: Evidence from São Paulo, Brazil. Unpublished.

http://mpra.ub.uni-muenchen.de/22162/

...on Marginal Revolution:

"Inequality, when it is not persistent, does not necessarily indicate dire circumstances that favor
later underdevelopment. Nor is it the case that unfavorable outcomes can be pinned mechanically on earlier inequality."

I would find a Mechanical Explanation dubious in any case, so I'm predisposed to agree. But, even though I'm impressed with how scholars try and determine these connections, it's hard for me to believe these connections can truly be determined.

Posted by: Don the libertarian Democrat at May 16, 2010 5:18:18 PM

http://www.marginalrevolution.com/marginalrevolution/2010/05/assorted-links-14.html#comments

The paper was very interesting, but, to me, it read heavily laden with assumptions. I don't think there's an alternative to that, but it leaves me believing that such deep issues are beyond resolution. At most, we can clear up a few important matters around the edges of these problems.

I'm fine with that, but many people aren't.

Don the libertarian Democrat