The Case Against Frequentism

From my Infidels paper on miracles. 

 

IV. Probability and its Empirical Foundations

According to Hume, probabilistic beliefs concerning the intentions of a supernatural being are inadmissible in reasonings concerning matters of fact because these beliefs fail to be grounded in experience. This insistence has been enunciated by Bayesian theorists, and it is the frequency theory. But the frequency theory has fallen on hard times, and most Bayesian theorists do not accept it, largely because of difficulties related to the problem of the single case.
The problem is this. Frequencies give us information as to how often event-types have occurred in the past. But we often want to know the probability of particular events: this coin-toss, this horse-race, this piece of testimony to the miraculous, etc. If we are to accept Hume's conclusion that testimony to the miraculous ought never to be accepted, we need to show more than just that rejecting testimony to miracles in general is a good idea because false miracle claims outnumber true ones. Many Christians are skeptical of miracle claims put forward by televangelists, but nonetheless believe that the evidence in support of the resurrection of Jesus, and perhaps in support of some modern miracles, is sufficient to overthrow our ordinary presumption against accepting miracle reports.
Frequentists have attempted to assess the prior probability of individual purported events by assimiliating them some class of events. Thus, we assess the probability of a particular coin-toss as 1/2 in virtue of its membership in the class of coin-tosses. But the question is which class the relevant reference class is. The claimed resurrection of Jesus falls into many classes: into the class of miracles, into the class of events reported in Scripture, the class of events reported by Peter, the class of events believed by millions to have occurred, into the class of events basic to the belief-system of a religion, etc. Of course it is what is at issue between orthodox Christians and their opponents whether the class of miracles in the life of Jesus is empty or relatively large.
Wesley Salmon attempts to solve this problem by defining the conception of an epistemically homogeneous reference class. A class is homogenous just in case so far as we know it cannot be subdivided in a statistically relevant way. Thus, according to Salmon, if Jackson hits .322 overall but hits .294 on Wednesdays, the Wednesday statistic is not to be treated as relevant unless we know something about Wednesday that makes a difference as to how well Jackson will bat. Thus, according to Salmon, the relevant reference class is the largest homogeneous reference class; we should try to get a sample as large as we can without overlooking a statistically relevant factor.[13]
There are two difficulties with this method as an attempt to satisfy Hume's strong empiricist requirements for properly grounded probability judgments. First, questions of statisical relevance cannot be fully adjucated by appeal to frequencies. Second, the very heuristic of selecting the largest homogeneous reference class cannot be read off experience.
On the first point, consider the situation of a baseball manager who must choose between allowing Wallace to bat or letting Avery pinch-hit for him. Wallace has an overall batting average of .272, while Avery's is .262. But the pitcher is left-handed, and while Wallace bats .242 against left-handed pitching, Avery bats .302. Nevertheless, the pitcher is Williams, and while Avery is 2-for-10 against Williams, Wallace is 4-for-11. Have these batters faced Williams too few times for this last statistic to count? And can this be straightforwardly determined from experience? What is needed is a judgment call about the relevance of this statistical information, and this judgment cannot simply be read straightforwardly from frequencies. The frequentist's epistemology for probabilistic beliefs, insofar as it is an attempt to conform to empiricist/foundationalist constraints, seems impossible to complete.
On the second point, is the heuristic of selecting the smallest homogeneous reference class justified simply by an appeal to experience? Admittedly it makes a certain amount of common sense. But this attempt to go from a statistical "is" to an epistemological "ought" seems to suffer from with the same (or worse) difficulties that getting "ought" from "is" suffers from in ethics, and here again Hume's empiricist/foundationalist assumptions impose an impossible burden on probability theory.
The frequency theory seems clearly to be the theory of priors that Hume would have adopted had he been involved in the contemporary Bayesian debate on prior probabilities. But even this theory fails to adjudicate the issue concerning miracles in Hume's favor or in favor of the defenders of miracles, because it lacks the resources within itself to select the appropriate reference class. This inability to provide determinate answers to questions of probability is what makes this theory inadequate for resolving the question of miracles. Therefore Hume cannot justify his claim that it is never rational to believe testimony to any miracle on the grounds that miracles are less frequent in experience than false miracle reports.[14]

13] Salmon, The Foundations of Scientific Inference (Pittsburgh: University of Pittsburgh Press, 1967), pp. 90-93.
[14] These objections were suggested to me by in conversation by Patrick Maher.
Ping your blog, website, or RSS feed for Free