Quick-access: (skip to compressed summary)
The election was held 3 March 2009. A press release immediately appeared from FairVote ("a non-profit, non-partisan organization that advocates for fair elections") signed by Rob Richie ("executive director") declaring "Burlington Holds Second Highly Successful Instant Runoff Voting Election." It was published verbatim by Huffington Post but unfortunately contained the false claim
The Burlington election was a model of clean, open debate without "spoiler" concerns.which was, of course, also promptly regurgitated verbatim by, e.g. Krist Novoselic in Seattle Weekly, etc. On 6 March, Some Analysis of the 2009 Burlington IRV Election by "Terry Bouricius, a former city councilor and state legislator from Vermont, and senior policy analyst for FairVote" appeared on the FairVote blog, extolling it as having "gone off without a hitch" and lauding its wonderful success without mentioning a single one of its numerous pathologies. Our analysis demonstrating that this election had suffered numerous pathologies appeared on the internet on 14 March. It was also described in Burlington's 2009 Mayoral Election: Did IRV Fail The Voters? by Wes D. Hamilton in the 15 March Green Mountain Daily. That article over time received numerous "comments" by internet denizens, mainly an IRV advocate named Rama Schneider, who also goes by the name "Ramabahama." On 17 March, Response to Faulty Analysis of Burlington IRV Election appeared on the FairVote blog, allegedly demonstrating our analysis "faulty." On 23 March the same venue sported More on Warren Smith's and Anthony Gierzynski's flawed analysis. Still more criticism, mainly from the same players, came in the 13 March Vermont Daily Briefing, in FairVote web pages sometimes referred to by the attackers... and heaven knows where else.
As of the end of March, we feel it is time to try to respond to the attack-attempts. Depressingly, it appears almost all fall into the following categories (or some combination):
Also, the attackers try to flood with large numbers of these, thus making the task of refuting them all, become long. They hope nobody will want to read all the refutations. We've tried to help the reader by providing a quick access index (above). We now try to deal with many of the attacks on a case by case basis. (We provide handy ABCD codes so the reader can tell which game-plan that attack employs; A is most frequent.)
As usual, quotes by the FairVote head and "senior analysts" with massively-false propaganda claims will be listed occasionally with green background, as a little humorous interlude, like this:
|
Instant runoff voting has a long, tested history of use in all kinds of important elections – from president of Ireland (Mary Robinson won there after being second on the first count in 1990), mayor of London (Ken Livingstone won as an independent after Labour Party insiders denied him the nomination), house of representatives in Australia (where a minimum of 4 candidates ran in every district in November 2007 because no one has to worry about splitting the vote, and every race was won with a majority) and a growing number of US elections. See www.fairvote.org/irv for more. |
"IRV's flaws, if they existed, would have showed up in the decades of IRV elections in Australia and Ireland... But they don't." – FairVote head Rob Richie, letter published in The Nation June 2008. |
This election did not have a non-monotonic result. It could have had a nonmonotonic result, but it didn't – that is, Kiss in fact did win. The only way you have a nonmonotonic result here is if Wright, Montroll or Smith would have won if being raised on ballots in some new combination. – FairVote head Rob Richie, web post 16 March 2009. |
"IRV lets voters rank candidates in preference order. A voter's best strategy is to sincerely rank the candidates." – T.G.Bouricius, P.J.Macklin, R.Richie: Science Magazine 294 (May 2001) 303-306. |
"For example, under Range and Approval voting, giving any support to a second choice may cause that voter's first choice to lose (violation of the Later-No-Harm Criterion), causing some voters to strategically truncate their true preferences. IRV complies with the Later-No-Harm Criterion, and is thus immune to such strategic calculation." – FairVote web page "IRV Myths and Facts (FAQ)" downloaded 25 March 2009. |
| Database | #papers with "Condorcet" in title | With "later," "no," and "harm" | With "mutual" and "majority" | "monoton" in title & topic "voting" |
|---|---|---|---|---|
| ISI "web of knowledge+science" | 275 | 0 [in title] | 1 [in title] but this 1 paper does not include mutual majority criterion about voting, instead concerns a group-psychological notion they call "mutual majority and minority influence." | 16 |
| AMS "math-sci-net" (Mathematical Reviews) | 112 | 0 [in title] | 0 [in title] | 10 |
| AMS "math-sci-net" again | 112 | 14 hits if "later" & "harm" allowed to appear anywhere, but none of the 14 papers are about voting. | 20 hits if "mutual" & "majority" allowed to appear anywhere, but only 4 voting-related and none of those involve "mutual" & "majority" as adjacent words. | 91 if monoton either in review or title |
| Total | 387 | 0 | 0 | 107 |
A cynic would argue that the sole reason for FairVote & Bouricius's emphasis on MM is because it, like "later-no-harm," is one of the few criteria that IRV obeys while a lot of other voting systems do not. Also, Bouricius gains the benefit of sounding mysterious and impressively-expert-like by intoning "mutual-majority criterion" (whether he knows what he is talking about, or not).
12 Range Voting(A) – FairVote/Bouricius: "Since Range Voting has never been used for any governmental elections it is hard to be certain how often various paradoxes and pathological outcomes would occur. But it certainly is subject to genuine spoiler scenarios..." (See also Richie on this.)
Response: Range voting has been used for many governmental elections, apparently highly successfully, dating back to the dawn of democracy. Indeed, it had already been used (for much longer than IRV has ever been used) even back at the time IRV got invented!
At least with our definition (above) of spoiler, range voting never exhibits a spoiler (unlike, as the Burlington election showed, IRV). That is, it is impossible in range voting, by giving S the maximum score, to cause both S and your 2nd choice Q both to lose. That's because the decision about how to score Q (or anybody else) is an independent decision, unaffected by how you score S; and raising their score can never hurt a candidate's winning chances with range voting (unlike IRV, as the Burlington election showed). Theorems like this enable us to be "certain" that range voting never exhibits certain kinds of pathologies.
Notice the contrasting meanings of the word "never." When mathematicians employ "never" it means never. When Bouricius and FairVote employ "never" it apparently means "sometimes" or "frequently" or "hugely frequently"; it is hard to predict which meaning they will have in mind at any particular time.
It is, however, certainly true that range voting can exhibit various kinds of pathologies. There are an infinite number of different voting systems and different possible pathologies that they might fail. The student can easily get lost in that thicket. The right way out of it is called Bayesian Regret. It is a systematic, objective way of comparing voting systems which effectively examines every possible pathology (of which there are an infinite number), weighting each by how serious and how frequent it is. When that measurement was done, Range Voting was found to be superior both to IRV, and to every other commonly-mentioned-in-books voting system – with either honest voters or strategic voters (or mixtures) under all 720 different possible combinations of modeling assumptions tried.
13 Tideman's book(A) – FairVote/Bouricius: Collective Decisions and Voting by Prof. Nicolaus Tideman states (p.238) that Range voting is one of six voting methods that "have defects that are so serious as to disqualify them from consideration."
Response: We had reviewed Tideman's book and explained there why Tideman's "strategy vulnerability" score was measuring the wrong thing and yielded plainly-wrong results. FairVote here conveniently forgets to mention that Tideman also finds instant runoff voting to be "unsupportable" (this is on page 240 for elections in which it is "feasible" to construct a pairwise-table – which it evidently was in the Burlington 2009 election, since we constructed it). The difference is that Tideman's analysis showing Range Voting "unsupportable" was (as we demonstrated in the review) flawed, while his arguments showing IRV unsupportable were valid. As far as we can see (as of March 2009) they have not been disputed by FairVote or anybody else.
Here's a helpful hint. If the sole voting-methods book you cite to support your case, says the very voting method you are trying to push, is "unsupportable," that's a little tiny clue your argument might be a teeny tiny bit in trouble.
14 Bucklin, Approval, & Range voting(AD) – FairVote/Bouricius: "In fact, Bucklin, Approval and Range voting quite possibly would have elected Kurt Wright (the Condorcet-loser among the top three), although this cannot be known for certain – it is true that Wright would have won if second choice rankings had been randomly reduced in half."
Response: First of all, we ran Bucklin on the exact same ballots input by IRV. It elected Montroll. Not Wright. We "know this for certain." (Of course, with Bucklin, the voters might have voted differently because of making different dishonest-strategic lying decisions than with IRV. But remember, FairVote itself has assured us that "strategic voting played no role" in this election, so they themselves think we don't have to worry about that. In any event: with the official ballots, Bucklin elects Montroll.)
Second, as our analysis (also) already said, there indeed is no way to know for certain who range and approval voting would have elected, because they do not employ rank-order ballots (while IRV and Bucklin do). Therefore the only way to guess what Range and Approval would have done is to somehow infer/guess what Burlington's Range/Approval ballots would have been. Nevertheless, we have a high degree of confidence they would have elected Montroll for two separate reasons. First, by theorem, range (and approval) voting always elects the honest-voter Condorcet winner (CW) provided enough of the approval/range voters are strategic and the CW would with honest voting have been either the top or second-top range-voting finisher. (In the "random elections model" in 3-way races, the chances a CW finishes top or second in range voting are 99%.) Second, in the present election, the IRV voters in a sense provided "approval threshold" data by ranking either "W only" (presumably meaning M,K not approved) or "W and M only" (presumably meaning K not approved) or "W>M>K" full ordering (presumably meaning either "W & M approved, K not" or "W approved but K & M not.") It does not matter which of those two "either" possibilities was intended – no matter which way all those choices were made, the votes were such that we always get Montroll as the approval-voting winner. That's a lot of room for variation in our assumptions – but no matter where we run within that room, Montroll always wins with the official Burlington ballots. So while we agree we "cannot be sure" Montroll would have been the approval-winner, it is the guess best-justified by the evidence. FairVote and Bouricius did not discuss this whole model and that theorem at all, acting as though we had no basis whatever for our claims, nor did they mention our analysis had already said we had no way to be sure. That's approach D – distort what we said, then attack that.
15 Range voting "unadoptable"(A) – FairVote (web page "Single-winner Voting Method Comparison Chart" cited by Bouricius, downloaded 26 March 2009): "Most people (and certainly most elected officials) are unlikely to be willing to abandon the principle of majority rule in favor of Bayesian regret (the core concept of Range Voting). If 55% of voters prefer candidate A and 45% prefer candidate B in a two candidate race, Range Voting promotes the concept that perhaps B should win if the 45% feel very strongly about their choice, while the 55% are only lukewarm about their choice. This characteristic of Range Voting, the fact that it expressly rejects the notion of majority rule, means that it will never be adopted for government elections."
Response: Let's see how many bogus uses of the (ever-popular with FairVote) word "never" occur here. Range voting will "never" be adopted for government elections – except for the fact it already was and used for over 1000 years. Government elections in which a non-majority wins (or might) could "never" be adopted? Gee. We're surprised to learn that the US constitution (2/3 and 3/4 supermajorities required to amend) could never have been adopted. And the US senate's cloture-vote rule (60%). And US veto-override votes (2/3). And the USA's procedure for enacting laws (pass by 3-0 majority among house, senate, & president; if even one objects, not a law). And juries in US criminal cases (12-0 required). And the USA's original (and present) presidential-election methods. And golly, FairVote's own favored voting method IRV, as we just saw in Burlington 2009, refused to elect Montroll despite majorities favoring him over every rival.
As usual, FairVote offers absolutely no evidence for their "unadoptable" and "never" claims. They simply arise from their own immense inner certainty, which is so great as to surmount both the need for evidence, and the facts that directly contradict them.
(Oh, and we've never particularly advocated range voting for use in two-candidate elections, at all. Voting only gets interesting when there are more than 2 candidates.)
Incidentally, you can read about the Los Angeles 2001 mayoral election, which is the only election known to us (as of 2009) in which the range voting (perhaps) would have "overruled a voter majority." You may judge for yourself whether that was a good or bad thing, and compare with the behavior of IRV voting.
This FairVote web page is quite interesting. It presents a list of voting methods and properties which FairVote "believes are most important to U.S. voters," and then in a chart states that the satisfaction of each property by each voting method is either "low," "medium," "high," "yes," "no," or "yes/no." You may be interested in our own such chart, or Tideman's criteria.
Incidentally, some errors we spotted in the FairVote chart are (a) the Condorcet-loser criterion entry for Condorcet methods should have said "yes/no" since Condorcet's own "least reversal" variant fails it, and (b) range voting should have been yes for cloneproof. FairVote claims since range voting "can degrade to approval which can degrade to vote-for-one plurality, Range may not satisfy this criterion." They fail to mention that under the Burlington 2009 IRV rules they themselves proposed, vote-for-one is allowed, but oddly enough conclude IRV satisfies cloneproofness... but anyhow not only is their argument bogus, their conclusion is too. It is entirely irrelevant whether a range-voting election happens to be the same as a plurality election in the sense every voter scores exactly one candidate max and all rivals min – range is still cloneproof.
Anyhow, rather oddly, by the exact list of properties given by FairVote, a voting method which satisfies more of them to a greater degree than IRV (by FairVote's own reckoning) is Schulze beatpath Condorcet voting ("high" resistance to spoilers and strategic voting, satisfies majority and mutual majority, satisfies Condorcet-loser and -winner unlike IRV, cloneproof, and monotonic unlike IRV). Schulze is also recommended by Tideman in the very book Bouricius cited above which had branded IRV as "unsupportable."
Another method that satisfies all the criteria they list for IRV, plus also Condorcet-Winner, is WBS-IRV (but it fails "later no harm").
Golly. So why is FairVote pushing IRV and not Schulze beatpath (and not WBS-IRV) voting? (As of March 2009, Schulze is not even mentioned anywhere in the entire "Fair"Vote website!) The only two reasons we can see in their chart are
Oho. So why it is that Schulze is "unadoptable"? Supposedly because it is complicated and harder to count than IRV. Only trouble with that is that Schulze actually is easier to count than IRV in the sense it is "precinct-summable," that is, with Schulze, but not with IRV, each precinct can publish a concise "subtotal" and the full election results are deducible from them.
16 Ramabahama defends rules – "Ramabahama" (Rama Schneider) argued, rather repetitively, that Kiss's election was valid because he won according to the rules of the IRV system. Essentially, R would simply repeat the rules, then state "Kiss won." If anyone pointed out a logical pathology present in the election, he would say that was a "what if" scenario, but the actual scenario was: Kiss won.
Response: In some sense, Ramabahama is entirely right. (And we actually appreciate his argument rather more than most preceding ones since we think he was actually being honest about it, not trying to deceive!)
And if the election rules had instead been "we will kill a goat, and if the entrails end up pointing South, then Simpson wins" we daresay Ramabahama would have argued that this was a fully legitimate Simpson victory and repeated those rules. Any attempt by us to say that the election rules themselves were illogical would have been met (we presume) by simply claiming those were "what if" scenarios. The actual scenario was: the entrails pointed South, and those were the rules – so Simpson won!
But we think even a staunch defender of rules like Ramabahama must feel a little disquiet. IRV said "Kiss won." Using the exact same rules and same votes except that some Wright voters switched their vote to Kiss, Kiss would not have won (Montroll would have won). We daresay Rama#1, in election#1 would have defended Kiss's legitimacy; he was elected by the rules. And in in election#2, Rama#2 would have defended Montroll's legitimacy; he was elected by the rules.
We're just a little worried about what would happen if Rama#1 ever encountered Rama#2. We also are a little worried about what would have happened inside his mind if the crux Wright↔Kiss switching voter who made the winner change the "wrong way" had, in fact, been Rama Schneider.
After this page appeared, Richie & Bouricius sent us some emails about alleged errors herein. In most cases their arguments, even if correct, fail to help the case for IRV and make them look even more irresponsible. But they did make one good point:
Mea culpa: Bouricius pointed out that the company Election Solutions Inc. (ESI) he co-founded with Caleb Kleppner and Kenny Mostern, is not the same company as Voting Solutions Inc. (VSI) founded by Jim Lindsay, Bill Gram-Reefer, and Steve Willett; and neither is the same as Premier Election Solutions Inc. formerly known as Diebold Corp. This Burlington 2009 election was counted using VSI software, not ESI software, in spite of the fact that ESI featured the output of VSI's software (i.e. the Burlington vote count) front center on their company web page (downloaded 30 March 2009) while VSI's web page did not mention it. Also, ESI's subpage about Burlington 2009 claims that "Burlington is going to use Choice Plus Pro, a program for tallying IRV elections..." and then that software written by VSI is freely downloadable from the ESI web site even though that "software may not be copied or used for commercial purposes without their (VSI's) permission." Got all that? We have now corrected our misunderstandings of this.
Hypothetical Approval/Range victor: Richie says "I think the odds are high that [Montroll] would have lost with approval and, especially, with range." Why? He felt that the Wright & Kiss backers were "passionate" and hence would have "bullet voted" voted for their favorite alone, depriving Montroll of, e.g. intermediate range-scores, and thus preventing him from winning.
Of course, the official IRV voting system rules allowed voters to "bullet vote," and indeed many did so, but despite that
But supposedly with range or approval the voters would have acted differently, bullet voting more-often, under the influence of their "passion." (I have no idea why Richie feels Montroll would have "especially" lost with range voting.) He presented no evidence for this conjecture.
Recountification and more about invalid ballots: Concerning their exaggerated claim, which we'd refuted, of "99.99% valid" ballots, R and/or B point out:
To respond to this: When assessing the number of invalid ballots and errors in an election, we have to use the final official tallies. If the officials and/or voters were confused and imperfect, that is sad, but their confusion and imperfections count. If Richie and Bouricius feel that they would have been (or actually were) better counters than the officials, or better voters than the voters, that in no way affects our conclusions about the actual error/invalid rates in the official counts. The plain fact is, after doing whatever counting, re-counting, and re-re-counting they were ever going to do, they came out with final official tallies and data files, and according to those, the error/invalid rates were 20 times larger than Richie & Bouricius said.
Notice that these final official tallies posted online by Burlington are date-stamped 3 March 2009 at 8:15pm, i.e. before all the misleading posts from FairVote came out about "99.99% valid."
Thus FairVote's "defense" of IRV's supposed "success" in this election which (they'd stated before) "went off without a hitch" consists in now claiming, basically, that "The official tallies were wrong. The officials were confused and unable/unwilling to incorporate recount-based corrections into their data. We (B & R) would have been way smarter than them."!
Oh. Sorry, we didn't realize this was what Richie & Bouricius had meant by "went off without a hitch."
Looking a little deeper, one may ask: why, after partially completing a recount, were the Burlington officials unwilling/unable to use whatever data they'd collected during the partial recount, to update their official tallies? We don't know. (In fact, we don't even know that they did, or did not; we're just relaying Richie & Bouricius's stories.) But we do know this: IRV, unlike a lot of voting methods (range, approval, plurality, Borda, Schulze-beatpaths Condorcet...) is not additive. That is, with IRV there is no such thing as a "subtotal." With additive methods, if recounts in Kalamazoo Precinct produce some corrected data, then Kalamazoo Precinct can publish its new corrected subtotal, and then the central officials trivially can combine the precinct subtotals to get the (new corrected) overall total. With nonadditive methods like IRV, trying to incorporate corrections can be much trickier. That may have been why Burlington did not (if they did not) incorporate corrections from the partial recount. So there are two possibilities here:
More on ballots and their invalidity: Bouricius (still-later response) now claims the 4 "invalid" ballots were not the same as the 4 "exhausted" ballots but were in fact blank, i.e. expressed no opinion in the mayoral race. That appears to be true. Juho Laatu (even-later response) has now summarized the problematic ballots. Laatu found 113 ballots "skipping" at least one rank, including 46 which skipped 2-or-more ranks; 6 ballots with tied-rankings; and 4 blank ballots. If all these are counted as "invalid" or at least "problematic" then the problem-rate would be (113+6+4)/8984=1.37%. In other words, the Bouricius/Richie/FairVote "99.99% valid" claim exaggerated to make the problems appear about a factor of 100 smaller than they were. Even so, we repeat that the performance of the Burlington voters and counters remains impressive.
Update – latest ploy from Rob Richie! After a period of apparent indecision, FairVote appears to have adopted a clever new strategy to use to respond to anybody on the internet who brings up this Burlington 2009 election:
"Come again? Montroll was in last place when the Burlington was reduced to three candidates. There in fact is no election method used in any public election in the world or any office that would have elected him." |