DATA JOURNALISM / ABS CHALLENGES / 2026 ROCKIES

Colorado Bought Its ABS Edge in Bulk

Baseball Savant ranks the Rockies second in MLB for ABS challenge value. Their hitters won only 42% of their challenges, while their catchers and pitchers won 64%. The value didn’t come from winning more often. It came from challenging more often, not from picking pitches better.

Every Rockies ABS challenge · 2026 regular season
386 challenges · 209 overturned · 177 upheld
Each mark is one verified challenge: overturned, upheld. Solid box = ABS zone; dashed box = where a ball’s edge still touches it (exact for a median-height batter, approximate for others). Hover, click, or use ← → keys.
Savant ABS Runs Above Average
+7.22nd of 30
Challenges · overturned
386 · 20954.1%
Hitters · catchers and pitchers overturned
42% · 64%MLB 49% · 58%
Runs from challenging more · from picking better
+7.9 · +0.7vs. an average club

Colorado’s hitters won 75 of 178 challenges, 42%. Hitters league-wide won 49%. Colorado’s catchers and pitchers won 134 of 208, 64%, against 58% for everyone else. The club still finished +7.2 in Runs Above Average, second only to the Minnesota Twins (+8.7). That doesn’t add up on its face, and I wanted to know why.

ABS is new to the majors in 2026. A hitter, catcher or pitcher can challenge a called ball or strike, and an automated zone makes the final ruling. The zone is 17 inches wide and runs from 27% to 53.5% of the batter’s height, judged at the middle of the plate, and any part of the ball touching it counts. Each club gets two challenges and keeps one each time it wins. To find out which of Colorado’s two faces is the real one, I went back through every called pitch and every challenge of the season and charted where each one crossed the plate.

What I found

  1. The edge is mostly volume. Colorado gained +8.6 runs over what an average club would have gotten on the same pitches (the 95% range, the span of values the data can’t rule out, is +3.1 to +14.4). +7.9 of that came from challenging more. Picking better pitches added +0.7 (−4.1 to +5.5), which I can’t tell apart from zero.
  2. Hitters are the extreme case. They led MLB in volume (+5.2 runs) and ranked 29th of 30 in how well they picked (−2.8). The 42% win rate is the cost of challenging that much.
  3. The catchers carry the quality. Hunter Goodman ranks second among 107 MLB catchers by Savant’s measure, and he won more challenges than his pitches would predict, though by less than his raw record suggests once I account for the small sample.
  4. Most of what Colorado “left on the table” was too close to see. 318 of its 473 unchallenged wrong calls were within an inch of the line.
  5. I found no clear Coors Field difference in challenge rate, success or umpire error. That means I didn’t detect one, not that there isn’t one.

Short on time? Read the one-page brief (PDF), written like an internal research summary. It is not a Rockies document.

1 The puzzle

Runs Above Average is Savant’s estimate, not a literal run count. It compares the run value Colorado gained by winning challenges, and gave up by losing them, with what an average club would have gotten on the same pitches. By that measure, Colorado’s catchers and pitchers were the best in baseball (+6.1) and its hitters modestly positive (+1.1).

Win rate can’t explain that, because win rate isn’t a measure of decision quality. A player who only challenges pitches that missed by four inches looks perfect. One who takes more chances looks worse and may help the team more. Hitters and fielders also challenge different pitches: hitters appeal called strikes that look like balls, while catchers and pitchers appeal called balls that clipped the zone. Around the league, the gap between the two is 8.6 points. Colorado’s is 22.3. Beyond that normal gap, the extra is 13.7 points (95% range 3.1 to 24.0), unusual but not off the chart.

Figure 1The offensive / defensive divideSelect a row to redraw both zones. Fielders: catchers and pitchers.
Hitterschallenged called strikes
n = 178 · 75 overturned (42%)
Catchers & pitcherschallenged called balls
n = 208 · 134 overturned (64%)

Map shows local overturn rate (thin cells blank).

HittersFielders

Tick marks show the average of the other 29 clubs. Select a row to redraw both zones.

To separate the two stories, I split each club’s gain into two parts. Volume is what a club earned by challenging more (or less) often than an average club would on the same pitches. Selection is the rest: how valuable each challenge was compared with an average one. To define “average,” I built a model of how often a typical club challenges a pitch, given where it crossed the plate, the count, the situation and the stakes. It held up on games it hadn’t seen (details are in the methodology).

Colorado’s hitters challenged 178 times where an average club would have challenged about 130. That volume was worth +5.2 runs (+2.6 to +8.3), the most in MLB. Their selection cost −2.8 (−6.1 to +0.5), 29th of 30. The catchers and pitchers did both: +2.6 from volume and +3.5 from selection (+0.1 to +7.0), fourth in MLB.

Figure 2Challenging more vs. challenging better
-4-20246-4-2024Runs from challenging MORE than average (volume) →Runs from picking BETTER (selection) →COL

Hitters: Colorado ranks #1 of 30 in volume (+5.2 runs) and #29 of 30 in selection (−2.8 runs). Dots are clubs; hover for values.

Figure 3All 30 clubsSort by any measure. Click a club to pin it beside Colorado.

ABS Runs Above Average (Savant). Official: runs gained and cost of failed challenges, each compared with an average challenger on identical pitches.

Colorado+7.2rank 2 of 30
CompareClick any club to pin it beside Colorado.
Average club+0.1of 30 clubs

My own version of the measure puts Colorado third rather than second. It leaves out Savant’s penalty for failed challenges and uses my own definition of an average club, so the rankings shouldn’t match exactly. The pieces I rebuilt track Savant’s published numbers almost perfectly (a correlation of about 0.99 across the 30 clubs for expected challenges, runs gained and expected runs gained), so I’m describing the same thing Savant scores.

2 Where in the zone Colorado challenges

Every dot below is a Colorado challenge, drawn where the ball crossed the plate and scaled to that batter’s own zone, so a pitch at the top edge is at the top edge for a 5-foot-9 shortstop and a 6-foot-5 first baseman alike. You can see where the club challenges most, where it wins, and how that map differs from the other 29 clubs. Areas with too few challenges to read are left blank.

Figure 4 · interactiveThe strike-zone explorer386 Rockies challenges. Catcher’s view; the solid box is the ABS zone, and the dashed box shows how far outside it a ball can land and still touch it (exact for a median-height batter, approximate for others).
Role
Result
Original call
Venue
Leverage
Months
Overturned UpheldFaded = filtered out
Data table for the 386 selected challenges
DateOpp.Inn.CountChallengerRoleOrig. callResultEdge margin (in)Flip value (runs)
Aug 26@ WSH▼30-2Hunter GoodmanFieldingBallOverturned0.970.15
Aug 26@ WSH▲60-0Connor NorbyBattingStrikeUpheld-0.920.10
Aug 25@ WSH▲40-0Willi CastroBattingStrikeOverturned0.610.06
Aug 25@ WSH▲42-0Willi CastroBattingStrikeUpheld-1.640.34
Aug 25@ WSH▼42-2Hunter GoodmanFieldingBallUpheld-0.470.22
Aug 27@ WSH▲20-2Ezequiel TovarBattingStrikeOverturned0.880.20
Aug 27@ WSH▲90-0Cole CarriggBattingStrikeUpheld-2.050.06
Aug 27@ WSH▲92-1TJ RumfieldBattingStrikeUpheld-2.470.13
Aug 24@ WSH▼21-2Brett SullivanFieldingBallOverturned1.500.29
Aug 24@ WSH▲32-0Jake McCarthyBattingStrikeOverturned3.200.15
Aug 24@ WSH▲50-2Jake McCarthyBattingStrikeUpheld-1.010.15
Aug 24@ WSH▼80-1Brett SullivanFieldingBallUpheld-0.820.08
Mar 30@ TOR▼53-2Hunter GoodmanFieldingBallUpheld-1.830.63
Apr 1@ TOR▼11-2Brett SullivanFieldingBallUpheld-0.020.09
Apr 1@ TOR▼81-1Brett SullivanFieldingBallOverturned1.610.09
Mar 31@ TOR▼21-2Hunter GoodmanFieldingBallOverturned0.430.15
Mar 31@ TOR▼33-2Hunter GoodmanFieldingBallUpheld-1.010.46
Mar 31@ TOR▼60-0Hunter GoodmanFieldingBallOverturned4.390.06
Mar 31@ TOR▲82-1Kyle KarrosBattingStrikeOverturned2.460.21
Mar 31@ TOR▲81-0Hunter GoodmanBattingStrikeUpheld-2.450.11
Aug 9@ STL▲31-0Cole CarriggBattingStrikeOverturned0.700.23
Aug 9@ STL▼81-0Brett SullivanFieldingBallOverturned2.710.06
Aug 8@ STL▲33-1Willi CastroBattingStrikeUpheld-0.530.57
Aug 8@ STL▲53-2Willi CastroBattingStrikeUpheld-0.430.46
Aug 16@ SF▼31-0Brett SullivanFieldingBallOverturned1.360.06
Aug 16@ SF▲73-2Jordan BeckBattingStrikeOverturned0.590.59
Aug 16@ SF▲81-1Cole CarriggBattingStrikeUpheld-0.640.13
Aug 15@ SF▼30-2Brett SullivanFieldingBallOverturned0.310.15
Aug 15@ SF▼42-1Brett SullivanFieldingBallUpheld-1.220.44
Aug 15@ SF▼40-1Brett SullivanFieldingBallOverturned0.890.09
Aug 14@ SF▲22-0TJ RumfieldBattingStrikeOverturned0.770.24
Aug 14@ SF▲40-0Connor NorbyBattingStrikeOverturned0.720.05
Aug 14@ SF▼61-1Brett SullivanFieldingBallUpheld-0.490.13
Jul 11@ SF▼10-0Kyle FreelandFieldingBallOverturned1.180.03
Jul 11@ SF▼22-2Kyle FreelandFieldingBallOverturned2.620.13
Jul 11@ SF▲81-1Hunter GoodmanBattingStrikeUpheld-1.710.13
Jul 11@ SF▲91-0Edouard JulienBattingStrikeUpheld-0.390.16
Jul 12@ SF▲11-2Kyle KarrosBattingStrikeOverturned0.380.22
Jul 12@ SF▼10-0Hunter GoodmanFieldingBallOverturned0.290.17
Jul 12@ SF▲20-0Cole CarriggBattingStrikeOverturned1.500.10
Jul 12@ SF▼60-0Hunter GoodmanFieldingBallOverturned1.470.06
Jul 10@ SF▼22-1Hunter GoodmanFieldingBallOverturned1.510.21
Jul 10@ SF▲60-0Cole CarriggBattingStrikeOverturned0.740.10
Jul 10@ SF▼60-1Hunter GoodmanFieldingBallOverturned1.600.09
Jul 10@ SF▼61-2Hunter GoodmanFieldingBallUpheld-0.600.29
Jul 10@ SF▼71-0Hunter GoodmanFieldingBallUpheld-3.410.05
Jul 9@ SF▲63-2Tyler FreemanBattingStrikeUpheld-0.640.46
Jul 9@ SF▲93-2Edouard JulienBattingStrikeUpheld-3.400.75
Jul 28@ SD▼10-0Hunter GoodmanFieldingBallOverturned2.320.12
Jul 28@ SD▼80-0Hunter GoodmanFieldingBallUpheld-1.330.12
Apr 11@ SD▼60-0Brett SullivanFieldingBallUpheld-0.480.06
Apr 11@ SD▲82-2Edouard JulienBattingStrikeUpheld-0.600.29
Apr 12@ SD▲73-1Hunter GoodmanBattingStrikeUpheld-1.440.33
Apr 12@ SD▼80-2Brett SullivanFieldingBallOverturned1.650.25
Apr 10@ SD▲11-1Edouard JulienBattingStrikeOverturned0.330.13
Apr 10@ SD▲41-1Mickey MoniakBattingStrikeOverturned0.790.09
Apr 10@ SD▲73-2Jordan BeckBattingStrikeOverturned0.200.63
Apr 10@ SD▼70-1Brett SullivanFieldingBallOverturned1.130.07
Apr 10@ SD▼71-2Brett SullivanFieldingBallOverturned1.850.09
Apr 10@ SD▲81-1Hunter GoodmanBattingStrikeOverturned1.440.08
Apr 10@ SD▲80-0Jordan BeckBattingStrikeUpheld-1.730.11
Apr 10@ SD▼83-0Brett SullivanFieldingBallOverturned0.900.22
Apr 10@ SD▼82-0Brett SullivanFieldingBallUpheld-0.860.09
Apr 9@ SD▲20-0TJ RumfieldBattingStrikeOverturned2.610.06
Apr 9@ SD▼20-0Hunter GoodmanFieldingBallOverturned0.020.03
Apr 9@ SD▼40-0Hunter GoodmanFieldingBallOverturned1.660.12
Apr 9@ SD▲62-1Troy JohnstonBattingStrikeUpheld-0.830.21
Apr 9@ SD▲71-0Willi CastroBattingStrikeUpheld-3.560.16
Apr 9@ SD▼110-0Brett SullivanFieldingBallOverturned1.790.08
May 14@ PIT▼12-0Hunter GoodmanFieldingBallUpheld-1.520.19
May 14@ PIT▼81-2Hunter GoodmanFieldingBallOverturned0.560.15
May 12@ PIT▼80-0Hunter GoodmanFieldingBallOverturned0.580.11
May 13@ PIT▼20-0Brett SullivanFieldingBallOverturned2.550.10
May 13@ PIT▼51-1Brett SullivanFieldingBallOverturned0.360.13
May 13@ PIT▲72-2Brett SullivanBattingStrikeOverturned1.870.22
May 10@ PHI▲80-1Edouard JulienBattingStrikeUpheld-1.790.08
May 8@ PHI▼83-2Hunter GoodmanFieldingBallUpheld-1.301.01
May 9@ PHI▲11-2Edouard JulienBattingStrikeOverturned1.720.20
May 9@ PHI▲11-1TJ RumfieldBattingStrikeUpheld-0.930.10
May 9@ PHI▲43-2Jake McCarthyBattingStrikeOverturned0.580.46
May 9@ PHI▲81-2Willi CastroBattingStrikeUpheld-3.110.22
Sep 9@ NYY▲13-2Cole CarriggBattingStrikeUpheld-2.070.43
Sep 9@ NYY▼72-0Brett SullivanFieldingBallOverturned1.050.20
Sep 10@ NYY▲21-1TJ RumfieldBattingStrikeUpheld-0.050.13
Sep 10@ NYY▼61-1Hunter GoodmanFieldingBallOverturned1.180.17
Sep 10@ NYY▼73-2Hunter GoodmanFieldingBallOverturned0.730.24
Sep 8@ NYY▼20-1Hunter GoodmanFieldingBallOverturned0.070.14
Sep 8@ NYY▲62-1Cole CarriggBattingStrikeUpheld-0.600.13
Sep 8@ NYY▲80-0Adael AmadorBattingStrikeUpheld-0.320.10
Apr 26@ NYM▼10-0Brett SullivanFieldingBallUpheld-0.340.12
Apr 26@ NYM▼13-2Brett SullivanFieldingBallOverturned0.041.75
Apr 26@ NYM▲71-2Ezequiel TovarBattingStrikeOverturned0.730.45
Apr 26@ NYM▼33-2Hunter GoodmanFieldingBallOverturned0.740.43
Apr 26@ NYM▼30-0Hunter GoodmanFieldingBallUpheld-0.800.03
Apr 24@ NYM▲21-2Kyle KarrosBattingStrikeOverturned0.530.15
Apr 24@ NYM▲70-2Jordan BeckBattingStrikeOverturned0.480.34
Apr 24@ NYM▲92-2Troy JohnstonBattingStrikeUpheld-2.950.22
Jun 28@ MIN▼62-0Braxton FulfordFieldingBallOverturned0.420.16
Jun 28@ MIN▼60-0Braxton FulfordFieldingBallUpheld-1.770.05
Jun 26@ MIN▲41-2Willi CastroBattingStrikeUpheld-0.280.29
Jun 27@ MIN▲62-2Willi CastroBattingStrikeUpheld-1.220.44
Jun 27@ MIN▲82-1Cole CarriggBattingStrikeUpheld-2.640.21
Jul 26@ MIL▼12-1Hunter GoodmanFieldingBallOverturned3.070.21
Jul 26@ MIL▼63-1Kyle FreelandFieldingBallUpheld-0.100.21
Jul 25@ MIL▼30-0Braxton FulfordFieldingBallUpheld-0.220.10
Mar 29@ MIA▼42-2Jose QuintanaFieldingBallUpheld-2.470.29
Mar 29@ MIA▼70-0Brett SullivanFieldingBallOverturned0.960.03
Jul 8@ LAD▼31-1Brett SullivanFieldingBallOverturned0.660.05
Jul 8@ LAD▼62-2Brett SullivanFieldingBallUpheld-0.270.22
Jul 7@ LAD▲31-2Kyle KarrosBattingStrikeUpheld-1.260.39
Jul 7@ LAD▲80-1Cole CarriggBattingStrikeOverturned1.180.09
Jul 7@ LAD▼91-1Braxton FulfordFieldingBallOverturned2.500.13
Jul 7@ LAD▼90-0Braxton FulfordFieldingBallOverturned1.420.11
Jul 7@ LAD▼90-1Braxton FulfordFieldingBallOverturned1.770.09
Jul 6@ LAD▼30-0Hunter GoodmanFieldingBallOverturned0.070.03
Jul 6@ LAD▲52-2Kyle KarrosBattingStrikeOverturned2.590.22
Jul 6@ LAD▲83-1Hunter GoodmanBattingStrikeOverturned0.140.33
Jul 6@ LAD▼90-2Hunter GoodmanFieldingBallOverturned2.640.34
May 27@ LAD▲21-2Willi CastroBattingStrikeUpheld-2.580.15
May 27@ LAD▲52-1Edouard JulienBattingStrikeUpheld-0.600.21
May 25@ LAD▲62-0Edouard JulienBattingStrikeUpheld-0.530.24
May 25@ LAD▲91-0Troy JohnstonBattingStrikeUpheld-0.160.16
May 26@ LAD▼51-0Hunter GoodmanFieldingBallOverturned1.790.23
May 26@ LAD▲81-1Sterlin ThompsonBattingStrikeUpheld-0.900.09
Jun 3@ LAA▼21-2Hunter GoodmanFieldingBallOverturned0.600.33
Jun 3@ LAA▲43-2Sterlin ThompsonBattingStrikeUpheld-0.970.75
Jun 3@ LAA▲62-2Willi CastroBattingStrikeUpheld-1.580.13
Jun 2@ LAA▲71-1Sterlin ThompsonBattingStrikeOverturned1.070.05
Jun 2@ LAA▼91-0Hunter GoodmanFieldingBallUpheld-0.700.12
Jun 2@ LAA▼90-0Hunter GoodmanFieldingBallOverturned0.340.12
Jun 1@ LAA▲12-0Willi CastroBattingStrikeOverturned0.370.19
Jun 1@ LAA▼11-0Hunter GoodmanFieldingBallOverturned0.500.20
Jun 1@ LAA▲32-1Willi CastroBattingStrikeUpheld-0.940.34
Jun 1@ LAA▲81-1Sterlin ThompsonBattingStrikeUpheld-0.310.13
Apr 16@ HOU▲30-0Tyler FreemanBattingStrikeUpheld-1.600.22
Apr 16@ HOU▲71-2Hunter GoodmanBattingStrikeOverturned2.910.75
Apr 15@ HOU▲61-1Jordan BeckBattingStrikeUpheld-1.390.10
Apr 15@ HOU▲91-1Edouard JulienBattingStrikeOverturned2.010.09
Apr 14@ HOU▲62-0Tyler FreemanBattingStrikeOverturned1.950.09
Apr 14@ HOU▲83-1Mickey MoniakBattingStrikeUpheld-1.290.24
Sep 12@ DET▲40-0Adael AmadorBattingStrikeUpheld-1.580.12
Sep 12@ DET▼40-0Hunter GoodmanFieldingBallUpheld-0.070.16
Sep 13@ DET▲12-0Adael AmadorBattingStrikeUpheld-0.180.20
Sep 13@ DET▼20-0Brett SullivanFieldingBallOverturned0.990.05
Sep 13@ DET▼73-2Brett SullivanFieldingBallOverturned0.190.63
Sep 11@ DET▲50-0Cole CarriggBattingStrikeOverturned2.490.23
Sep 11@ DET▲92-1Zac VeenBattingStrikeOverturned0.950.21
Sep 24vs AZ▲12-2Brett SullivanFieldingBallUpheld-0.540.29
Sep 24vs AZ▲40-0Brett SullivanFieldingBallOverturned1.030.10
Sep 20vs SEA▼51-1Brett SullivanBattingStrikeUpheld-1.730.09
Sep 20vs SEA▼90-0Adael AmadorBattingStrikeOverturned0.360.06
Sep 23vs AZ▲10-2Hunter GoodmanFieldingBallOverturned0.810.23
Sep 23vs AZ▲30-0Hunter GoodmanFieldingBallOverturned0.740.03
Sep 23vs AZ▲30-1Hunter GoodmanFieldingBallOverturned1.260.03
Sep 23vs AZ▼31-2Cole CarriggBattingStrikeOverturned1.070.51
Sep 23vs AZ▲61-1Hunter GoodmanFieldingBallUpheld-0.270.17
Sep 23vs AZ▲70-1Hunter GoodmanFieldingBallOverturned1.450.07
Sep 22vs AZ▲91-2Hunter GoodmanFieldingBallUpheld-2.130.22
Sep 18vs SEA▼30-0Kyle KarrosBattingStrikeOverturned3.940.11
Sep 18vs SEA▲70-0Hunter GoodmanFieldingBallOverturned2.460.06
Sep 19vs SEA▲53-1Hunter GoodmanFieldingBallOverturned0.350.11
Sep 17vs SD▲23-2Brett SullivanFieldingBallUpheld-0.070.68
Sep 16vs SD▲11-1Braxton FulfordFieldingBallOverturned0.540.33
Sep 16vs SD▲40-1Braxton FulfordFieldingBallOverturned0.920.12
Sep 15vs SD▼81-2Cole CarriggBattingStrikeUpheld-2.800.20
Sep 14vs SD▲41-2Hunter GoodmanFieldingBallOverturned0.870.29
Sep 6vs STL▲20-0Brett SullivanFieldingBallOverturned1.150.08
Sep 6vs STL▼23-2Vimael MachínBattingStrikeUpheld-0.710.43
Sep 6vs STL▲93-2Blas CastañoFieldingBallUpheld-1.610.63
Sep 5vs STL▲11-1Hunter GoodmanFieldingBallOverturned0.480.17
Sep 5vs STL▲40-2Hunter GoodmanFieldingBallOverturned2.080.17
Sep 5vs STL▲51-2Hunter GoodmanFieldingBallOverturned1.750.27
Sep 5vs STL▼52-0Cole CarriggBattingStrikeUpheld-0.790.13
Sep 4vs STL▲71-1Hunter GoodmanFieldingBallOverturned1.000.09
Sep 4vs STL▼70-1Hunter GoodmanBattingStrikeOverturned0.540.08
Sep 4vs STL▼81-0Jake McCarthyBattingStrikeOverturned0.180.08
Sep 4vs STL▲90-0Hunter GoodmanFieldingBallUpheld-2.000.12
Sep 2vs BAL▼40-0Connor NorbyBattingStrikeUpheld-0.090.10
Sep 2vs BAL▼70-0Cole CarriggBattingStrikeUpheld-2.400.06
Sep 2vs BAL▼110-0Cole CarriggBattingStrikeUpheld-0.310.06
Sep 1vs BAL▲33-2Brett SullivanFieldingBallOverturned0.571.01
Sep 1vs BAL▲50-0Brett SullivanFieldingBallOverturned2.650.06
Sep 1vs BAL▼60-0Adael AmadorBattingStrikeOverturned2.310.12
Aug 31vs BAL▲60-1Hunter GoodmanFieldingBallOverturned1.220.08
Aug 31vs BAL▼60-2Willi CastroBattingStrikeUpheld-2.200.15
Aug 23vs CLE▲42-2Brett SullivanFieldingBallUpheld-1.300.41
Aug 23vs CLE▲50-0Brett SullivanFieldingBallUpheld-2.250.12
Aug 22vs CLE▲43-2Brett SullivanFieldingBallUpheld-0.220.46
Aug 21vs CLE▼80-2Willi CastroBattingStrikeUpheld-2.000.15
Aug 19vs LAD▲11-0Brett SullivanFieldingBallOverturned1.250.12
Aug 19vs LAD▲41-0Brett SullivanFieldingBallOverturned0.820.16
Aug 19vs LAD▼40-0Adael AmadorBattingStrikeUpheld-2.910.20
Aug 19vs LAD▼50-1Cole CarriggBattingStrikeUpheld-0.040.03
Aug 18vs LAD▼12-1TJ RumfieldBattingStrikeUpheld-2.440.21
Aug 17vs LAD▼30-0Jordan BeckBattingStrikeUpheld-1.230.07
Aug 17vs LAD▲70-1Brett SullivanFieldingBallOverturned1.020.07
Aug 17vs LAD▼80-2Zac VeenBattingStrikeUpheld-2.160.15
Aug 4vs TB▼30-0Cole CarriggBattingStrikeOverturned0.970.25
Aug 4vs TB▼40-0Cole CarriggBattingStrikeUpheld-0.210.06
Aug 4vs TB▼60-0Jordan BeckBattingStrikeUpheld-1.280.03
Aug 5vs TB▼91-2Edouard JulienBattingStrikeUpheld-0.820.09
Aug 2vs KC▼52-1TJ RumfieldBattingStrikeOverturned2.450.08
Aug 2vs KC▲61-2Brett SullivanFieldingBallOverturned0.100.09
Aug 2vs KC▲90-0Brett SullivanFieldingBallUpheld-0.920.16
Aug 3vs TB▲60-2Hunter GoodmanFieldingBallOverturned2.050.07
Aug 3vs TB▼73-1Kyle KarrosBattingStrikeUpheld-2.330.21
Aug 3vs TB▼80-0Willi CastroBattingStrikeUpheld-3.260.10
Jul 31vs KC▲80-0Hunter GoodmanFieldingBallOverturned1.230.06
Jul 31vs KC▲91-0Hunter GoodmanFieldingBallOverturned2.390.05
Aug 1vs KC▼41-2Kyle KarrosBattingStrikeOverturned1.610.27
Aug 1vs KC▼80-0Cole CarriggBattingStrikeOverturned0.960.12
Aug 1vs KC▲91-2Hunter GoodmanFieldingBallUpheld-2.720.47
Jul 22vs WSH▲32-1Brett SullivanFieldingBallUpheld-0.780.14
Jul 22vs WSH▲40-0Brett SullivanFieldingBallOverturned2.620.11
Jul 22vs WSH▼41-2Kyle KarrosBattingStrikeOverturned3.210.27
Jul 22vs WSH▼43-2Kyle KarrosBattingStrikeOverturned1.100.59
Jul 22vs WSH▼80-0Cole CarriggBattingStrikeUpheld-4.110.11
Jul 20vs WSH▼30-1Cole CarriggBattingStrikeUpheld-2.190.09
Jul 20vs WSH▲40-0Kyle FreelandFieldingBallOverturned0.860.06
Jul 21vs WSH▼61-0Cole CarriggBattingStrikeOverturned0.500.26
Jul 21vs WSH▲71-2Hunter GoodmanFieldingBallUpheld-1.340.48
Jul 19vs CIN▲20-0Hunter GoodmanFieldingBallOverturned1.190.16
Jul 19vs CIN▲61-0Hunter GoodmanFieldingBallOverturned0.460.12
Jul 19vs CIN▼62-2Willi CastroBattingStrikeUpheld-2.970.13
Jul 19vs CIN▼90-0Tyler FreemanBattingStrikeOverturned1.420.12
Jul 19vs CIN▼92-2Tyler FreemanBattingStrikeUpheld-2.060.39
Jul 18vs CIN▲70-0Brett SullivanFieldingBallUpheld-0.670.16
Jul 18vs CIN▼81-1Cole CarriggBattingStrikeUpheld-0.770.09
Jul 5vs SF▲40-0Brett SullivanFieldingBallUpheld-0.170.06
Jul 5vs SF▲43-2Brett SullivanFieldingBallOverturned0.780.43
Jul 5vs SF▲62-1Brett SullivanFieldingBallOverturned2.780.21
Jul 4vs SF▲11-1Hunter GoodmanFieldingBallUpheld-1.510.09
Jul 4vs SF▲70-2Hunter GoodmanFieldingBallOverturned2.270.15
Jul 4vs SF▲90-0Hunter GoodmanFieldingBallOverturned0.760.06
Jul 4vs SF▲90-1Hunter GoodmanFieldingBallOverturned0.460.14
Jul 2vs MIA▲52-2Brett SullivanFieldingBallUpheld-1.490.22
Jul 3vs SF▼30-1Kyle KarrosBattingStrikeOverturned3.180.09
Jul 3vs SF▼52-0TJ RumfieldBattingStrikeOverturned1.730.15
Jul 3vs SF▼52-2Edouard JulienBattingStrikeUpheld-1.020.39
Jul 1vs MIA▼70-0Mickey MoniakBattingStrikeOverturned0.690.03
Jul 1vs MIA▲92-2Hunter GoodmanFieldingBallUpheld-1.450.29
Jun 30vs MIA▼10-1TJ RumfieldBattingStrikeOverturned2.380.03
Jun 30vs MIA▼20-0Edouard JulienBattingStrikeOverturned1.410.12
Jun 30vs MIA▲32-2Hunter GoodmanFieldingBallOverturned0.160.13
Jun 30vs MIA▼92-2Edouard JulienBattingStrikeUpheld-2.940.29
Jun 29vs MIA▲21-0Hunter GoodmanFieldingBallOverturned1.790.18
Jun 29vs MIA▲62-0Hunter GoodmanFieldingBallOverturned1.970.15
Jun 29vs MIA▼62-0Edouard JulienBattingStrikeOverturned0.400.19
Jun 29vs MIA▼70-0Hunter GoodmanBattingStrikeOverturned2.490.06
Jun 29vs MIA▼90-1Edouard JulienBattingStrikeOverturned0.340.08
Jun 23vs BOS▲32-0Hunter GoodmanFieldingBallOverturned1.420.19
Jun 23vs BOS▲32-2Hunter GoodmanFieldingBallOverturned1.780.87
Jun 23vs BOS▲83-2Hunter GoodmanFieldingBallUpheld-1.120.43
Jun 24vs BOS▼22-2Cole CarriggBattingStrikeUpheld-2.140.29
Jun 24vs BOS▲61-2Braxton FulfordFieldingBallUpheld-0.630.09
Jun 21vs PIT▼21-2Cole CarriggBattingStrikeOverturned0.400.33
Jun 21vs PIT▲30-0Brett SullivanFieldingBallOverturned0.870.06
Jun 21vs PIT▼80-0Willi CastroBattingStrikeOverturned2.210.06
Jun 21vs PIT▼91-0Braxton FulfordBattingStrikeOverturned0.300.16
Jun 22vs BOS▲13-1Hunter GoodmanFieldingBallOverturned0.140.11
Jun 22vs BOS▲70-0Hunter GoodmanFieldingBallOverturned0.160.10
Jun 22vs BOS▲83-2Hunter GoodmanFieldingBallUpheld-0.890.63
Jun 19vs PIT▼60-1Sterlin ThompsonBattingStrikeUpheld-3.700.23
Jun 11vs CHC▲10-0Brett SullivanFieldingBallOverturned1.280.10
Jun 11vs CHC▲22-2Brett SullivanFieldingBallUpheld-1.310.13
Jun 11vs CHC▲53-2Brett SullivanFieldingBallOverturned0.370.46
Jun 11vs CHC▼90-0Edouard JulienBattingStrikeUpheld-0.380.06
Jun 9vs CHC▲31-0Hunter GoodmanFieldingBallUpheld-0.630.16
Jun 9vs CHC▲71-1Hunter GoodmanFieldingBallOverturned0.170.09
Jun 10vs CHC▲41-2Hunter GoodmanFieldingBallUpheld-0.060.22
Jun 10vs CHC▼60-0TJ RumfieldBattingStrikeUpheld-1.190.06
Jun 7vs MIL▲61-1Hunter GoodmanFieldingBallOverturned1.980.13
Jun 7vs MIL▲61-2Hunter GoodmanFieldingBallUpheld-0.320.75
Jun 7vs MIL▼71-0Edouard JulienBattingStrikeOverturned0.660.23
Jun 7vs MIL▲80-1Hunter GoodmanFieldingBallOverturned1.660.08
Jun 7vs MIL▲81-2Hunter GoodmanFieldingBallOverturned1.170.20
Jun 7vs MIL▲92-2Hunter GoodmanFieldingBallUpheld-1.710.30
Jun 5vs MIL▲23-2Hunter GoodmanFieldingBallUpheld-0.860.79
Jun 5vs MIL▼90-0Chad StevensBattingStrikeOverturned1.660.18
Jun 5vs MIL▼101-0Jake McCarthyBattingStrikeOverturned0.380.06
Jun 6vs MIL▲40-2Brett SullivanFieldingBallUpheld-0.040.34
Jun 6vs MIL▲43-2Blas CastañoFieldingBallOverturned1.250.75
Jun 6vs MIL▼51-2Brett SullivanBattingStrikeUpheld-1.800.24
May 29vs SF▼41-1Kyle KarrosBattingStrikeUpheld-0.150.08
May 29vs SF▼60-0Willi CastroBattingStrikeOverturned0.930.10
May 31vs SF▼10-0Willi CastroBattingStrikeUpheld-0.490.10
May 31vs SF▲42-1Braxton FulfordFieldingBallOverturned0.670.21
May 20vs TEX▼43-2Kyle KarrosBattingStrikeOverturned0.931.75
May 20vs TEX▼51-2Tyler FreemanBattingStrikeOverturned0.940.47
May 20vs TEX▲71-0Brett SullivanFieldingBallOverturned1.040.23
May 18vs TEX▼12-0TJ RumfieldBattingStrikeOverturned0.750.29
May 18vs TEX▲20-2Hunter GoodmanFieldingBallUpheld-0.100.22
May 18vs TEX▼33-1Ezequiel TovarBattingStrikeOverturned2.130.29
May 18vs TEX▼60-0Willi CastroBattingStrikeOverturned3.250.12
May 18vs TEX▲81-2Hunter GoodmanFieldingBallUpheld-0.010.45
May 17vs AZ▼92-2TJ RumfieldBattingStrikeOverturned0.110.13
May 16vs AZ▼22-1Kyle KarrosBattingStrikeUpheld-0.430.21
May 16vs AZ▲60-0Hunter GoodmanFieldingBallUpheld-0.740.10
May 15vs AZ▼30-1Mickey MoniakBattingStrikeUpheld-0.960.10
May 15vs AZ▲92-2Hunter GoodmanFieldingBallOverturned1.110.60
May 15vs AZ▼91-1Edouard JulienBattingStrikeOverturned1.650.13
May 6vs NYM▲20-2Hunter GoodmanFieldingBallUpheld-0.470.25
May 6vs NYM▼91-0Tyler FreemanBattingStrikeOverturned1.730.30
May 7vs NYM▲23-2Brett SullivanFieldingBallUpheld-1.511.01
May 7vs NYM▲70-0Brett SullivanFieldingBallUpheld-1.780.06
May 4vs NYM▼60-2Brenton DoyleBattingStrikeUpheld-0.580.15
May 4vs NYM▼83-2Tyler FreemanBattingStrikeUpheld-1.270.79
May 3vs ATL▲31-2Brett SullivanFieldingBallOverturned0.300.39
May 3vs ATL▲63-1Brett SullivanFieldingBallUpheld-1.840.57
May 3vs ATL▲61-0Brett SullivanFieldingBallUpheld-1.690.06
May 2vs ATL▲10-0Hunter GoodmanFieldingBallOverturned1.970.06
May 2vs ATL▲40-0Hunter GoodmanFieldingBallOverturned1.560.08
May 2vs ATL▲63-2Hunter GoodmanFieldingBallUpheld-0.750.43
May 1vs ATL▼40-2Hunter GoodmanBattingStrikeUpheld-0.610.07
May 1vs ATL▲92-0Hunter GoodmanFieldingBallOverturned1.570.24
May 1vs ATL▼91-0Edouard JulienBattingStrikeUpheld-1.520.23
Apr 22vs SD▼32-1Willi CastroBattingStrikeUpheld-2.150.20
Apr 22vs SD▲53-2Hunter GoodmanFieldingBallOverturned0.060.24
Apr 23vs SD▲10-0Brett SullivanFieldingBallOverturned0.490.03
Apr 23vs SD▲30-0Brett SullivanFieldingBallOverturned0.520.20
Apr 23vs SD▲52-0Brett SullivanFieldingBallUpheld-0.890.09
Apr 23vs SD▲82-1Brett SullivanFieldingBallUpheld-0.030.08
Apr 21vs SD▼70-0TJ RumfieldBattingStrikeUpheld-0.160.10
Apr 21vs SD▲90-0Hunter GoodmanFieldingBallOverturned3.990.06
Apr 21vs SD▲92-2Hunter GoodmanFieldingBallOverturned0.950.56
Apr 20vs LAD▼60-1Ezequiel TovarBattingStrikeUpheld-0.920.07
Apr 20vs LAD▲81-0Brett SullivanFieldingBallOverturned0.650.10
Apr 20vs LAD▼80-2Hunter GoodmanBattingStrikeUpheld-0.600.15
Apr 19vs LAD▲20-1Michael LorenzenFieldingBallOverturned0.140.08
Apr 19vs LAD▲30-0Michael LorenzenFieldingBallUpheld-1.790.06
Apr 19vs LAD▲31-0Hunter GoodmanFieldingBallOverturned1.310.12
Apr 19vs LAD▼70-0Ezequiel TovarBattingStrikeUpheld-1.330.06
Apr 18vs LAD▼11-0Edouard JulienBattingStrikeOverturned0.800.16
Apr 18vs LAD▲31-0Hunter GoodmanFieldingBallOverturned2.390.16
Apr 18vs LAD▲81-2Hunter GoodmanFieldingBallOverturned3.280.63
Apr 18vs LAD▲83-1Hunter GoodmanFieldingBallUpheld-0.880.19
Apr 17vs LAD▲11-0Brett SullivanFieldingBallUpheld-0.560.11
Apr 17vs LAD▼91-1TJ RumfieldBattingStrikeUpheld-0.870.13
Apr 8vs HOU▲62-1Hunter GoodmanFieldingBallUpheld-0.170.13
Apr 8vs HOU▲92-1Hunter GoodmanFieldingBallOverturned0.620.14
Apr 7vs HOU▲10-2Brett SullivanFieldingBallOverturned1.320.07
Apr 7vs HOU▼41-0Jordan BeckBattingStrikeOverturned1.040.05
Apr 7vs HOU▼51-2Kyle KarrosBattingStrikeUpheld-1.260.33
Apr 7vs HOU▲60-2Brett SullivanFieldingBallOverturned0.960.17
Apr 6vs HOU▼33-2Kyle KarrosBattingStrikeUpheld-0.610.63
Apr 6vs HOU▼50-0Troy JohnstonBattingStrikeUpheld-0.280.07
Apr 3vs PHI▲10-0Hunter GoodmanFieldingBallOverturned1.210.06
Apr 3vs PHI▼50-0Hunter GoodmanBattingStrikeUpheld-0.340.06
Apr 3vs PHI▼80-1Hunter GoodmanBattingStrikeUpheld-1.140.07
Apr 4vs PHI▼23-2Ezequiel TovarBattingStrikeUpheld-1.920.63
Apr 4vs PHI▲33-2Brett SullivanFieldingBallOverturned2.210.43
Apr 4vs PHI▲60-1Brett SullivanFieldingBallUpheld-2.290.08
Apr 5vs PHI▲43-2Hunter GoodmanFieldingBallOverturned0.970.63
Apr 5vs PHI▲52-0Hunter GoodmanFieldingBallOverturned0.660.20
Apr 5vs PHI▲81-2Hunter GoodmanFieldingBallOverturned0.140.15
Apr 30@ CIN▼60-0Hunter GoodmanFieldingBallOverturned0.460.07
Apr 30@ CIN▲72-2Troy JohnstonBattingStrikeUpheld-2.250.44
Apr 29@ CIN▼22-1Brett SullivanFieldingBallUpheld-0.100.21
Sep 26@ CWS▲20-1Cole CarriggBattingStrikeOverturned0.010.03
Sep 26@ CWS▲51-0Connor NorbyBattingStrikeUpheld-0.640.05
Sep 25@ CWS▲63-2Kyle KarrosBattingStrikeOverturned1.450.52
Jun 15@ CHC▲62-0Troy JohnstonBattingStrikeUpheld-1.540.28
Jun 15@ CHC▼73-0Brett SullivanFieldingBallUpheld-0.370.18
Jun 17@ CHC▼40-0Hunter GoodmanFieldingBallOverturned0.480.12
Jun 17@ CHC▼82-2Hunter GoodmanFieldingBallOverturned1.170.56
Aug 29@ ATL▼10-2Hunter GoodmanFieldingBallUpheld-1.250.23
Aug 30@ ATL▼91-1Brett SullivanFieldingBallOverturned2.140.13
Aug 28@ ATL▲41-1Connor NorbyBattingStrikeUpheld-0.930.19
Aug 28@ ATL▲50-0Cole CarriggBattingStrikeOverturned0.700.12
Aug 28@ ATL▼60-0Hunter GoodmanFieldingBallOverturned2.640.06
Jun 14@ ATH▲11-0Willi CastroBattingStrikeUpheld-1.400.16
Jun 14@ ATH▼10-0Hunter GoodmanFieldingBallOverturned0.300.10
Jun 14@ ATH▼12-2Hunter GoodmanFieldingBallOverturned0.780.44
Jun 14@ ATH▼20-1Hunter GoodmanFieldingBallUpheld-0.040.07
Jun 13@ ATH▲90-0Sterlin ThompsonBattingStrikeUpheld-2.400.03
Jun 12@ ATH▲30-1TJ RumfieldBattingStrikeUpheld-4.610.03
Aug 11@ AZ▼51-2Tomoyuki SuganoFieldingBallOverturned0.050.15
Aug 12@ AZ▼10-0Brett SullivanFieldingBallOverturned0.110.17
Aug 12@ AZ▼30-0Brett SullivanFieldingBallUpheld-0.380.12
Aug 12@ AZ▲43-1Willi CastroBattingStrikeOverturned2.340.33
Aug 12@ AZ▼62-2Brett SullivanFieldingBallOverturned0.530.82
Aug 12@ AZ▲81-1Willi CastroBattingStrikeUpheld-1.160.13
Aug 10@ AZ▼10-0Hunter GoodmanFieldingBallUpheld-0.550.05
May 23@ AZ▼31-1Hunter GoodmanFieldingBallOverturned1.710.17
May 22@ AZ▼92-1Hunter GoodmanFieldingBallOverturned0.510.21
May 21@ AZ▼90-0Hunter GoodmanFieldingBallUpheld-0.400.08

Three things stood out, and one of them is a caution. First, the bottom edge. Hitters’ challenges nearest the bottom of the zone succeeded 25 of 73 times, 34%, against 49% for other clubs’ hitters (−2.5 standard deviations from the league rate). Colorado’s catchers and pitchers, by contrast, did unusually well at the same edge: 52 of 73, 71% against 59%. I looked at six combinations of role and edge, so one at 2.5 deviations is suggestive, not established. As a check I looked at 2026 spring training, where Colorado hitters went 4 for 9 at the bottom edge to others’ 2 for 6. That’s far too small a sample to confirm or refute anything.

Second, where hitters place their bets. Colorado’s hitters challenged more called strikes that were correct by two to three inches (13% of their challenges against 8%) and fewer that were clearly balls by one to two inches (10% against 16%). That’s where the weaker pitch selection comes from.

Third, a caution. 683 of the calls against Colorado were wrong and challengeable (the club had a challenge in hand, ABS was running and no position player was pitching), which exactly matches Savant’s count. 682 of them have full game context, and those are the ones the numbers below use. Colorado overturned 209 of them, 31%, against 25% league-wide. That leaves 473 on the table, which makes for a tempting headline. But 318 of them (67%) were within an inch of the line, a distance no player can judge from the box or from behind the plate. Only 42 were two inches or more off, and not one of those was worth 0.30 runs or more. Savant’s unrealized-value number is real, but most of it was out of anyone’s reach.

3 The players behind the numbers

A challenger who goes 4 for 5 isn’t necessarily better than one who goes 35 for 65. To compare people fairly, I counted each challenger’s overturns against what the pitches he chose would normally produce, using only what a player could plausibly see: the rough location, the call, the count and the situation, never the exact margin. Then, because small samples exaggerate, I pulled every estimate back toward the league average by however much real skill differences among players appear to matter.

Colorado’s value on the catching and pitching side comes down to two people. Goodman and Sullivan made 188 of the club’s 208 challenges in that group. Goodman won 77 of 113 (68%) on pitches that predict 69, +7.8 above expectation, and Savant’s own RAA ranks him second among 107 MLB catchers (+3.95, behind Atlanta’s Jonah Heim, +4.30). Real skill differences among catchers and pitchers are small, about 3.7 points per challenge, so after adjusting for the small sample his estimate is smaller: about +2.8 points per challenge (95% range −2.6 to +8.1), or about 3 extra overturns over the season. That range includes zero, so I’d call it a lean, not a finding. Sullivan won 44 of 75, matching his expectation (−1.5 overturns), so whatever produced his +1.65 RAA, it wasn’t a better-than-expected hit rate.

Among hitters, the data can’t reliably rank anyone. Across 229 MLB hitters with at least 8 challenges, I estimate the real spread in skill at about 1.1 points per challenge, against 12 points of luck in a typical hitter’s record. That estimate depends on my model, so I’d read it as “small,” not “zero.” Willi Castro won 6 of 24 against 9 expected, and Cole Carrigg 12 of 27 against 14. Those are the club’s most visible lows, and with these sample sizes neither can be told apart from an average hitter. I wouldn’t build a bad-decisions story on them.

Figure 5Player profilesSelect a player to see where their challenges landed.
MLB 58%0%25%50%75%100%Goodman77/113Sullivan44/75Fulford7/10

Dot = observed overturn rate; whisker = 95% range; tick = rate expected from the pitches/situations they chose. Only players with ≥ 5 challenges.

Hunter Goodman

Challenges77/11368% overturned
Expected69.2overturns on those pitches
Above expected+7.8± 9.0 (95%)
Savant RAA+3.9577 of 184 chances taken

After adjusting for the small sample by pulling toward the MLB average (real skill differences among the 86 fielding challengers with ≥ 15 challenges look to be about 3.7 points per challenge, against about 6 points of luck in a typical record), the adjusted estimate for Goodman is +2.8 points per challenge versus expectation (95% range −2.6 to +8.1), which includes zero. Expected overturns come from my model, and this range does not include uncertainty in that model.

113 challenged pitches. 77 overturned (●), 36 upheld (✕).

4 What a challenge is worth

A reversed call is worth the difference in run expectancy between a ball and a strike in that exact count, with that many outs and those runners on. At 0-0 with two out and nobody on, that’s 0.03 runs. At 3-2 with two out and the bases loaded, it’s 1.75. Six Colorado challenges show the range. Select one to step through the call, the tracked pitch, the ruling and the consequence. I only show where the ball crossed the plate, because the data don’t support drawing a flight path.

Figure 6Reconstructing six real challengesChosen for stakes and range, not for how they ended: two saved strikeouts, a bases-loaded walk, a miss by a hundredth of an inch.
UMPIRE: BALL
Bottom 1st · 2 out · 1B/2B/3B (loaded) · tied · count 3-2

Brett Baty vs Jose Quintana

Road game at NYM, Apr 26. Brett Sullivan challenged for Colorado’s defense.

The umpire called ball on a SI at 91 mph. If it stands: ball four — walk. Challenges must be made immediately, with no replay review.

  • Original call: ball — ball four — walk.
  • ABS ruling: strike — strike three — out.

The cost side is less obvious. Winning a challenge costs nothing, but losing one costs you a future option. Savant’s documentation uses a rule of thumb of 0.2 runs. I estimated it from the data instead, by comparing how clubs fared in games where they started an inning holding two challenges versus one (or one versus none). That works out to about 0.047 runs per lost challenge, or 0.043 using only the 4,331 of 4,754 lost challenges with enough comparable games. For first-inning losses, which have nothing to compare against, I assumed one challenge is worth 60% of two. This is a comparison, not proof of cause and effect: clubs that kept their challenges may differ in skill or opportunity. The average club ends a game with 1.0 challenges unspent (Colorado: 0.9), which is why the number comes out small. At a cost nearer 0.2, failed challenges would matter far more, so everything below depends on this estimate. Using it, the best “skip the low-stakes ones” rule I could find for hitters, tuned on the other 29 clubs, added 0.03 runs per club in the sample and 0.05 runs for Colorado’s hitters (range −0.17 to +0.28). That’s close to nothing.

The lab below shows the break-even for any situation: how sure a player has to be before challenging pays off. It can’t tell you how sure he actually is, and that gap is the whole problem.

Figure 7The challenge decision labIllustrative expected-value model. Not a play-calling rule.
Count
Runners
Challenges
Cost of losing a challenge
break-even 42%
Called pitch against youCHALLENGE1-1, 1 out, bases emptySAVE THE CHALLENGENothing changes · value 050% wrong: +0.09 runs, keep it50% right: −0.064 runs, lose it+0.012 runsEXPECTED VALUE OF CHALLENGING= 50% × 0.09 − 50% × 0.064Break-even = cost ÷ (cost + flip value) = 42.4%

Challenge. At 50% confidence this clears the 42.4% break-even.

Reality check · count 1-1, all of MLB48% of hitters’ challenges succeeded (n = 518)61% of fielders’ challenges succeeded (n = 523)
  • Illustrative, not a play-calling rule. “Belief” is a probability you must form from sight alone; the exact pitch location is unknown until after the ruling.
  • Flip value = change in run expectancy between a called ball and a called strike from this count, out and base state (a run-expectancy table built from 2026 pitches).
  • “This study” cost = the difference in average future gain between games where a club held r challenges and games where it held r−1 at this inning (0.047 runs on average over upheld challenges; 0.043 using only the 4,331 of 4,754 where both groups have enough games; the rest, mostly first-inning losses, assume one challenge is worth 60% of two). It is a comparison, not proof of cause and effect: clubs that kept their challenges may differ in other ways. Savant’s documentation uses a 0.2-run rule of thumb; the 0.21 option is the flat loss implied by its leaderboard totals.
  • Ignores win probability beyond run expectancy, who is batting or pitching, and how a flipped call changes later pitches.

So how much would a better challenger be worth? I replayed every club’s season using a simple rule: challenge only when the odds clear the break-even. The catch is that the rule can’t see the exact location. It gets a blurry version of where the ball crossed, plus the count, the situation, the pitch type and how many challenges are left, and it keeps track of its own challenges. It never sees the ABS ruling. Everything the rule relies on was set using games other than the ones being scored.

Figure 8The value of seeing the pitchRuns per club-season that the break-even rule adds over what clubs actually did, depending on how precisely a player can see the pitch. Each quarter of the season is scored using settings learned from the other three. The table beneath scores only the final quarter, as a true out-of-sample test.
−20−15−10−50+5+10+150 in1 in2 in3 in4 inHow blurry the player’s view of pitch location is (std. dev., inches) →Runs a season vs actualball diameter 2.9 inMLB average clubColorado
Same replay, two ways of scoring it. Retrospective: each quarter scored with parts fitted on the other three. Prospective: last quarter only, everything fitted on earlier dates.
BlurSeason, avg clubSeason, ColoradoLast 41 games, avg clubLast 41 games, Colorado (95% range)
0 in+13.2+5.8+2.7+0.7 (−2.6 to +4.1)
1 in+11.8+3.2+2.1−0.7 (−4.1 to +2.7)
2 in+3.9−6.9+0.3−3.1 (−6.1 to −0.2)
3 in−3.9−13.9−2.0−4.3 (−7.3 to −1.3)
4 in−8.9−16.1−2.9−5.0 (−7.7 to −2.4)

Read this as a what-if, not a forecast. If a player could place the pitch to within an inch, the rule would add +11.8 runs a season over what the average club actually did, but only +3.2 over what Colorado did; Colorado ranks 28th of 30 in room to improve. At two inches the average club’s gain shrinks to +3.9, and the rule falls below Colorado’s actual choices (−6.9). At three inches it loses for nearly everyone. In the last 41 games (August 14 to September 27), which nothing was set on, the pattern holds: at two inches the rule gains +0.28 runs per club and loses −3.06 to Colorado (range −6.1 to −0.2). So Colorado’s challengers already decide better than a rule that sees to within two inches, and a smarter rule would need much sharper sight than that to help. I tried seven settings for one family of rules, so this doesn’t show that no rule could do better, and the amount of blur is my assumption, not a measured limit. It’s also a static replay: it doesn’t change later pitches when a call flips.

5 Does Coors Field matter?

It’s the obvious question for this club. I found no clear difference, which isn’t the same as proving there is none. Colorado challenged 4.0% of its opportunities at home and 3.3% on the road, won 54% against 54%, and gained about the same value over expectation per game. For all challenges together, every range includes zero. For catchers and pitchers alone, the challenge-rate range only just excludes it (+0.7 points, +0.05 to +1.45); with twelve comparisons on the page, one barely clearing zero is about what chance would produce. League-wide, umpires were wrong on 6.52% of eligible called pitches at Coors and 6.46% elsewhere (11th highest of 30 parks), and visiting clubs challenged 3.0% of their opportunities there against 3.1% elsewhere. I won’t attribute anything to altitude that the data don’t show, and I can’t rule out small effects.

Figure 9Coors Field versus the roadHome minus road, with 95% ranges that account for game-to-game luck.
Coors Field208 challenges · 113 overturned
On the road178 challenges · 96 overturned
Challenges per opportunityCoors 4.0% · road 3.3%
+0.7 pts0.0 to +1.4
Overturn rateCoors 54% · road 54%
+0.4 pts−9.1 to +10.0
Umpire wrong-call rate on pitches against ColoradoCoors 6.8% · road 6.0%
+0.8 pts−0.1 to +1.8
Run value vs expected, per gameCoors +0.059 · road +0.047
+0.013 runs−0.061 to +0.083

Home − road. Bars are 95% ranges that account for game-to-game luck (162 games in total); a bar that crosses the centre line is consistent with no difference, which is not the same as showing there is none. Twelve intervals are on offer across the three scopes, so one that barely clears zero is expected by chance. Axis spans ±3 points for the two rates, ±20 points for overturn rate, ±0.15 runs for run value.

Context from the whole league. Across every club, 6.52% of eligible called pitches at Coors were wrong versus 6.46% elsewhere (Coors ranks 11th of 30 parks; the park-to-park spread is ±0.23%). Visiting clubs challenged 3.0% of their opportunities there (163 of 5,427) against 3.1% elsewhere, winning 56% versus 54%. Both clubs combined, the Coors rate is 3.5% against 3.1%; that figure mixes in Colorado’s own home behavior and is not a visitor measure.

6 What Colorado could do next

None of these says “challenge less” or “challenge more.” Colorado is already near the frontier on volume, and the cost of a lost challenge is small. For each recommendation I list what I saw, why I believe it, what it might be worth, what could be wrong and how to test it.

A Make hitters’ challenge confidence measurable

What I saw
Hitters led MLB in volume and ranked 29th in selection; their bottom-edge challenges won 34% against 49% league-wide.
Why I believe it
Selection cost −2.8 runs (−6.1 to +0.5). The bottom-edge result is −2.5 standard deviations from the league rate, one of six comparisons. Spring training was too thin to test it.
What it could be worth
Bringing selection to average is worth about 3 runs a season if the point estimate is right. The range runs from about break-even to 6 runs, so plan for less.
What could be wrong
I can’t distinguish hitter-to-hitter skill differences from zero, so this is a team-wide calibration question, not a personnel one.
How to test it
Log a three-level confidence (sure / lean / guess) before each 2027 challenge, spring included. Write down the bottom-edge hypothesis in advance, and each month score how well confidence matched results.

B Count challenge skill in catcher decisions

What I saw
Catchers and pitchers were MLB’s best side (+6.1 RAA). Goodman ranks second of 107 catchers (+3.95).
Why I believe it
77/113 against 69 expected. After adjusting for the small sample, his edge is +2.8 ± 5.4 points (95%). Real skill differences among catchers and pitchers look modest (3.7 points).
What it could be worth
Savant credits Goodman +4.0 runs against average. My adjusted estimate of his selection edge alone is 3 extra overturns, about 0.6 runs. It’s worth weighing alongside framing and receiving when deciding catcher playing time, but not worth overriding them.
What could be wrong
One season, and only 113 challenges. The small-sample adjustment cuts the raw edge by more than half.
How to test it
Add overturns above expected per 100 opportunities to the catcher report and track it through the season. Watch whether backup catchers pick up Goodman’s approach.

C Measure how well your challengers see the pitch before changing any rule

What I saw
In the what-if replay, a break-even rule helps the average club only if its challengers can locate the pitch to better than about two inches, and Colorado’s actual choices already beat that rule.
Why I believe it
Runs per season over actual behavior, if challengers could place the pitch to within 1, 2 or 3 inches: +11.8, +3.9 and −3.9 for the average club; +3.2, −6.9 and −13.9 for Colorado (28th, 27th and 29th of 30 in room to improve). In the last 41 games at two inches, Colorado was −3.1 (−6.1 to −0.2).
What it could be worth
Unknown until perception is measured. If a Colorado challenger really sees to one inch, the replay implies a few runs a season (+3.2), more for the average club; if not, a better rule gains nothing.
What could be wrong
The blur is an assumption, and real perception isn’t that tidy. I tested one family of rules at seven settings, and a replay can’t capture how a flipped call changes later pitches.
How to test it
Measure each hitter’s and catcher’s location error in spring-training sessions with tracked-pitch replay, assign the challenge role accordingly, and check whether measured precision predicts in-season results.

Methodology

This section is for anyone who wants to check my work. Everything above comes from public MLB data, and I checked my rebuilt numbers against Savant’s published ones wherever I could. I also rebuilt the core results as plain SQL queries and checked them against the Python: The Rockies ABS Analysis, Rebuilt in SQL.

Data and coverage. I used all 2,427 final regular-season games from March 25 through September 27, 2026, pulled on October 30, so later MLB corrections aren’t reflected. Pitch locations, calls and challenge results come from MLB’s StatsAPI game feeds (2427 files). Base-out situations, scores, catchers and a cross-check on locations come from Baseball Savant’s Statcast export (184 daily files). Official totals come from Savant’s ABS leaderboard, documented in its ABS metrics documentation. The rules are in MLB’s announcement. Spring-training games (31 Colorado games, 143 challenges) were used only for the out-of-sample check in chapter 2.

Pitch locations. The game feed measures location at the front of the plate, but the ABS zone is judged at the middle, and Statcast itself moved its location fields to the middle of the plate in 2026. I recalculated each pitch’s position at 8.5 inches behind the front edge from its tracked path. That reproduces Savant’s published values for 404 pitches to within a millionth of a foot. With a 1.45-inch ball radius and the batter-specific zone the feed reports (27% to 53.5% of height), my geometry reproduces all 10,541 located ABS rulings.

Challenges. Challenges on a pitch that ends a plate appearance (strike three, ball four) are recorded at the at-bat level in the feed, not on the pitch, and a straightforward read of the data misses about a quarter of them. After attaching them, I count 10,551 league challenges against Savant’s 10,557 (24 of 30 clubs match exactly, and none differs by more than 2). Colorado reconciles exactly: 386 challenges and 209 overturned, split 178 and 75 for hitters, 208 and 134 for catchers and pitchers. My running count of each team’s challenges left matches the feed in all 4,428 team-games that didn’t go to extra innings.

Opportunities and value. A chance to challenge follows Savant’s definition: a called pitch against the team, a challenge in hand, ABS running in the game (four games lack it) and no position player pitching. After removing 1,780 ineligible called pitches, Colorado had 683 overturnable calls, exactly Savant’s 683 (682 once I set aside one pitch with missing Statcast context, which is the set the percentages use). Across clubs, my counts correlate with Savant’s at r = 0.999, with 21 of 30 clubs matching exactly; Savant also counts some correct-but-close pitches under its “reasonable pitch” rules, so small positive gaps are expected. To value a flipped call, I built a run-expectancy table for all 288 combinations of count, outs and baserunners from 2026 pitches, smoothed where the data were sparse. I adjusted it so it behaves sensibly: more balls never lower the batting team’s value, more strikes never raise it (29 of 288 cells changed, by at most 0.085 runs), and a three-ball count never exceeds the walk it leads to (4 cells). Flip values are therefore never negative; one situation (3-0, two out, runner on third) sits at exactly zero, which the decision lab reports as “no break-even.” Against Savant’s published per-challenge values, my table differs by a median of 0.012 runs.

Models. Two statistical models sit under the analysis. One predicts how often an average club challenges a given pitch (AUC 0.95 on games it hadn’t seen, where 0.50 is a coin flip; log loss 0.081 against 0.143 for a flat rate). The other predicts whether a challenge succeeds (AUC 0.75), using only coarse information a player could have before the ruling. Both were trained on earlier dates and tested on later ones, with whole dates held out together. The success model was over- and under-confident at its extremes, so I recalibrated it on other date blocks without Colorado (out-of-sample log loss 0.580 to 0.567). The what-if replay scores each quarter of the season with settings fitted on the other three; only the last quarter is a true out-of-sample test. Ranges: team and Colorado figures come from re-drawing the season’s games 2,000 times; win-rate ranges use the Wilson method; the player ranges after the small-sample adjustment do not carry through uncertainty in the benchmark model.

Limitations

  • Runs Above Average, volume and selection are measured against a model, not literal runs or wins. Whatever the sign, ten runs is roughly one win.
  • “Expected” uses the true location, so it is a benchmark for describing what happened, not something a player could compute in the box. The success model and the what-if replay use only what a player could plausibly see, and the amount of blur is my assumption.
  • Static replays ignore knock-on effects of flipped calls. The cost of a lost challenge is a league-average comparison, not an optimum or a proven cause and effect. I didn’t identify technical outages beyond the four games without ABS, and extra-inning challenge counts disagree with the feed in 113 team-games, which I left out of validation rather than resolve.
  • I examined six edge comparisons and didn’t adjust for that, so I don’t claim the bottom-edge result as established. The 10,551 league challenges include ten whose Statcast data failed to match up (context fields blank, left out of the run-value work).
  • One season, one club. Nothing here predicts 2027.

Sources, attribution and independence

Every number on this page can be rebuilt from public data; the analysis code, tests and notes are kept with this site’s source. Baseball data © MLB Advanced Media, L.P., used for independent, non-commercial analysis. MLB Advanced Media permits individual, non-commercial, non-bulk use of its data, so this site publishes only Colorado’s own challenge records and league totals, not league-wide pitch-level files. This work is not affiliated with, endorsed by, or reviewed by Major League Baseball or the Colorado Rockies. Names and statistics are used only to report on public play.

← All writing