Bullpen Chaining: How Valuable is Rafael Soriano to the Rays?
Earlier this week, Sky Kalkman published an article on the new ESPN The Max Info blog, detailing the effects of bullpen chaining and why losing Joe Nathan won't destroy the Twins this season. Since I don't have an Insider account, I couldn't read the article, but Sky was gracious enough to share his workbook over at Beyond the Boxscore. And so, since I'm dying for the season to begin and for us to have some real news finally, I figured it'd be nifty to use Sky's workbook to look at how Rafael Soriano affects the Rays' pen this season.
Before we get into the numbers, let's quickly rehash the theory behind "bullpen chaining". If a position player gets injured, it's easy enough to determine who's going to be replacing them and the difference between their productions, right? That's the concept behind measuring a player's WAR (Wins Above Replacement) since if a player gets injured, they're going to be replaced by a bench player or someone from the minors - a "replacement level" player, if you will.
With a relief pitcher, though, it's not so easy. Relievers have specific roles and the best relievers get used in the high-leverage situations, so if a closer gets injured, you won't throw their 5.00 ERA replacement pitcher in to close. Instead, the second best pitcher in the pen gets moved up to close and everyone else in the pen starts seeing slightly higher leverage situations. So how then do you determine a closer's value? Do you measure how more valuable they are than a replacement level pitcher? Do you measure the difference between them and the second best option in the pen? Or is it somewhat of a combination?
What Sky did is calculate the value (as measured by Runs Above Replacement) of the Twins' pen both with and without Nathan, taking into effect a pitcher's ERA, innings pitched, and leverage index. Let's use his workbook and take a look now at how the Rays pen looks both with and without Rafael Soriano.

I included the workbook above so if you want to mess around and try your own numbers in there, feel free. I tried to make this a conservative estimate, using CHONE projections for ERA and IP. I made my best guess for each pitcher's leverage index, although most players corresponded very neatly to the LI's listed. The Rays do have a deep pen, which negates some of the effect of gaining a closer like Soriano, but he is still a great addition. From this analysis, it appears he'll be worth around one win to the Rays this season over what our pen would produce otherwise. If you bump his ERA down to 2.50, though, it's closer to 2 wins.
Anyway, I thought this was a fun little experiment. If you have any questions on leverage index or bullpen chaining, feel free to ask and we'll do our best to answer.
1 recs |
9 comments
|
Comments
Really nice work Steve.
It’s basically marginal diminishing returns to add a really good pitcher to an already good pen. Obviously, if an injury happens it’s nice to have another guy ready to step right in.
"It's good to have a little cushion. But it's not going to be easy."
by Andy Hellicksonstine on Mar 19, 2010 12:49 PM EDT reply actions
Interesting
Just to make sure I understand, we assume Dale Thayer sees 0 IP before the injury and 55 IP after. The leveraged index doesnt change, because the situations are the same, just spread amongst different players, so we only lose approx a win. If Soriano misses 65 IP, is that about equivalent to a season?
Cool stuff.
The two main ways one could disagree with this analysis:
- Soriano will be better than a 3.50 ERA pitcher. I tend to trust the projection gurus, but hey, if he repeats last year, that’s a lot more value.
- Adding Soriano allows Howell and Balfour to better be leveraged better against lefties and righties, lowering their runs allowed, especially in important situations.
The first takes issue with the projection system, the latter the model.
Beyond the Boxscore Not a member? Sign up.
Sky, how come you chose to use ERA over FIP?
Admittedly I read this and Satchel’s piece, but haven’t gotten to yours yet.
"It's good to have a little cushion. But it's not going to be easy."
by Andy Hellicksonstine on Mar 19, 2010 2:07 PM EDT up reply actions
Going forward ERA and FIP are really the same thing.
Biggest difference is that ERA’s going to take into account fielding. That’s not going to be much different between pitchers on the same team, although it could matter for for high-K vs. low-K or heavy GB vs. heavy FB pitchers.
Beyond the Boxscore Not a member? Sign up.
I would think his impact is significantly greater than 2 wins.
I hope to see better seasons from some of the relief staff, that can translate into wins in that aspect alone. Thus the chain effect.
Gary Williams for President!
Jordan Williams freshman Manbeast
Yeah, I figure that Soriano will probably out-perform a 3.50 ERA and Howell and Balfour could do better than projected as well.
I just figured I’d be conservative and then people can make their own estimates.
Thanks for sharing the workbook! It’s an excellent resource.
I love Casey Fossum. Now try and take me seriously.
by Steve Slowinski on Mar 19, 2010 8:39 PM EDT up reply actions
Bullpen usage
I think one of the major advantages of adding Soriano has been overlooked by most. Maddon has said that he felt quite constrained by his bullpen last year, playing matchups more than he would like. If you watched the bullpen during games, most of our relievers were up and down warming multiple times during a game. You’d see some of them get up and go back down 3+ times several days in a row. It’s the natural consequence of a matchup bullpen. These warmups obviously aren’t at full strength, but it began to take its toll, particularly late in the year. Going back towards a role based pen, even though it will probably be a flexible role, should reduce this pattern and help the pen maintain its effectiveness throughout the season.
I'm not completely on board with the Rays pen being so deep.
My sense is the projections for the last 4 guys on the depth chart are a bit murky.
And no innings for Sonny?
Benoit’s coming off injury, Choate has an extraordinarily patchy track record, and Abreu and Thayer are almost completely reliant on MLE’s.
And now with the concern about Howell, it might have been better to run this sim a bit differently.
by nyyfaninlaaland on Mar 20, 2010 3:38 AM EDT reply actions

by 























