SSI on the Value of Spring Training Performance

Sorry. It ain't zero.

.

Q.  Can you make any sense of spring training statistics?

A.  Different stats have different levels of "noise" in them.  Ichiro's career batting average has noise in it, but it's about 2%, not counting park context.  Ichiro's career range factor has noise in it, too, but the noise is something more like (?) 30%.

Baseball sabermetricians are really cruddy at estimating the AMOUNT OF noise in a particular statistic.  A sense of proportion is almost completely lacking in the industry.  Sabermigos are great at math; they're not so great at common sense.

We mean it in a good way.

.

Q.  How much noise is in there in spring training stats?

A.  Oh ... what would it be?  60%?  Something like that.  

One of the few sabermigos who does have a sense of proportion:  Jeff Sullivan.  Read this article by him.  He points out various [huge] sources of noise in ST stats.

It is very, very challenging to make sense of a phenomenon when your metrics are diluted with 60% noise.  When you've got 60%, 70% noise, and you run a "study" (sic!) asking about the value of the stats, your study is going to suggest NO value to the metric unless you know how to design it.  

But I'll guarantee you that there is some "study" that will show the phenomenon being reflected at some level of consistency.  Give me all of the home run leaders in Arizona, past twenty years -- even first-week leaders -- and I'll guarantee that their presence is reflected in MLB regular-season slugging leaderboards, at some level of confidence.  It might be only a .20 correlation, but there will be a correlation.  Which is the same thing as saying that ST stats are not worth zero.

.

Q.  SSI thinks that spring performance is worth something?  How much?

A.  Not much, usually.  In a few cases it becomes critical.  

Kendrys Morales might be just tinkering.  Felix' results are unimportant, unless he walks a guy per inning.

Jason Bay vs Casper Wells is going to be important; both guys are playing for a job and both guys are out there competing.  Jon Garland and Jeremy Bonderman are going to be competing.

.........

The 2nd-worst thing you can do with such metrics is to assume that the noise is small - and to treat the metrics as though they are reliable with no further thought.  Many casual fans do this.  

I doubt any SSI or LL or USSM readers do this, and I hate to see the kind of condescension that assumes a web-literate fan to be unaware of the noise in ST stats.

...........

The VERY worst thing you can do is to assume that since you don't like a metric, and you don't know how to edit out the noise, and you don't know how to design a study in which correlations are found --- > then the metric must be worth ZERO.

ST stats aren't worth MUCH, in BULK.  But to imagine that every player's ST performance is irrelevant is incredibly naive.  If Jeremy Bonderman walks more guys than he strikes out, he's going home.  If he fans 20 guys and walks 2, then with the time off and re-boot, that means that he's probably going to have a good year by his own standards.

.

Q.  When are MLB teams going to wake up and ...

A.  Hold on right there, Turbo.  Just. Stop.

Consider this statement, from an author who higher on the very same web page had strictly forbidden any and all "appeals to authority":

.

Or, you know, you could use a projection based on more than just the last season’s data point. Which is what every good organization in baseball does.

.

I'll tell you something else every good organization in baseball every organization in baseball does.  Consider. Spring. Training. Performance.

We might slow down, draw a breath, and ask a simple question.

Why does every MLB organization watch ST performance carefully?  Why do all "good" MLB organizations (at least occasionally) make roster decisions based on spring results?

Org's don't just watch tools and skills.  They also watch performance and results.  All of them do. They understand about noise, understand with 100% crystal clarity.  They're out there watching, aware that ST very often misleads you, and still factoring ST performance as one variable in the equation.

Why would that be?

.

NEXT

Klat Categories: 

Filtered HTML

  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <em> <strong> <cite> <blockquote> <ul> <ol> <li> <i> <b> <img> <table> <tr> <td> <th> <div> <strong> <p> <br> <u>
  • Lines and paragraphs break automatically.
By submitting this form, you accept the Mollom privacy policy.

Shoutbox

Please log in or create an account to post shouts.
Gordon GrossBoy, do I wish I was not working 70 hour weeks and could contribute to this. Thanks for the great discussions, guys.15 hours 45 min ago
Bat571My part 3 is in the hopper. It repeats a lot of what's being dicussed in the existing threads, but I have a somewhat different take on the constraints on JackZ and their basis. Appreciate it if you could jailbreak it, Doc, and any comments are of interest. Hopefully my take adds something to the discussion.17 hours 33 min ago
jemanji*Super* cool Mo' Dawg :- )1 day 12 hours ago
jemanjiBat571 - many times this happens to me when the pic is too big, or when it's from an unfriendly source (copyright issues?). I try a smaller pic, or one from a different original source, and everything's fine. … I've got a Q in to the boss on it. Thanks for your material! :- ) Jeff1 day 12 hours ago
mojicianThat story is awesome Moe.1 day 15 hours ago
moethedogA short Giants story: Their rookie BU catcher, Andrew Susac, is the grandson of a good friend of mine, a city counsellor I served with. In mid-August Susac hit his first MLB homer, an opposite field job in Wrigley. One of my college roommates, a HUGE Giants fan, was watching the game on TV and called me to tell me.(he knew the hometown connection as he had read about it in a Giant's on-line mag) I was in Missoula dropping Bailey off at college. I called Andrew's granddad, suspecting he would be watching the game on TV. When he answered I just asked if this was the granddad of a guy who had just hit his first career homer. He said "I'm so excited that I can't breath! I think I'm floating on air!" It was one of the coolest calls I've ever made. A game in Chi-Town, a buddy in Portland, me in Missoula and a glowing granddad on the Oregon Coast = the magic of baseball (and cel phones!)!1 day 20 hours ago
mojicianThose who bet against the Giants in even numbered years end up poorer and wiser. Its not about WAR, or roster construction or who has the smarter GM or the better team. The Giants laugh at your logic. Based on that sort of thinking, the Nats or the Dodgers won the pennant. For the Giants, its about making the post season, and then "burning the other cities down, every last one of them". The Royals are Cinderella, the Giants are Vandal maurauders with trophy lust. The Giants are specialists at dispatching Cinderella teams from Missouri. Giants in 5. In a week's time, remember where you heard that. :)1 day 21 hours ago
moethedogOr noticed the lack of a picture...2 days 36 min ago
moethedogI just noticed it. Not there: Sorry.2 days 37 min ago
SABR Mattno...I don't see his picture either.2 days 48 min ago
moethedogYou could try logging out and see if the pic is there.....2 days 4 hours ago
moethedogBat, that has happened to me once or twice. I've eventually assumed that I was the only one who couldn't see the picture.2 days 4 hours ago
Bat571Hey, Doc or KLAT admin guys - my uploaded picture doesn't seem to show in the front page tile view. I changed it twice, and it does show up on the article page, but, did I do something wrong (.png is O.K., right?) or what?2 days 16 hours ago
Bat571Taijuan's Mom has had cancer - I suspect he just wants to be with family. But I hope his Mom has not taken a turn for the worse.2 days 23 hours ago
SABR MattHmm...I hope Walker doesn't have a behavior issue to work out.3 days 2 hours ago
mojicianIn the morning article, not the tweet, it sounds like Walker had legit personal reasons for leaving. As in, no Jesus Montero drama.3 days 2 hours ago
mojicianTaijuan Walker thinks that an instructional league consists of new victims learning about pain and suffering.3 days 3 hours ago
mojicianNew Marinerland drama: Shannon Drayer tweets that Taijuan Walker has gone AWOL from the AFL. Maybe he likes it in Tacoma.3 days 3 hours ago
MtGrizzlyThe guys on one of the pre-game shows indicated that Harvin refused to go back into the Dallas game and that was what sealed his fate.3 days 16 hours ago
misterjonezFrom reading tweets (I know, I know) and articles at Fieldgulls I came away with the overwhelming impression that he was becoming a clubhouse cancer. I generally think that when an organization (and league) made up, primarily, of Alpha Males complains of a person's personality, there's a serious problem. good on the 'Hawks for sticking to their guns and the 'program first' mantra.3 days 17 hours ago