SSI on "Appeal to Authority"

... which nobody is DOING, compadre

.

Q.  Are MLB talent scouts able to evaluate players based on intuitive judgments?

A.  The thought was floated that they aren't.  In this article the author implies that the only appropriate tool for making roster decisions is a performance-based analysis.

For example:

.

Every year, though, decisions are made based on how players do in March. The decisions are justified by claiming that it they aren’t based on the results, but on how the players look to experienced coaches and scouts who are paid to evaluate players in an up-close-and-personal atmosphere. The problem is that human beings — even experienced scouts and coaches — are pretty terrible at evaluating the difference between “how a guy looks” and what his results are.

 

Incidentally an incorrect implication, but the spirit is clear.

.

Q.  What makes you think that "experienced scouts and coaches" can evaluate anything based how a guy looks?

A.  Oh, just f'r instance, let's consider the amateur draft.

In this Baseball Analysts article, Sky Andrecheck examines the MLB return that franchises have gotten with their draft picks.

He finds a verrrrrrry nice, smooth curve:  the higher an amateur player was taken, the better the career he had in the major leagues.

.

Q.  Implying what?  What's your point?

A.   That MLB franchises knew how good that amateurs would turn out to be, up and down the draft, with a remarkable level of accuracy.

.

Q.  Implying what?  Still don't get your point.

A.  Do you think they used a performance analysis paradigm to evaluate anything?  Or do you suppose that they evaluated 18-year-olds based on how a guy looked?

If experienced scouts and coaches can't tell anything based on how a guy looks, what is that curve doing there?

.

Q.  Oh.

A.  Any time we sabermigos get to thinking we know it all, and Eric Wedge knows nothing, we might do well to remember the amateur draft.  How large a distance is there between you, gentle reader, and your being able to achieve a curve like the one above, based on watching high school games?

There is a million miles between ME, and me getting a curve like the one above, by watching high school players.  I doubt the distance between YOU and there, is much less than that.

.........

Now remember something:  the above curve is based on the talents and abilities of fine men who are at the bottom of the MLB employee pool.  Jack Zduriencik, and Eric Wedge -- and all GM's and Managers -- are they at the bottom of the MLB employee pool?  Or are their skills at all toward the top of the pyramid.

.

Q.  One last question.  The Mariners did seem to do pretty lousy last March, making decisions off Arizona performance.

A.  I think there's a lot of "noise" in their 2-for-7 result last year.  :- )  But if you want us to go point-by-point, just let us know.

Supposing the Mariners did do lousy last year, which I don't necessarily suppose, would that mean you'd give up the task?  After all, every good organization watches spring training ......

.

Q.  What is appeal to authority, by the way?

A.  The syllogism thusly:

Most of what authority A has to say on subject matter S is correct.
A says P about subject matter S.
Therefore, P is correct.

If you can find ANY statement in the last few years, locally, with that final line in it, I'll buy you a Good Humor bar.  

We are arguing about whether Capt Jack's and Sgt Wedge's intuition should be ONE PIECE OF THE PUZZLE, or whether it shouldn't be.

Nobody says Eric Wedge must be correct because he's the manager.  Nobody.

.

Your friend,

Dr D

 

 

 

 

Klat Categories: 

Comments

ghost's picture

ghost

In terms of weeding out noise...I go game by game and count up the statistics ONLY of players with a legitimate chance of making the big league roster and only when those players are competing against other players who have a legitimate chance of coming home a big leaguer.

To clarify...we see that Justin Smoak went 2 for 3 with a walk, a sharp single to right, a line out to left and a two run homer. Those ABs occurred against:

BB: The starting pitcher - an establishe dbig leaguer
Line Out: The team's primary set-up man
1B: Someone with maybe a 10% chance to make the club
GW HR: An MLB (TM) Mr. Magic Closer

So...in my head, Smoak went 1 for 2 with a walk and an impressive HR.

I've made a habit of doing this...it works better than you;'d think at getting rid of the noise.

1

and I have trouble believing the managers, coaches, and GMs that are watching every play are unduly influenced by stats. The advantage to small samples like this is that it becomes easier to remember hard hit outs and fly balls as well as embarrassing strikeouts and batters being fooled on pitches. Fans rely on stats because we can't see every game, much less the batting practices, the bullpens, and the drills, and we can only guess how a player is feeling physically or mentally. Much as we may not understand from outside, all those things contribute to decision making processes, as well they should.

And from the last spring training we have:

Saunders wins vs. Wells, good call
Kawasaki wins vs. Rodriguez, my guess is the Mariners didn't believe in Rodriguez at Short
Liddi wins vs. Peguero, push
Beavan wins vs. Ramirez, fail, but tucking Ramirez in the bullpen was a hedge that didn't work when hr was injured, it should be pointed out that Beavan didn't exactly implode.
Noesi wins vs. Iwakuma, again a fail, and again, the Mariners tucked him into the bullpen and had him work on strengthening his arm according to Baker.

2

He hit .455 (or whatever) in spring and Wedge shocked us all by announcing, loud and clear, that he was a utility player who wouldn't be used much.

Very odd for other blogs to hold that one up as a case-in-point.  He was precisely an example of the club SEEING THROUGH spring training stats.

3

He routinely gives you the report as to whether a good game occurred against premium competition and, if so, whether the pitcher was just out there working on something.

It's a great point.  And, yes, you still might wind up with only an 8-for-17 batting line against premium pitching but ... suppose it were 0-for-17?  Would people hesitate to bust Smoak's (or Figgins', or Peguero's) chops for a terrible result?

................

Pitcher J:  3 strikeouts, 10 walks in 20 innings

Pitcher J2:  21 strikeouts, 2 walks in 20 innings

One of those is, on March 27th, Jon Garland and one is Jeremy Bonderman.  The Enlightened GM wouldn't even want to know which had been which?

4

The same was something I noticed about Bays HR off Tyson Ross in the 1st. In general the Mariners have been scoring early which means that our most likely MLBers were scoring against their most likely. Nobody can convince me that this is not positive.

I dont appeal that completely. More like since A said P, P may be true. The Zunino quote early this morning is a pretty good example where since Zunino said that Maurer has a good changeup I explore the possible implications of him saying so. I've said the same recently about pressure in certain lineup spots and veteran leadership. Outside of that appeal in that situation, since the players and coaches believe in those things I believe there's a possibility in their effect. In that case you are talking about faith in abilities which is a key to life. If the players themselves have more faith in their success while wearing tie dyed armbands, give them the armbands. They will produce better if they have faith that they will.

5

I read the article in question on the Big Blog and left with similar issues with it. ST stats are, in aggregate, less than optimal. Still, the author uses Iwakuma as an example of ST performance bias. Baker (who is with the team, coaches, trainers and players every single day) has indicated that in ST and thorugh the first half of the season, Iwakuma literally took 3+ days to recover from throwing a couple of innings. It wasn't his ST stats that kept him out of the starting rotation - it was the fact that he wasn't ready for the SP grind. I think it's to the club's credit that they kept him around until he was.

Too, they don't get credit for the correct decisions. Catricala had a very good ST and the M's had no incumbent (beyond Figgins) at 3B. But they made the call to send him to AAA - a decision that his performance in 2012 says was the right call.

Long way of saying that these things are a lot more nuanced than a simple "teams pay too much attention to ST stats". Fans probably do but I doubt the front office does. (Much).

6

Hearing the concerns, Zduriencik went down to watch some AB's, watched the hitters stand on the plate and dare Iwakuma to throw something, watched them line shots around like BP, and shook his head "fuhgeddabdouit."

It wasn't stats at all.  Iwakuma's stats were fine - as I recall he had a 3:1 control ratio or something.

7

I pretty much agree with everything you've said in this article.

But, it does make me wonder about one thing. What is the 'normal' skew between "looks" and "performance"?

My thinking is in a VERY high % of cases, the looks and production agree. In all of those cases, the question of "tastes great" or "less filling" is moot.

Let's face it ... in baseball it is HARD to look horrible and be very productive. We remember those exceptions (and likely overestimate their total number), for the simple reason they ARE exceptions.

Looking exclusively at stats, I pegged Carp as a better bet than Smoak, (I tagged Carp before he took his first AAA swing, and shrugged off Smoak after his initial stint with Texas in the Majors - just to be fully forthcoming).

Eyes on - the "initial" take I heard on Carp was "meh" - while the eyes on take for Smoak was - (apologies to Molly Shannon), SUPERSTAR!

At this point, Smoak is a career .683 hitter (1421 PAs), while Carp is a career .740 hitter (608 PAs) ... but Carp is gone and Smoak remains ... (clearly NOT based on production).

Saunders, on the other hand, was viewed as having major "look" issues, while being extremely productive all the way up until he hit the majors.

Can looks override production? yes.
Can production override looks? yes.

But, both of those are within lmits. A very productive, but awful looking AAA player rarely will get an MLB chance. A great looking, but dreadfully producing player won't always get the call up and will eventually get the axe.

Honestly, I think most of the bad lookers end up failing due to injury. Major league effort with bad mechanics is a naturally bad mix. To this day, the best looking SS I have seen in my life was BJ Upton. He "looked" (to my non-scout eye), smoother than even Ozzie. But, 50 errors a year doesn't lie, so today he is an OF.

In the end, what I think "look" vs. "stats" comes down to is there is no way for a scout to see inside any players head. The productivity is what shines a light on the cerebral part of the equation. Doc can look at all the hours of footage available, but this will not tell him that Jose Lopez is basically satisfied with himself and really just doesn't want to put in the effort to get better - or that Michael Saunders is willing to do anything, up to going into a meatlocker and punching dead cows for a couple of hours each day, if the club thinks doing so will give him a legit shot at the bigs.

8

The spring idea is different from the scouting a young players tools idea. One seems to be a determination of what they are now while the other is a determination of what they could be. What they could be has more variables and wasn't really the discussion. Coming out of spring you have to decide who's better right now and this year in general. Long term analysis of ceiling and likelihood may have an effect on those decisions, but it shouldn't be the determining factor in most cases.

That doesn't mean that scouting doesn't work in determining what they are now, though.

9

Going into last season I had pretty much given up on Michael Saunders. His "look" looked pretty much like it had in the years prior, but then something happened. His new approach started to yield some results, and with renewed confidence in what he was doing, his look changed. The deer in the headlights look was gradually being replaced by a look of challenge. Still though, just as I do not have complete faith in Saunders going into this season, I am sure that he too feels a bit of trepidation. Players in Saunder's current condition need to have success in order to become complete confident in what they are doing. I've seen it before in other ventures.

Mike Carp, on the other hand, never had a confidence issue. Carp was supremely confident in himself to the point of cockiness. On top of that, Carp also has the work ethic to more finely hone what is able to do. But Mike Carp has an issue of "look" that most of us will never get to see, but some of us have. Mike Carp has a bit of an attitude problem that raises it's ugly head every now and then when he is placed in a position of stress. I heard about it in camp, and I've seen it first hand. Gordon and I both saw it first hand when in his first at bat after being sent down from the majors to Tacoma, Mike Carp got into an altercation in his very first at bat with an umpire and got tossed. Carp was then reprimanded by Darren Brown for a couple of games. When things are going his way he is a sweatheart (or so I am told) and a great team player. When things aren't going his way he turns into a something less desireable.

In a Carp versus Smoak steel-caged death match, Carp got tossed to the curb because of his occasional "look".

Now we have Dustin Ackley who bore a striking resemblance to Jeremy Reed last year. That "look" is going to be hard for him to lose, IMHO. In 2011 when he was finally brought up he "looked" like the eager rook who had never faced a level of competition that he couldn't compete in, and had a measure of success. Last year, once the pitchers figured him out, he found himself unable to compete and "looked" lost. I'm willing to bet a ton of cPoints that Wedgie has Ackley under a constant observation from afar to track how he looks during the ST. Ackley's bona fides gives him some rope, but how much depends on what Zduriencik thinks.

Give me 15 minutes with someone and I can pretty well tell you what chance they have of reaching their potential. I'm not bragging, I'm just confident...

10

Those of you who are old enough and caught the TV Western, "The Guns Of Will Sonnett" will recognize the allusion in the title of my reply. It's a freebie.

Great post, Lonnie, one that gives insight into the human side of GM'ing, coaching, and playing baseball. For most of us all we ever see is games on TV or at the stadium. We see players through a filter that prevents us from seeing only a little, the tip of the iceberg so to speak, of the human side of the game. And yet for the players and coaches the games, which command all our attention, are in a brief, intense environment the application to those games of each man as a person, all his skills, preparation, personality development, social tendencies, etc.

Anybody who hires knows that, though the accomplishments of a person are key to hiring, in the end you hire a person, not a list of accomplishments. Interviews are done not only to explore the substance of a resume, but to get a feel for the person being interviewed. Their track record is a window on that person, but it is not the whole story.

Thanks for sharing you personal insight into Carp and Ackley. Ackley has a TON to prove this year, and it will make a HUGE difference to the M's whether or not he is able to reach his potential.

11

Tajuan threw 10 pitches to get his 6 outs today....all of them strikes. Two 3-pitch punchouts, and 4 1-pitch outs.

He walked one guy on 4 pitches.

Hultzen had one 4-pitch walk and two hits inthe 1st, but got out of the jam and was fine in the 2nd. K'ed 4.

Beavan needs to be sharp.

moe

12

ghost's picture

ghost

Pitch f/x does not always work correctly in ST games. It is unlikely that these pitch counts are correct.

13

But while I was listening on the radio, Walker's walk was 4 pitches and at least 1 of his strike outs were 3 pitches. Other than that I wasn't paying attention, but whenever PitchF/X isn't working, Gameday shows the minimum number of pitches required, 1 for a hit or out, 3 for a K, 4 for a BB, and ball if there is a wild pitch or passed ball.

That said, both Hultzen and Walker pretty well shredded the batters, the only note on Walker is that 1 batter hit the ball pretty hard on his ground out.

14

ghost's picture

ghost

Reminds me of Northern Exposure.

Anyone ever watch that show? :)

The traffic report here in Nome - a car just drove down main street!

Some batter got solid wood on one of Walker's pitches...that was the only bad news. :) Love it.

15

bsr's picture

bsr

Is there any argument made on USSM that ISN'T essentially an "appeal to authority"? Lol

Why the guy seems to love endlessly beating up this strawman version of "The Mariners" that is supposedly acting based on some caricature of simplistic jock thinking...is beyond my understanding.

I'd assume the basic thought process employed by all teams in evaluating spring training is Bayesian and hypothesis based...you have a strong "prior" expectation for each player going in, set by past performance and projected development trajectory, and it takes a LOT of ST evidence to override that prior and change your mind on a player. And you have some hypotheses that can help you decide whether to do so as well. Eg, Smoak put in serious hours on a (quite tedious and methodical) offseason improvement regimen. If he's mashing in ST off real pitchers, you've now got a supporting reason to think it could be real progress.

Sure, some teams are better at this process than others. That's called skill (and luck!). But the process itself is decision making 101 in any field...no idea why a smart guy like Cameron thinks a professional sports team would be doing otherwise.

16

Why Cameron, a very smart guy, thinks that GMZ and his team are making poor decisions by utilizing a poor process is a mystery to me, particularly when it is GMZ's job that is on the line. Cameron rarely makes an effort to understand the multiple variables a real life GM must consider; e.g., 1) Cameron has reduced the M 's treatment of Iwakuma last year to a simple function of velocity only and has ignored the facts that Iwakuma had a poor spring and got lit up in the final exhibition game in Japan, and 2) reducing the trade of Jaso for Morse to a simple WAR calculation, ignoring the difficulty of finding true MOTO bats & ignoring the free availability of competent back-up catchers like Shoppach. I know that I should argue these points on USSM and not here but I don't have the energy to butt heads with DC.

17

Filtered HTML

  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <em> <strong> <cite> <blockquote> <ul> <ol> <li> <i> <b> <img> <table> <tr> <td> <th> <div> <strong> <p> <br> <u>
  • Lines and paragraphs break automatically.
By submitting this form, you accept the Mollom privacy policy.

Shoutbox

Please log in or create an account to post shouts.
rick82Outside of Felix, and maybe our defense (although every little bobble is killing us), the bullpen has actually been our strongest suit. It's just that the high leverage situations are going to those who perform poorly. And our best performers are in the low leverage situations. We are basing our bullpen on 2012 performances. I want to see Danny and Dominic handing the ball to Rodney. It's too bad Tommy and Charlie haven't stepped up, but it's been that way for about a year now. Charlie's getting out pitched by Beimel. Tommy is all over the map. Yoervis continues to look over his head. The pen just looks backward to me. But, yeah, the offense is the real problem.1 hour 5 min ago
Gordon GrossThe idea was that we'd be able to put Pryor and Maurer and others out there as well. The rotation isn't the only thing getting pounded. We had pitching depth and we've needed all of it. But my 240 million dollar man isn't breaking .700 OPS yet, and too many of my blue chip hitters (young and older) are belly flopping. They have to turn it around or we're going nowhere. Needing the pen to throw 5 innings of zero run ball every night that Felix doesn't pitch just won't work.6 hours 25 min ago
Gordon GrossNo, I get it JD, but their actual ERA figures are mostly fine too. We have 4 guys in the pen with an ERA under 2. If the whole pen was a dumpster fire I might feel differently, but the pen as a whole isn't really bad. Maybe it will GET bad (again) through overuse or whatnot, and it's not Oakland's pen, but it's not bad. It's just being asked to do the impossible, since it can't score runs after the 6th inning - and neither can our offense. The team OPS of .576 in innings 7-9 with 14 runs scored isn't cutting it. We're not getting to the other team's pen - understandable when it's Oakland, abominable on other cases.6 hours 35 min ago
IcebreakerXG, that's an interesting stat. However, I feel like the M's continuously torch games by sticking bad FIP/xFIP pitchers in high LI situations. Though, I'm sure there's a way to calculate a cross-stat of LI and xFIP...6 hours 45 min ago
rick82Noesi today: 1 IP, 7 ER8 hours 31 min ago
JDDubSorry G, not trying to attack you. Just frustrated.9 hours 4 min ago
JDDubWild pitchers seem to carry great FIP, only to underperform in real life. Woo Hoo, guy K'd the side in two different blowouts. Then walked 2 and gave up 2 singles with a 4-3 lead when it mattered. Looks great on paper, not in the standings. No offense G, but it has felt this way most of my time as a Mariners fan. Only Gillick and Lou paid good attention to locking down a game you have in hand, the only 2 times the franchise showed much life. Lou managed to somehow get Charlton. Gillick piled up the bullpen arms. If FIP and xFIP are so great year after year why is our bullpen constantly coughing up the game and not the other team? The stats are misleading I believe. We tied for 6th in Blown Saves last season. That doesn't factor in ties or other close games torched.9 hours 21 min ago
Gordon GrossOur top 5 bullpen FIPs go: 1.39, 2.48, 2.75, 3.19, and 3.87. The As: 1.44, 2.15, 2.75, 3.80 and 4.00. Their bullpen is not demolishing ours, JD. It only feels that way. Mostly it's their starting pitching giving their entire team an ERA+ of 150 (!). But they've gotten the victories out of that they've needed to. We haven't.9 hours 43 min ago
Gordon GrossCorey Hart doesn't exactly look like a busted-up retread in the early going, and his defense is fine now that he's in the OF every other day. I agree, tho, the overall plan leaves something to be desired thus far.I understand the arguent that goes "why have a #3-4 starter like Matt Garza (85 ERA+ so far for 4/50 mil) when Paxton and Walker looked so good?" I admit, I want the arm NOW, but I'd take Paxton and Walker over Garza every day of the week. I'd have taken that shot at Kazmir for 2/21 like the As did, but a lot of #3 guys are really #4-5 guys in disguise who wanted big cash. We just need to catch a break. I hate that every year we need to catch a break we don't catch.9 hours 56 min ago
JDDubIt's too bad an idiot like me could see last September that our bullpen was going to continue to kill us without addressing it. Such a small amount of money and we wouldn't be having these conversations. Instead I got charts showing all the bullpen guys underperforming their xFIP and lots of "spending money on the bullpen is the biggest waste there is! The $/WAR value is not prudent.". I don't know about you guys but it always killed the teams I was on when one guy sucked at defense. 4 lock down defenders on the court don't matter if the 5th guy is giving up blow by layins all night. On my hoops team it was always the same guy, for the M's bullpen it's a new guy every night!9 hours 57 min ago
Tacoma RainAs upset as I am... I take solace in the fact we have had 2 good starts in a row from rookie pitchers... yeah, Elias was left in two too many batters due to the bullpen, and everything else really sucked... but Elias and Maurer pitched with their hearts on their sleeves... We are getting to the point of just trying to figure out what works, and then deciding whether to keep or torch the rest.10 hours 2 min ago
phxterryA tale of 2 cities, er, 2 teams: Billy Beane finds good young pitching and then fills the 25 man roster with ball players whose specific skills fill all holes; then, despite limited funds in the2013-14 offseason, spends big to bring in a fleet of lock down relievers to hold every late lead and win the majority of 1-run and extra inning games. He hires a manager who utilizes players skillfully and maximizes their strengths. GMZ spends $240M on a special player, but who plays at the M's position of greatest depth/strength - middle infield. GMZ does not fill the most glaring holes: RH OFer who can hit and play defense & veteran #3 starter. He adds only 1 lock down reliever while relying on retreads like Wilhelmsen and Furbush. Then he hires a manager who can't tell a bad reliever from a good one. Mix and stir: voila - A's are winning (again) and M's are losing (again).10 hours 37 min ago
IcebreakerXI can't wait until the Astros sweep us.11 hours 44 min ago
rick82There's a reason Farquhar passed all these guys up last year and became the closer. He asserted himself. Why he takes a back seat to Tommy, Charlie and Yoenis is a mystery to me.12 hours 44 min ago
Gordon GrossOur pitching has actually been pretty decent in the early going, Rick. It's our offense that is - once again - betraying us after that opening series. Gotta get the bats on track. Losing a couple close heartbreakers has changed the complexion of the early season for us. The Rangers have walked off at least 4 times in victory, and we've suffered 3 walkoff losses and a couple other heartbreaking late inning defeats. We pull those out and it's all roses while we wait for our pitching reinforcements. Now, though, we need hitters to hit - a lot. Gotta take this Astros series.13 hours 49 min ago
GLSI don't mind Furbush so much, but he's never been that guy, that when he comes in the game, that you really feel good about it. I think he has a role, but to me he's more of a 6th/7th inning guy. I really don't Furbush, Wilhelmsen, or Medina showing their faces in the 8th inning of a close game.13 hours 50 min ago
Gordon GrossI like Charlie, but he's been a slow starter in the past and is continuing that this year. It's okay that it takes him til May to get his sea-legs, but that doesn't mean I want him pitching a bunch of important April innings then. He's also never been great against righties, though he was decent last year. I don't pivot my pen around Furbush in the early going, that's for sure.13 hours 53 min ago
rick82But yeah, if you'd have told me that Elias would by default be our #2 starter on April 20, I would have expected a 7-11 record.14 hours 47 min ago
rick82Thirteen: I don't see it. It's been a while since he's been "one of the best". He's been pretty middling for about half a season at least. And I don't see any evidence of him returning to 2012 form. He has earned his way to long relief.14 hours 50 min ago
ThirteenGuys, calm down! Furbush hasn't even thrown six innings yet, and over the last two years he's been one of the best LH setup men in the sport. Don't bail on a LH setup man after six bad innings!15 hours 5 min ago