by Myron Logan
Dave Cameron writes so much about baseball that if you’re not disagreeing with him once or twice a week, you probably aren’t paying attention. That is, of course, meant as a compliment to Dave, as he is right on the money most of the time.
But I don’t think I agree with this post on the utility of college baseball stats. First, he talks about the hazards:
“From the use of metal bats, the huge variances in quality of opponents, some parks that heavily impact run environments, and the smaller sample of games played, there are all kinds of adjustments that need to be made to try to translate NCAA statistics into something that resembles context-neutral. And, once you’ve done all that work, there is still limited value in the numbers.”
Those are all good points, I think, but I don’t see why they render the stats useless. The two biggest adjustments to make are probably the park and quality of opponents, and that can certainly be done. Those adjustments don’t necessarily make the stats predictive, but they are a step in the right direction.
Anyway, Cameron later goes on to say this:
“Good hitting prospects hit well in NCAA ball, but so do less good hitting prospects, and just using numbers, it’s basically impossible to tell them apart. We’re big fans of statistical analysis here, obviously, but we also need to know the limits of what numbers can tell us. When it comes to college performances, scouting reports are what you want – the guys hitting the fields everyday and looking at swings and athleticism do a better job of predicting which college players will hit in the majors and which ones won’t.”
I’m just not sure that is true. Brian Cartwright has some interesting stuff on the projection side. After the stats are translated, he finds that most players perform relatively similarly in college, the minors, and the majors.
If you read one of my Q&A’s with Chris Long, I think you’ll get the sense that he *certainly* does not ignore college numbers, or even put them on the back burner.
It’s also clearly apparent that scouting plays a big role. I think the best projection system for college players would involve combining both adjusted statistics and scouting reports, in some fashion. The only people really able to do that, at this point, are guys like Long, who have the access to tons of scouting reports that we really don’t. You can add things to the adjusted numbers like body type, swing type, bat speed, etc., sort of like PECOTA, combining numbers, physical traits, and actual scouting. I have no idea if this is actually being done, but I’d guess that someone is doing it.
Anyway, I don’t have a clear answer as to how to weight the stats and the scouting. I’m not sure anybody does. But I think it’d be just about as silly to ignore the numbers as it would be to ignore the scouting reports. And when you have both, like they definitely do in front offices, and like we sort of do with Baseball America-type sites, why ignore either?