What Makes a Top 10 Pitcher? by Alex Craig

By: Josh Margles

In baseball statistics, an earned run average (ERA) is the mean of earned runs given up by a pitcher per nine innings pitched. I decided to take a deeper look to see what goes into the ERA of a pitcher. In this study, I divided all the qualified pitchers from the last five years into two groups; top 10 ERA and non-top 10, as a means to determine what makes a top 10 ERA pitcher.

Using four indicators; strikeout percentage, walk percentage, left on base percentage, and BABIP (batting average on balls in play) we can figure out the probability that a pitcher will finish in the top 10 in ERA. I ranked all the pitchers in the last five seasons by these categories, and put them into a big matrix of numbers based on their rankings. To indicate if they finished in the top 10 ERA category, I put a 1 for top 10, and a 0 for finished outside the top 10. I used each pitcher’s yearly rank instead of their actual numbers because each year’s top 10 is different. Therefore, it is important to compare numbers on a year- to-year basis.

Some of the chart looks like this:

Screen Shot 2019-01-24 at 4.02.14 PM.png

To find a prediction, I used a program in R called XGBoost. XGBoost takes the information based on the previous data and tests to see if there is a pattern between where the pitcher finished in rank, and if he finished in the top 10 of ERA in the season. After running the numbers with different parameters on XGBoost we can determine two things. The program tells us which of the four stats is most indicative of a high ERA rank, and which pitchers were outliers (the model predicts the outcome).

First, let’s look at which stat is the most predictive in determining the rank. Surprisingly, LOB rank has the most impact on a pitchers ERA rank. Note that these aren’t percentages, rather they are used to show the relative importance in each stat in predicting ERA.

Screen Shot 2019-01-24 at 4.01.35 PM.png

This chart shows that where the pitcher finishes in LOB percentage is the best predictor. Interestingly enough, the pitcher that had the highest LOB percent (he left the highest percentage of runners on base) each of the last five years finished in the top 10 in ERA. Also, out of the pitchers that finished in the top five LOB percentage, 20 out of the 27 (there was one three-way tie) finished in the top 10. The chart also shows that LOB rank and K rank are much more significant than BB rank or BABIP rank.

Next, let’s look at the predictive aspect of the model. I ran the model using a number of different combinations of test and training data, and then had it predict on the pitchers. The model predicted around 85 percent of the pitchers correctly. Now, let’s look at a few pitchers that the model incorrectly predicted and why this data was wrong.

Screen Shot 2019-01-24 at 4.06.16 PM.png

Garrett Richards finished the 2014 season with a 2.61 ERA, which placed him 10th in the MLB. However, the model predicted that Richards would finish outside of the top 10 with those ranks. One explanation for why Richards finished with a good ERA is his HR rate. He had a 0.27 HR/9 rate in 2014, which was the lowest of any qualified pitcher in the last five years. So, while he allowed a lot of baserunners, not a lot came in because of the fact that he could keep the ball in the yard. Richards has been injured the last few years, but his success has been almost completely related to his home run rate.

Screen Shot 2019-01-24 at 4.09.23 PM.png

Stroman in 2017 had an ERA of 3.09, which placed him 9th. What Stroman lacks in strikeouts, he made up for in his ground ball to fly ball rate, as well as his groundball percentage. This allowed Stroman to get easy outs without needing to strike everyone out. Since he got so many groundballs, most of the hits he gave up were singles, which limited the amount of earned runs. He also induced the most double plays in 2017, which helped him get out of innings without allowing any earned runs.

Screen Shot 2019-01-24 at 4.11.24 PM.png

One problem with this model is that it treats everyone outside the top 10 as equals. In 2015, Scherzer had a 2.79 which was the 11th best in the MLB. Even though he finished with a great ERA, the reason he didn’t make it into the top 10 was because of the amount of HR he allowed. He gave up 31 HR which was the most in the NL. Even though he finished in the top 10 in these four stats, his home runs prevented him from being in the top 10 in ERA.

Screen Shot 2019-01-24 at 4.13.40 PM.png

One of the more interesting results was that the model projects Fiers in the top 10 even though he had a 3.56 ERA, finishing 24th in 2018. The reason why his LOB rank is so good, while still consistently giving up runs, is because he gave up the second most HR/9 of anyone in the MLB. While the rest of his numbers look good, like Scherzer, home runs prevented Fiers from having an elite ERA.


Stats from, and

RBIs - Clutch? Or Opportunity? (xRBI) by Anthony Turgelis

RBIs are often criticized because they are largely dependent on how many plate opportunities the hitter gets with runners on base. Most analytics experts have dismissed RBIs as a dated stat, but many baseball insiders still claim that they have some relevance. We aim to address these flaws and create a stat that everyone can agree on.

Read More

Using Pitch Values to Preview the Blue Jays' 2018 Starting Pitchers by Anthony Turgelis

By: Anthony Turgelis (@AnthonyTurgelis) and Jordan Moore

Data Visualizations by: Adam Sigesmund (@Ziggy_14)

All data from Fangraphs, all projection values from ZiPS.

Baseball is back! Tomorrow afternoon, the Toronto Blue Jays will take on the New York Yankees to open their 2018 season. While there are certainly reasons to be optimistic and pessimistic about this Toronto Blue Jays team, their starting rotation remains to be seen as a strength. This article will first introduce Fangraph’s Pitch Value system and how they evaluate pitch effectiveness, and later preview the Blue Jays starting rotation so it can be seen what every pitcher has to offer.

Fangraphs Pitch Value System

The idea behind the Fangraphs Pitch Value System is to assign run values to how a pitcher performed while using this pitch. They are then compared to the average results, to determine whether each pitch value is below or above average, and by how much. These can also be viewed for hitters, who generate similar calculations based on how effective they are against each type of pitch. For this article, we will use the standardized calculations which are calculated on a ‘per 100 pitch basis’, since each pitcher’s pitch frequency widely varies, but to provide this further context we will also include their pitch mix from the current year.

The limitations of Pitch Values are that they are not always predictive, and can vary from year-to-year. Also, there is likely to be some variance depending on which batters the pitcher had to go up against, since the batter’s ability to hit each pitch will affect the results. If a pitcher were to happen to face batter’s who are less-skilled or less-prone to hitting a curveball (for example), a curveball-heavy pitcher may post higher curveball values due to this lucky arrangement, which may not be entirely indicative of their curveball results going forward. To offset this, their career pitch values will also be included, so if there did happen to be a year where a certain pitch performed wildly different (which again, could be from external factors), their career numbers could also be used to predict their value going forward. In addition, Pitch Values are only calculated for: fastballs (wFB/C), curveballs (wCB/C), changeups (wCH/C), cutters (wCT/C), sliders (wSL/C), knuckleballs (wKN/C), and splitters (wSF/C). Sinkers are included in fastball calculation.

The 2017 best and worst values will also be highlighted for reference on how effective each pitch is to the worst and best values that qualified (large enough sample) starting pitchers have produced. Values here were omitted if the pitch was less used in less than 15% of their pitches thrown, which could create small sample size noise and overstate its value. Using this statistic, let’s see where the Blue Jays Starters stack up against the rest of the league.

J.A. Happ - Opening Day Starter


We begin with the Opening Day starter, J.A. Happ. Happ is a curious case as his career numbers probably don’t reflect his true ability at this point in his career - in a good way. After being traded from the Blue Jays to the Seattle Mariners, the Mariners later flipped Happ to the Pirates at the deadline. Here, Happ linked up with pitching coach Ray Searage, who has notoriously shaped-up the careers of many pitchers. Things clicked for Happ who turned a curveball that was arguably his weakest pitch, to one that achieved very good results, possibly because of its reduced usage.

His career pitch value on his curveball sits at -0.97 - below average - but in the last two seasons has achieved a curveball value of 1.53 and 1.41, above average and ranking him 18th among pitchers who pitched 100 innings of more last season. As seen in the graph, Happ had an above average fastball last year and throughout his career, a not-so-great slider and a not-so-great changeup. The thing to remember here is that these values are rate stats, so the fastball grading out positive is the most important part since it’s a pitch he throws ~70% of the time. Happ had an fWAR of 2.9 last season (38th among pitchers with 100+ IP), and is projected to put up an fWAR of 2.7 this upcoming season. The often-underappreciated Happ should continue to be one of the Jays most consistent pitchers.

Aaron Sanchez - Friday's Probable Pitcher

29746404_1809282842450114_1019471883_o (1).png

Aaron Sanchez, the 6’4 25 year-old California native is looking to stay healthy and pick up where he left off in the 2016 season. 2017 was a very disappointing season for Sanchez as a blister on his throwing hand kept him sidelined for all but 8 games in the season. In 2016, Sanchez held a 15-2 record with an ERA of 3.00 which was good enough to earn him his first All-Star game nod (replacing injured Craig Kimbrel). Considering Sanchez's small 2017 sample, his 2016 and career numbers will be used for comparison purposes.

In 2016, Sanchez held a fastball value average of 0.94, leading him to throw a fastball 74.60% of the time. What makes Sanchez’s fastball so unique is the ball tends to move like a breaking ball, however it still packs extreme heat causing his fastball to produce great results. Sanchez’s fastball value improved in 2016 compared to his career average of 0.86, so there is lots of optimism the young stud can continue this positive trend if he stays healthy. Sanchez's high value and high usage means that he sits down a lot of batters on his fastball, and it is a top pitch.

In 2016, Sanchez also saw an increase in his curveball value raising to 0.68 compared to his career average of 0.11, so we may see more of a curveball added to his arsenal in 2018 (threw a curveball 16.27% in 2016).  Sanchez saw a small increase in his change-up value in 2016 compared to his career average (0.27 to 0.7), so hopefully he can continue to develop his change-up as well. With one all-star game under his belt already, and his fastball, curveball, and change-up all improving in 2016 compared to his career average, Sanchez has a very bright future as he approaches his prime.

If Sanchez can continue to improve in all 3 of his pitches, he has the potential to be a CY Young candidate. In 2016, he produced an fWAR of 3.8, but ZiPS is projecting him at 2.3 fWAR for the coming season. If he can stay healthy, he has a chance to be significantly higher than that, if not the Jays might be in trouble. Injuries seem to be the only thing stopping Sanchez at this point in his career, so he and the Blue Jays will be hoping he stays on the field as much as possible. 

Marco Estrada - Saturday's Probable Pitcher

29633656_1809282845783447_144122169_o (2).png

Coming into his fourth season with the Toronto Blue Jays, seasoned veteran Marco Estrada is looking to bounce back from a year where he saw all 4 of his pitches drop below his career averages in value. The 34 year old has been known as a location pitcher throughout his career, putting the baseball in the corners of the strike zone forcing the batter to make difficult decisions on whether to swing or not.

Throughout Estrada’s career, he has evolved into a change-up specialist, however his change-up value fell off a cliff in the 2017 season, dropping below the league average to a weak score of -0.7. This may indicate batters have solved the puzzle of his change-up pitch, or it could indicate age is taking a toll on Estrada’s performance (he will be 35 in July).  With a seasoned pitcher like Estrada however, there is always room for optimism as he could rebound in the 2018 season and bring his change-up value closer to his career average where his change-up value sits at 0.63, above the league average. Estrada’s fastball saw an insignificant value drop of 0.05 compared to his career fastball value of 0.28, indicating his arm strength is still healthy while he’s approaching age 35. Estrada saw the biggest drop in his curveball, dropping to a disappointing -1.57 in value, which may explain the low percentage of this pitch choice in 2017 (7.70%). Estrada’s cutter has always been very below average, and he saw this pitch drop in value as well to -1.63 while only throwing a cutter 6.70% of the time. The low percentages of curveball and cutters thrown in the 2017 season indicate he’ll rely heavily on his fastball and change-up again in 2018, so hopefully Estrada can rebound this season and find his change-up groove again.

Even in a down year, Estrada managed an fWAR of 2.6 in 2016, and is projected for 2.1 fWAR this coming season. Estrada was a guy who had outperformed his FIP in each of the three previous seasons before last, and will likely need to find out how to do that again this coming season, and figure out how to surpress contact like he used to.

Marcus Stroman - Sunday's Probable Starter


The would-be Opening Day starter had he not picked up a minor injury in Spring Training, many look to Marcus Stroman as the face of this ball club. Standing at 5' 8", Stroman is proof that Height Doesn't Measure Heart, and that if you can throw a baseball, you do not need to tower over the competition to be a starting pitcher.

Stroman leans heavily on his fastball and his slider, which is a good call considering those are his two best pitches. His slider pitch value is consistently above league average at 1.46 last year and 1.22 throughout his career. He had the 10th highest pitch value out of all qualified starters last year. The movement on this pitch can sometimes be just insane, which is seen in the video below:

Nasty, even though it missed the zone. His fastball grades out as above average as well, which is very valuable given the high usage. His tertiary pitches don't grade out as well, with his cutter and curveball getting near-average pitch values throughout his career. His 2017 cutter value was left in the graph to illustrate how a small sample size can affect this stat. His usage was only 2.4% last year, and a few unlucky results could really sway the pitch value stat. This shouldn't be a reason for concern.

Stroman had an fWAR of 3.4 last year, and ZiPS expects him to take another step forward this season projecting an fWAR of 4.5 this season. Expect him to battle with Aaron Sanchez this year to be regarded as the team's Ace.

Jaime Garcia - Monday's Probable Starter

29632656_1809282839116781_552419505_o (1).png

The only new addition to the list, Jaime Garcia called St. Louis home for 8 years where he won the world series in 2011, until he fell victim to the trading carousel of the MLB. He was traded to the Atlanta Braves on December 1 of 2016, where he recorded a 4-7 record with the Braves before being traded to the Minnesota Twins on July 24 in 2017. Less than a week later, Garcia was traded to the New York Yankees. On February 15, 2018, Garcia signed a 1 year deal (with a team option for a 2nd) with the Toronto Blue Jays where he is hoping to again find his groove and play his way into a multi-year contract. He has a standard 4-pitch mix with no pitch extremely more or less dominant than the rest

In 2017, Garcia’s fastball had a value of 0.28. He threw a fastball 60.36% of the time in 2017, and considering it's above average results, is a good weapon for him. Garcia’s curveball took a statistical dive in 2017 as he had a career curveball 0.03, and in 2017 this value dropped to a dismal -1.87, putting it in the lowest tier of value for qualified starters. In 2017 he only threw a curveball 6.74% of the time, which means that the negative results didn't hurt him overly often. We shouldn’t expect to see Garcia throw a lot of curveballs this year unless he can get better results with it. Garcia’s slider value in 2017 was right on par with his career slider value at -0.79, so we may see some reduced usage, but this pitch does seem to be one of his weaker ones. Garcia also saw a small improvement in his change-up last year, bringing his value up to 0.24 compared with his career change-up value of 0.11. Perhaps Estrada and Garcia can work together to improve one another’s change-up as Estrada is considered a change-up specialist who had a terrible year last year. 

Garcia put up an fWAR of 2.1 last season across his 3 teams. ZiPS projects him to put up an fWAR of 1.6 this season, which is perfectly acceptable for a 5th starter. If Garcia can get into a groove and continue to get good results on his fastball and change-up values, he will fit well into the Blue-Jays pitching rotation and he can be a valuable asset to the team for his pitching, leadership skills, and World Series experience. If not, it's a one-year deal that won't hurt in the long-run, which makes it a good signing considering where the Jays are at in this point of time.

Happy Opening Day everyone, we hope you'll follow along with QSAO as the season progresses for more Jays and MLB analysis. Catch the Blue Jays Opening game against the New York Yankees on March 29th at 3:37pm on Sportsnet Ontario.

Keep up to date with the Queen's Sports Analytics Organization. Like us on Facebook. Follow us on Twitter. For any questions or if you want to get in contact with us, email qsao@clubs.queensuca, or send us a message on Facebook.

Advanced Baseball Stats for Casual Baseball Fans by Anthony Turgelis

By Anthony Turgelis

We’ve all seen Moneyball. If you haven’t seen Moneyball, go see Moneyball, it’s on Netflix. The ‘Moneyball Revolution’ within baseball has shaken up the game, and changed the way that executives in baseball are looking at the game.

This will be an intro to some of the stats, metrics, and concepts that these executives are looking at. The goal here isn’t just to define what these things are, but rather to show how they can be used as tools of evaluation, to confirm the eye-test, or to just enhance the experience of the game. You might even end up sounding smart in front of your friends. When writing this article, I tried to include everything I wish I knew when first diving into the world of baseball analytics.

To avoid boring you with the history of how this Moneyball Revolution came to be, I’ll only drop one name that you should be familiar with - Bill James. Bill can be credited for being the pioneer of statistical analysis within baseball, as in the 1970s he was one of the first to publish this type of work that would be seen by a wide audience. Many people found his work fascinating, and attempted to replicate it, and - to make a long story short - after 30 years of this, the MLB finally took notice and the Moneyball Revolution began.

Concepts/Terms to Know:

The majority of these terms and concepts have been taken from Fangraphs, which is a site to find many advanced baseball stats and analysis. Links on where to find these concepts/stats will be provided.

Fielding Independent Pitching (FIP) - FIP is an adjusted Earned Run Average (ERA, or runs allowed by a pitcher excluding errors) metric that attempts to quantify what a pitcher’s value would be if they stripped out the defense component of the game. FIP assumes that all balls that are hit into play are given league average results on whether they fall for a hit or not. This way, a pitcher is not penalized for having a bad defense behind him, which certainly would affect their pitching results, and their ERA as a result. FIP is considered predictive as it has higher correlations across seasons than ERA, which makes sense considering it measures things that the pitcher can control and not things like defense which can fluctuate by game and by season. It is adjusted so that the league-average FIP is the same as the league-average ERA. This is done so that it can be easily compared to a player’s ERA to see if they are over/under-performing their FIP, and whether there may be any regression available for the player. There are cases of players who can consistently outperform their FIP numbers, such as Marco Estrada who in 2015-16 was elite at inducing weak contact (which can be considered a skill), so FIP assuming league-average results on balls-in-play would likely paint him as less effective than he actually is. On the other hand, his ERA did balloon to 4.98 in 2017 after significantly outperforming his FIP the previous two years, so the regression bug may have actually hit him as well.

FIP can be found on Fangraphs pitcher pages, such as Marco Estrada’s, next to ERA, where you will find his 2017 FIP to be 4.61.

Batting Average on Balls in Play (BABIP) - BABIP is a player’s batting average on only balls that were put into play, and the average is roughly .300 for both hitters and pitchers. The reason why this is a very important stat, is that it tends to stabilize after 800 balls in play. This means that if a player is having a stretch of months (or even a whole year) where they are achieving a much higher/lower BABIP than league average, and their career average, they are likely due for some regression as they have likely been getting lucky/unlucky on the results of the balls they have put into play. It’s worth noting that better hitters will likely have higher BABIPs, and vice-versa, and some players are able to sustain high BABIPs throughout their career without regression. The 2017 Toronto Blue Jays hitters ranked dead last in the entire MLB in BABIP in 2017, which can be seen as a source of optimism that they may achieve better results on their balls in play in 2018.

BABIP can be found on Fangraphs pitcher/batter pages, such as fringe prospect Dwight Smith Jr’s, who rode a .588 BABIP in 2017 to achieve his .370 batting average, which was less impressive and likely luck-driven given his ridiculous BABIP, and so he still earned a demotion and will likely not get an early look to crack the 2018 team.

Hit Probability - To temporarily stray from Fangraphs, Hit Probability is a metric that was introduced by Statcast at the beginning of the 2017 season to estimate the likelihood that a ball-in-play will be a hit, based on its launch angle and exit velocity compared to similarly hit balls in the past. Similarly to FIP, it attempts to negate the effects of defense and the ballpark on players who may have high percentage hits robbed by star outfielders making unlikely plays, or getting credit for many weak hits that likely would not be repeated. I did an analysis on how the 2017 Blue Jays were being affected by luck based on their hit probabilities, and throughout the season I saw players regress to what their averages were expected to be based on their Hit Probability numbers. The most extreme case was Devon Travis who had a cold start but still had high aggregated Hit Probability numbers but who, as the season progressed, positively regressed to the expected level. The quarter season report can be found here, and the mid-season report can be found here.

Hit Probability statistics can be found on Baseball-Savant here, where you can select any game and see the hit probabilities for all balls in play for that game.

Weighted Runs Created + (wRC+) - wRC+ is an attempt to quantify a player’s total offensive output into one total stat, based on the value of their contributions, after park adjustments. It uses the concept of Weighted On Base Average (wOBA) which simply gives the run value of each plate outcome. For example, it finds that triples contribute to runs roughly twice as often as a single, so a triple would be worth double the value of a single in this calculation. After doing this, you can find out the value of runs created by each player’s offensive outputs. wRC+ is a rate statistic, so it is very easy to be used even in smaller samples to see how a hitter has been performing. It is one of the best tools to use when evaluating a hitter’s offensive abilities. The league average wRC+ is 100, and each point above 100 is indicative of one percentage above league-average.

It can be found on the batter pages on Fangraphs, such as Mike Trout’s, who was the 2017 leader at 181 wRC+, beating Aaron Judge by 8 points even with 19 less home runs.

Park Adjustments - No Two Parks are The Same:

To state the obvious, no two MLB ballparks are the same. The most noticeable difference is obviously the different dimensions, but additionally there are many other factors at play such as weather and other environmental factors. As a result, there tend to be plenty of differences in player performance at different parks, and adjustments are calculated to reduce the effects of these parks as best as possible. They typically are separated for left and right-handed batters, since parks are not always symmetrical, they may favour one-sided batters over another.

Colorado’s Coors Field is regarded as the extreme case of a ‘Hitter’s Ballpark’ - hitters tend to generally perform well there due to the high altitude and large outfield so batters can expect more balls in the outfield to fall for hits. Conversely, AT&T Park in San Francisco is regarded as the largest case of a ‘Pitcher’s Ballpark’ due to its high walls and damp air. Rogers Center in Toronto is ranked as the 8th best ballpark for hitters. Four out of five ballparks in the AL East are considered to favour the hitter over the pitcher, so that could be one of the reasons why a team based in Toronto fails to attract premium free agent pitchers.

The War on WAR:

If you only have time to learn about one advanced stat in baseball, Wins Above Replacement (WAR) is the one to go with. WAR is an attempt to quantify the overall value of a player’s contributions into one easy number. It simply could be put as: The number of wins that you can expect your team to add while employing the player, compared to a different player that would be easily acquired from the minor-leagues or a team’s bench.

WAR is a counting stat and is based on what happened, rather than what will happen in the future. If an MVP-calibre player only played 20 games, they may have a lower WAR than many inferior players, due simply to the fact that they didn’t play enough games to accumulate a high WAR total.

Fangraphs goes into more details of what exactly goes into the WAR stat for hitters, but essentially it is the total value of runs that a batter contributes to the team in the areas of: hitting, baserunning, fielding, divided by how many wins a team can be expected to win with those runs added (Runs/Win generally fluctuates by year but is ~10). It is then adjusted by position (For example: CF is much harder to play than 1B, so they are credited accordingly - more here), adjusted by ballpark, and adjusted to consider the ‘Replacement Level’ player and how much more/less valuable that player is to this imaginary player.

For Pitchers, it is much more complicated, so it’s best to outline the two different WAR stats that are most commonly referenced. First, there’s Fangraphs WAR, commonly referred to as fWAR. fWAR uses Fielding Independent Pitching (FIP) during their calculations, instead of ERA. Recall that FIP is generally regarded as a more predictive stat than ERA, so fWAR could be better used as a tool to project future pitching performance. Conversely, Baseball Reference uses ERA when calculating their bWAR stat. ERA is based on what has actually happened, and could be influenced by team defense among other external effects. These effects are variable by game and are out of the pitcher's control, so this should be seen as more of a ‘what happened in the past?’ stat, rather than a ‘what should I expect in the future?’ stat.


I hope that this article has given you an introduction to some tools to enhance your viewership of baseball. These tools were selected as stats that may challenge how the game is traditionally viewed. Player’s are often over/undervalued by fans since traditional metrics such as batting average will never paint the full picture of their contributions. Hopefully the concepts learned today will allow you to form more complete opinions on player’s teams while enjoying the games.

Keep up to date with the Queen's Sports Analytics Organization. Like us on Facebook. Follow us on Twitter. For any questions or if you want to get in contact with us, email qsao@clubs.queensuca, or send us a message on Facebook.