In December 2017 we unveiled the true potential of Cloudflare’s scale: to find the best commercially available mince pie and let the world know about it. In 2018 we’ve all been extremely busy helping Cloudflare & our customers and therefore we left it very late this year. Uncomfortably late.
If you want to know the best mince pie to buy in 2018 right now, skip straight to the bottom of this post where we reveal the winner. If you want to understand more about what makes a mince pie great and how we can learn this at Cloudflare’s scale - read on.
How do you review 42 varieties of mince pie in an hour?
With a very short amount of time to get this research out to a discerning and demanding public, we engaged the entire Cloudflare London team to help. Team members diligently went out and purchased mince pies from all over the South East of England for everyone to taste.
On Monday the team assembled for a “Mince Pie Jam”, where we would taste & consistently review each pie:
A quick refresher - what is a mince pie?
As we can see from even the most cursory Internet search, there’s a lot of questions surrounding mince pies. After some confusion relating to our 2017 edition of the IMDB we should clearly state: modern mince pies do not contain meat. A Mince Pie is “a sweet pie of British origin, filled with a mixture of dried fruits and spices called mincemeat, that is traditionally served during the Christmas season in the English world.” - Wikipedia for Mince Pie
Our methodology
We reviewed the mince pies in terms of its characteristics as well as overall. Each mince pie was given a score of 1 to 10 for each of the following:
Innovation
Booziness
Pastry to Filling Ratio
Pastry
Mince
Overall rating
The top 3 categories there are somewhat objective measurements compared to the more subjective ones below. During analysis, this created some exciting opportunities.
Analysis
With this combination of 3 subjective & 3 objective metrics and a total of 214 submitted reviews by our team, we had a lot of data. To break this data down Nela quickly settled on the Pearson Correlation Coefficient (PCC).
The Pearson Correlation Coefficient
Wikipedia describes the PCC as follows:
The correlation coefficient ranges from −1 to 1. A value of 1 implies that a linear equation describes the relationship between X and Y perfectly, with all data points lying on a line for which Y increases as X increases. A value of −1 implies that all data points lie on a line for which Y decreases as X increases. A value of 0 implies that there is no linear correlation between the variables.
By setting our X Value as the Overall Rating, we were able to plug in each of the other metrics from our reviews as the Y value, to understand how important each of these characteristics are in producing a high quality result.
2018 Internet Mince pie Database evaluation criteria coefficient. Explore the full dataset
From this data we can conclude that satisfaction with a pie’s mince filling is the most likely criteria for overall pie satisfaction with r=.841
, while innovation creates a negative correlation implying that traditional mince pies are favoured, and straying from this will only lead to dissatisfaction. Alcohol content had a minor positive correlation while pastry, pastry to filling ratio, and aesthetic had an average positive correlation.
Word Association
Along with scores, our reviewers also left tasting notes which gave an insight into how they arrived at their scores. Taking the reviews which scored a mince pie from 1-5 we’re able to see the terms most associated with poorer performing pies:
Pies scoring between 6 and 10 points had the following terms used the most in tasting notes:
Also-rans and notable mentions
Before we get to the final overall rankings, there’s a few categories we wanted to mention.
The Most Expensive Pies
Unsurprisingly, some of the most expensive mince pies come from London’s fanciest Restaurants & Bakeries. The 3 most expensive mince pies did not rank highly enough to feature elsewhere - which goes to show you that money doesn’t necessarily buy you the best mince pie.
Ottolenghi Mince Pie
Overall
Price
Booziness
Aesthetic
Pastry-to-Filling Ratio
Innovation
Pastry
Filling
6.647
£10 for 4 (250ppp)
8.176
8.471
7.647
4.000
6.588
6.059
A Dickensian-styled thing of beauty, I expected a pie-seller to appear muttering "gawd blimey guv'nor thems good pies". Good bite, alcohol was raw and overly pungent, tasty but I needed a quiet lie down afterwards.
Flourish Mince Pie
Overall
Price
Booziness
Aesthetic
Pastry-to-Filling Ratio
Innovation
Pastry
Filling
7.167
230ppp
3.167
6.333
8.167
6.000
7.667
6.667
Deeelicious and moist. A little citrus and Christmas on the finish
St. John Mince Pie
Overall
Price
Booziness
Aesthetic
Pastry-to-Filling Ratio
Innovation
Pastry
Filling
6.273
230ppp
6.273
4.000
6.727
4.727
6.182
6.000
In a word, dense. Dense filling, dense pastry. A bit too heavy all round.
The Bottom 3
Below are the 3 lowest scoring mince pies in 2018. We publish this not to humiliate but in the hope that these bakers will learn & improve for 2019.
Tesco Mince Pie Cookies
Overall
Price
Booziness
Aesthetic
Pastry-to-Filling Ratio
Innovation
Pastry
Filling
2.4
£3.00 for 8 (~38ppc)
3.2
1
2
10
2.8
1
The 10 on "experimental" here means ... experiment gone badly wrong. If ratings allowed for complex numbers, this one would score an overall '10i'.
ASDA Extra Special All-Butter Luxury
Overall
Price
Booziness
Aesthetic
Pastry-to-Filling Ratio
Innovation
Pastry
Filling
4.2
£1.50 for 6 (25ppp)
6
3
2
3.75
5.75
4.5
A bit dry and what on earth is all that air doing there?! Get out and put mince in!
Aldi Holly Lane Mince Pies
Overall
Price
Booziness
Aesthetic
Pastry-to-Filling Ratio
Innovation
Pastry
Filling
4.667
£0.75 for 6 (~13ppp)
5.667
3
4.333
1.667
5
4.333
BANG average from Aldi. I don't know where Holly Lane is but if I were to guess it would be firmly in the middle of somewhere. Slightly chalky, pasty pastry and sweet uninteresting mince.
The most innovative mince pies
Nela’s impressive Pearson Correlation work showed that there is actually a minor negative correlation with mince pies that are highly innovative. During tasting we observed that innovative pies drew people in but they most definitely divided opinion. Here are the 3 most innovative mince pies (as ranked by their innovation score).
Heston from Waitrose Chocolate & Cherry Mince Pies
Overall
Price
Booziness
Aesthetic
Pastry-to-Filling Ratio
Innovation
Pastry
Filling
5.600
£3.00 for 6 (50ppp)
5.800
5.400
5.400
9.600
4.200
6.000
Bad
ASDA Extra Special All-Butter Caramel Crumble Pies
Overall
Price
Booziness
Aesthetic
Pastry-to-Filling Ratio
Innovation
Pastry
Filling
6.667
£2.00 for 6 (~33ppp)
7.333
1.000
4.000
9.333
7.333
6.667
Interesting but this is not a mince pie
Aldi Black Forest Mince Pies
Overall
Price
Booziness
Aesthetic
Pastry-to-Filling Ratio
Innovation
Pastry
Filling
6.700
£1.99 for 6 (~33ppp)
6.000
2.300
7.200
9.300
5.500
6.800
Absolutely amazing taste however questionable as a mince pie ????
The overall chart
Here are 2018’s top mince pies as stringently tested by the Cloudflare mince pie QA engineers:
2018 Internet Mince pie Database Rankings. Explore the full dataset
The IMDB Top 3 mince pies for 2018
M&S Bakery Mince Pies
Overall
Price
Booziness
Aesthetic
Pastry-to-Filling Ratio
Innovation
Pastry
Filling
8.400
£1.30 per pie
8.200
4.400
8.000
3.200
8.000
8.400
I tried it twice. Will probably try to grab another one. Even with 14 others in-between the first and the second sampling, my preference hasn't changed. To me this is the star of the show. Yum!
Gail’s Bakery Mince Pies
Overall
Price
Booziness
Aesthetic
Pastry-to-Filling Ratio
Innovation
Pastry
Filling
8.200
£8.75 for 6 (146ppp)
7.700
4.900
8.000
4.300
8.000
8.300
Tasty filling, with a solid pastry. A great all rounder, if a little sweet with extra filling peel and topped sugar on the pastry.
Iceland Luxury Mince Pies
Overall
Price
Booziness
Aesthetic
Pastry-to-Filling Ratio
Innovation
Pastry
Filling
7.500
£1.89 for 6 (~32ppp)
6.000
3.500
6.000
3.000
3.500
9.500
Iceland are a dark horse here - the mince here elevates the fairly pedestrian pastry - which is pale and a little bit chalky in texture. But that mince - full of complexity - there's a hint of banana in here despite there being no actual bananas. HOW DID THEY DO THIS? DELICIOUS
Thanks
Thanks to everyone at Cloudflare who took part in this extensive research. If you’re inspired by some of the questions answered in this blog post and you like spiced fruit and intense pastry debates then Cloudflare is hiring in London and all over the world.
Happy Holidays!