We’re updating our flight review scoring — Here’s what you need to know

Sep 20, 2019

This post contains references to products from one or more of our advertisers. We may receive compensation when you click on links to those products. Terms apply to the offers listed on this page. For an explanation of our Advertising Policy, visit this page.

Reviews have been at the very core of The Points Guy since Brian began writing back in 2010. We’ve certainly come a long way since then, and today, TPG himself and the rest of the team have reviewed hundreds of flights and hotels all over the world. We’ve aimed to review as many products as we can, from Emirates first class all the way down to the back of the bus on Spirit. Our team has a range of voices, each giving their unique perspective. And, at the first-ever TPG Awards at the end of 2018, we introduced a new scoring system in order to more definitively evaluate products.

Oman Air first class (Photo by Zach Honig / The Points Guy)

When we first set out to introduce a scoring system, we decided that we would judge each flight against itself. It is an experience, after all, and one that can change depending on a number of factors. However, we recognize that because the flight experiences can vary so widely — even on the exact same route, aircraft and cabin — it becomes difficult to objectively separate flights from one another, especially as the volume of flights and number of reviewers grows.

(Photo by Emily McNutt/The Points Guy)
Virgin Atlantic premium economy on the A350 (Photo by Emily McNutt/The Points Guy)

So today we’re introducing the next iteration of our flight review scoring: an official review rubric that the TPG team will use to measure most aspects of the flight experience. After completing a flight, the reviewer will submit their notes to the reviews team — made up of a small group of TPG editors and expert flight reviewers — along with a proposed score. The reviews team will then meet to discuss the review before assigning a final score. 

Using this new checklist as a scoring guideline will help mitigate some of the inherent subjectivity in our flight review scores. The reviews team has spent countless hours and hundreds of thousands of miles in the air, so they’ll have much more context when assigning a score. 

Korean Air business class (Photo by Nick Ellis/The Points Guy)

The new scoring checklist includes well over 200 questions for each cabin class — economy, premium economy, business and first class. We’re even going to start collecting some new statistics like the seat-to-bathroom ratio and a (flight attendant) call button response test, which will help us more objectively measure and evaluate the product and service.  

When meeting with our team of experts, we realized that different aspects of a flight matter more or less depending on what cabin you’re sitting in. As such, we are also changing the allocations for each flight review category. Currently, all categories are weighted equally across cabins: 10 points for Ground Experience, 25 points for Cabin and Seat, 15 points for Amenities and IFE, 25 points for Food and Beverage and 25 points for Service.

Starting today, the new allocations will be as follows.

Category Economy Premium Economy Business Class First Class
Ground Experience 5 10 20 20
Cabin and Seat 30 30 30 20
Amenities and IFE 40 30 15 15
Food and Beverage 15 20 20 25
Service 10 10 15 20

Lastly, our review scores continue to be valid relative to a given cabin. For instance, if a Singapore Airlines A380 economy review scores an 87 and a Thai Airways Boeing 747 first-class review scores a 75, it doesn’t mean that you should choose Singapore economy over Thai first class. It just means that Thai’s first-class product isn’t all that great compared to its first-class peers.

(Photo by Javier Rodriguez / The Points Guy)
Aeroflot economy (Photo by Javier Rodriguez / The Points Guy)

We hope that this new scoring system will help you when you’re deciding which airline and product to fly. We’re incredibly excited by the next chapter in our flight reviews, and look forward to having you on board with us.

Featured image by Zach Honig / The Points Guy

2018 TPG Award Winner: Mid-Tier Card of the Year
Chase Sapphire Preferred® Card

NEW INCREASED OFFER: 60,000 Points

TPG'S BONUS VALUATION*: $1,200

CARD HIGHLIGHTS: 2X points on all travel and dining, points transferrable to over a dozen travel partners

*Bonus value is an estimated value calculated by TPG and not the card issuer. View our latest valuations here.

Apply Now
More Things to Know
  • Earn 60,000 bonus points after you spend $4,000 on purchases in the first 3 months from account opening. That's $750 toward travel when you redeem through Chase Ultimate Rewards®
  • 2X points on travel and dining at restaurants worldwide & 1 point per dollar spent on all other purchases.
  • No foreign transaction fees
Intro APR on Purchases
N/A
Regular APR
17.99% - 24.99% Variable
Annual Fee
$95
Balance Transfer Fee
Either $5 or 5% of the amount of each transfer, whichever is greater.
Recommended Credit
Excellent/Good

Editorial Disclaimer: Opinions expressed here are the author’s alone, not those of any bank, credit card issuer, airlines or hotel chain, and have not been reviewed, approved or otherwise endorsed by any of these entities.

Disclaimer: The responses below are not provided or commissioned by the bank advertiser. Responses have not been reviewed, approved or otherwise endorsed by the bank advertiser. It is not the bank advertiser’s responsibility to ensure all posts and/or questions are answered.