Ranking Score Explained

Hey, thanks for your interest in how we calculate an experience's ranking score. It's at the core of Rankers so I'm pleased you're curious.

The ranking score percentage is used to compare and sort experiences in ranking tables. It is not necessarily a direct measurement of the quality of a particular experience as rated by its customers. I've found it a useful tool to allow me to find the best experiences with confidence. But I've also found it important to read the customer reviews before making any final judgements!

We calculate an experience's ranking score using a multi-factor data model instead of a raw data average (mean). This model takes into account several important questions. For instance - is there a trusted body of reviews? What is the age of a review and is the review from a credible source?

Below you'll find details around some of the important factors that went into calculating the ranking score for Skyline Luge Queenstown.

If you have any questions or comments about our ranking score calculation please get in touch at info@rankers.co.nz. We don't believe this is perfect or complete so we're always interested in ways we might make improvements.

Cymen Crick's avatar

Cymen Crick

Rankers Owner

Skyline Luge Queenstown

Valid Reviews

162 Valid Reviews

The Skyline Luge Queenstown experience has a total of 163 reviews. There are 162 valid reviews that are included when calculating the ranking score and 1 invalid review that are excluded from the calculation. Reviews can be excluded only when a reviewer is not verified or after an investigation by our team determines the reviewer is not genuine.

Below is the distribution of ratings for the 162 valid reviews:

Rating Count Percentage
10/10 39
24%
9/10 47
29%
8/10 40
25%
7/10 23
14%
6/10 9
6%
5/10 3
2%
4/10 1
1%
3/10 0
0%
2/10 0
0%
1/10 0
0%

84.38% Average

The raw data average (mean) for all the Skyline Luge Queenstown valid reviews is 84.38% and is based on 162 valid reviews. This value is not used to calculate the ranking score and it only provided here as a comparison to the weighted average.

Face-to-Face Reviews

121 Face-to-Face Reviews

The Rankers team meets with travellers while they’re in New Zealand and conducts face-to-face surveys. These reviews, in our opinion, are the most trusted in the industry and represent a critical control sample. To our knowledge, we are the only travel review website in the world that has gone to this extent.

More about face-to-face reviews

Within the 162 valid reviews, the experience has 121 face-to-face reviews collected during interviews by our team.

Below is the distribution of ratings for the 121 face-to-face reviews:

Rating Count Percentage
10/10 25
21%
9/10 35
29%
8/10 32
26%
7/10 18
15%
6/10 8
7%
5/10 2
2%
4/10 1
1%
3/10 0
0%
2/10 0
0%
1/10 0
0%

83.39% Average

The raw data average (mean) for all the Skyline Luge Queenstown face-to-face reviews is 83.39% and is based on 121 face-to-face reviews. This value is not used to calculate the ranking score and it only provided here for comparison purposes.

Weighted Average

84.62%

Rankers calculates a weighted mean as a base average on which we can improve. Individual review's ratings are given a weight based on several factors. The weight of a review determines the overall impact it'll have on the final weighted average.

Recent reviews have more weight as they are more relevant and reflect the experience as it currently operates. Over time reviews become less relevant and loose their impact on the ranking score.

Low rating reviews carry slightly less weight. This dampens the effect of very low ratings for every experience across the board. This is especially important when the experience has few reviews overall and a single negative rating can grossly mischaracterise an experience. Consistent poor reviews will still result in the experience receiving a comparitively low ranking score.

Credible sources provide reviews that can be trusted. If we have verified a reviewer is genuine via a face-to-face meeting then the review carries additional weight.

Reviewer Rating Age Relative Weight
Katrina 5/10 2659 days 77%
Nicole and Timm 10/10 2691 days 100%
Phil Baker 8/10 2693 days 98%
Jessica and Henry 9/10 2931 days 84%
Audeme Mechain 9/10 2933 days 84%
C Clarke 10/10 2955 days 84%
Alice Ormandy 7/10 2977 days 76%
Chloe Olsen 6/10 2980 days 70%
Natasha 9/10 3007 days 80%
Barbara Knops 8/10 3012 days 78%
Dries 9/10 3013 days 79%
Rebecca Holmes 6/10 3014 days 68%
Nathalie 10/10 3017 days 80%
Hannah Phoenix 9/10 3021 days 79%
Manu Liberta 10/10 3022 days 79%
Yee How 8/10 3030 days 77%
Nanda Dyke 8/10 3038 days 77%
Austin Jurgensmeyer 9/10 3061 days 76%
Niall Regan 8/10 3069 days 75%
Dita Vasquez 9/10 3082 days 75%
Chadd Holland 10/10 3270 days 64%
Josh Legge 8/10 3283 days 62%
Sonya Grimm 9/10 3284 days 63%
Laura Schafer 9/10 3317 days 61%
Remi Lopez 7/10 3318 days 57%
David Tholander 5/10 3318 days 46%
Melanie Kronbichler 8/10 3329 days 59%
Lea Watterson 9/10 3332 days 60%
Nicola Wiggan 8/10 3372 days 57%
Vanessa 9/10 3655 days 40%
Chris 7/10 3655 days 37%
Sam Smith 7/10 3665 days 37%
Ane Didriksen 9/10 3996 days 19%
Iris Anette Berger 9/10 3996 days 19%
Penny Lee 8/10 4003 days 18%
Kiernan Matthew 9/10 4057 days 15%
Paul Wallace 8/10 4064 days 15%
Daniel Danamer 9/10 4067 days 15%
Andrew Cattanach 8/10 4089 days 13%
Pioter Jurkowski 10/10 4089 days 13%
Rory Seaton 7/10 4090 days 12%
Emeline Dupre 7/10 4090 days 12%
Matthew H 10/10 4242 days 4%
hendrik king 8/10 4303 days 0%
Yves Vennewald 7/10 4382 days 25%
Pia Pitkala 8/10 4384 days 26%
Billy Koichopolos 10/10 4388 days 27%
Gina Lisi 10/10 4388 days 27%
Dave Mertzig 6/10 4395 days 23%
Lorna and Seb 5/10 4398 days 19%
Roeland Driessen 9/10 4454 days 27%
Dagette 10/10 4546 days 27%
Paul Kelly 10/10 4576 days 27%
Esther Goh 10/10 4699 days 27%
Steffien 10/10 4729 days 27%
Jill Homewood 8/10 4753 days 26%
Armin Boehmer 7/10 4755 days 25%
Anne King 8/10 4769 days 26%
Hayley Atkinson 10/10 4771 days 27%
Melanie 6/10 4772 days 23%
Seth & Carla 10/10 4774 days 27%
ToGy 8/10 4789 days 26%
J Bliss 9/10 4851 days 27%
James McColl 7/10 4881 days 25%
neilqecosse 9/10 4942 days 27%
cruisysue 7/10 4973 days 25%
Sam papworth 10/10 5094 days 27%
Jon_and_Family 10/10 5095 days 27%
Gronewold Harm-Dierchs 9/10 5110 days 27%
Steve & Pearl Baker 9/10 5116 days 27%
Victoria Boolsen 9/10 5118 days 27%
Tanya & Florian 10/10 5120 days 27%
taniadeanryanbrittany 9/10 5126 days 27%
Katie Mitchell 10/10 5126 days 27%
Lenore Dejong 9/10 5128 days 27%
Caroline Sheridan 7/10 5130 days 25%
Jacqueline Comer 9/10 5133 days 27%
Lauren Pestell 10/10 5133 days 27%
John 8/10 5138 days 26%
Van den Borne 8/10 5140 days 26%
Julia 9/10 5146 days 27%
georgiarose89 7/10 5185 days 25%
Lyndell 7/10 5216 days 25%
Jill 9/10 5246 days 27%
Andrew Hammond 10/10 5277 days 27%
thomas merrin 10/10 5460 days 27%
Marcus Kippner 8/10 5482 days 26%
John Bost 8/10 5491 days 26%
Jann Clar 9/10 5500 days 27%
Pete Hallam 8/10 5518 days 26%
Samantha Piekuta 8/10 5528 days 26%
Gracieb 9/10 5550 days 27%
wenerz 8/10 5566 days 26%
TomL 8/10 5611 days 26%
eowyn2k 9/10 5611 days 27%
rincoln 8/10 5611 days 26%
paulandcathy 9/10 5642 days 27%
ToryL 6/10 5703 days 23%
jessica 8/10 5746 days 26%
DustyLaptop 8/10 5764 days 26%
gerrys 8/10 5780 days 26%
Sofie 9/10 5795 days 27%
Johnnie 8/10 5806 days 26%
Sally477 9/10 5826 days 27%
kymberlyw 10/10 5826 days 27%
Becca1 10/10 5827 days 27%
Andy Baker 8/10 5845 days 26%
amyd 8/10 5856 days 26%
RichardB1 9/10 5860 days 27%
RobH 10/10 5861 days 27%
Theresa 10/10 5861 days 27%
Brian 8/10 5864 days 26%
Amanda Williams 10/10 5865 days 27%
Kelly23 10/10 5903 days 27%
Ellen 10/10 5938 days 27%
Laura 9/10 5951 days 27%
Jess 10/10 5951 days 27%
Peter 8/10 6000 days 26%
Davina 8/10 6000 days 26%
Jennie 8/10 6031 days 26%
Spike 10/10 6031 days 27%
Zoe Summers 7/10 6037 days 25%
Annie Walsh 6/10 6041 days 23%
Tsmith 9/10 6068 days 27%
Charlie Bond 9/10 6106 days 27%
Rhys Howell 10/10 6167 days 27%
Ben 10/10 6196 days 27%
Benjamin Throk 8/10 6204 days 26%
Elizabeth Woodruff 9/10 6205 days 27%
Jason Page 7/10 6205 days 25%
Stuart Bartram 9/10 6208 days 27%
Klaus Uhl 6/10 6208 days 23%
Beixin Wang 10/10 6211 days 27%
Neil 10/10 6216 days 27%
Emily Houston 7/10 6222 days 25%
Kenneth and Mette 10/10 6225 days 27%
Lena1 9/10 6225 days 27%
Pauline Thai 8/10 6244 days 26%
Bex 9/10 6252 days 27%
Rebekah Holbrook 8/10 6253 days 26%
Simon Chettleburgh 7/10 6253 days 25%
Stephen Brightman 7/10 6253 days 25%
Tim 9/10 6265 days 27%
Hugh McCarthy 7/10 6272 days 25%
Dave Simmons 10/10 6300 days 27%
purplekat99 10/10 6312 days 27%
Wendy Williams 7/10 6317 days 25%
Rene Schotvanger 8/10 6427 days 26%
Julie 7/10 6511 days 25%
Svenja 9/10 6541 days 27%
Michael 9/10 6543 days 27%
Adi 10/10 6551 days 27%
Kate 7/10 6551 days 25%
Raul 9/10 6560 days 27%
Hanneke 7/10 6569 days 25%
Jennifer 9/10 6579 days 27%
Ian 9/10 6579 days 27%
Pam 4/10 6581 days 16%
Fabian 8/10 6583 days 26%
Helle 9/10 6590 days 27%
beesom 6/10 6591 days 23%
Albert 6/10 6608 days 23%

Adjustments

Several adjustments to the weighted average are added to improve relevancy and credibility. These adjustments apply equally to all experiences that meet the criteria.

Sample Size Adjustment

No Adjustment

A reasonable number of reviews are necessary in order for the average to be credible and for an experience to take a prime position within the ranking tables. As such, experiences with only a few reviews have a moderated score. This does not mean that the experience or the reviews can't be trusted. The Skyline Luge Queenstown experience has plenty of reviews and does not meet the criteria for any adjustment.

Recent Reviews Adjustment

-4.01% Adjustment

There may be an adjustment if this experience hasn't received any reviews within the last 57 days. However the Skyline Luge Queenstown experience does not meet the criteria for any adjustment.

In addition, an experience's ranking score may be adjusted for each day there is no new ranking. After 1 day the adjustment comes into effect. The maximum number of days that can be adjusted for is 200 days. Due to the seasonal nature of many businesses, this adjustment is applied dynamically throughout the year.

The Skyline Luge Queenstown experience has been adjusted for 200 days. Adjustments are according to the following table.

Days Adjustment
197 -3.95%
198 -3.97%
199 -3.99%
200 -4.01%
201 -4.03%
202 -4.05%
203 -4.07%

Balancing Adjustment

2.83% Adjustment

Every experience's review score is adjusted to balance out the disproportional number of negative reviews that are contributed.

You won't be surprised to learn that disgruntled customers are more likely to leave a review than happy ones. They are motivated to share their experience and warn others. We consider this a good thing and it's why reading the reviews is important. However we've learned it can misrepresent the experience in a more overall sense.

We apply a balancing adjustment to counteract this effect and ensure the ranking score is a more fair representation of the experience. This adjustment is applied equally to all experiences.

Final Ranking Score

83%

The final ranking score once any adjustments, ratings, and rounding has been applied. This value is recalculated each day and a short rolling average is applied. Therefore it may not be precisely accurate based on the other values presented.