Advertisement
What can WSL judges show the surfers when they storm the judging tower? A blank page full of empty boxes?

School teacher reveals missing “rubric” that has the power to transform professional surfing into world’s biggest global sport!

Disinterest and  indifference to pro surfing is at all-time high. Time to talk rubrics.

When the tour opens at Pipe on January 29, it’ll mark almost 10 years since the WSL began running the show. 

Back in 2013, after the tour was taken over by ZoSea, one of the chief architects of the takeover Paul Speaker said, “For the first time we’re able to approach this league as a global centralized sports league…and it’s essential for those of us who are already engaged, and those who are invited in, see it as one of the premier global sports in the world.” 

One of the premier global sports in the world? 

It’s fair to say, rather politely, that the WSL hasn’t quite reached those heights. 

Advertisement

The ASP gave us the world’s best surfers in the world’s best waves concept but since then the tour has stagnated badly. 

One reason is the judging system. 

And, I’m gonna tell ya why. 

Rubrics.

Advertisement

Or lack thereof.

The WSL Judging Problem #1

On page 82 of the WSL rulebook, in Chapter 13, are the rules pertaining to judging WSL events. Here’s a screen grab from the section relevant to how judges score waves.

From the information contained in Section 13.05 above, I have taken that info and used it to create a scoring rubric, seen below.

If you’re not familiar with these things called rubrics, they’re just fancy info charts often used for scoring. Especially in academia land. They normally resemble something like the one below, which my university writing department uses to grade student essays. 

Comparing the two rubrics, it’s not too hard to see the problem with the WSL one, is it? 

Advertisement

Yep, it’s fucking blank. 

It’s got the five scoring categories along the top and the breakdown of scores down the left side… and that’s it. 

From the rule book, page eighty-two, this is what we get regarding judging and wave-scoring. A few ambiguous bullet points devoid of any detail or elaboration whatsoever. 

And when converted into standard rubric form, it’s completely fucking empty! 

Advertisement

This is where I become concerned. 

When your scoring rubric is completely empty and missing some scoring accoutrements that might serve to help or guide the presiding judges, how can you tell me that the scores the judges are coming up with in WSL events, including WCT events, are anything more than a hopeful, ambitious guess? 

How can they be anything else when you’re working from a blank page?

Tell me, according to the WSL judging rubric above, what separates a “Good” score and a “Very Good” score in terms of Commitment and Degree of Difficulty? 

Advertisement

Blank. 

How do you know a score is “Excellent” in the Combination of Major Maneuvers category? 

Blank. 

Why is something only “Fair”, and not “Good” when it comes to Speed, Power and Flow? 

Advertisement

Blank. 

Then compare the WSL’s rubric and with my uni’s essay writing rubric, and you see the difference. 

Unlike the WSL’s blank rubric, all the categories have information for graders to draw upon. 

In addition, the info included in the rubric is just the bare bones. We also have full booklets regarding each category and each square to help our marking be as accurate and consistent as possible. 

Advertisement

For example, in the Lexis (Vocabulary) category, we use the New General Service List (NGSL) as our standard. The NGSL is the most widely accepted and cited vocab list in English language learning. It lists the 2,800 most basic, commonly used words in English, starting from “the” at Number 1, down to “thirst” at Number 2,801. 

Therefore, when scoring the “Lexis” category, we look for fancy words in the essay that are outside the top 2,800 words from the NGSL.

For instance, if a student writes “The WSL judging system is calamitous”, then that will score well. 

Why? 

Advertisement

Firstly, ‘cause “calamitous” is a great word that sits way outside the top 2,800 word list and, secondly, ‘cause he student has used the word in its correct adjectival form, “calamitous”, as opposed to  “calamity”, the noun form.  

What do the WSL judges have in their grading rubric? Nada. Zero. A blank page. 

That being the case, I come back to my initial point, how can the scores that the judges give for every single wave be anything but a hopeful, calculated guess?

Big problem.

Advertisement

The WSL Judging Problem #2

This ain’t the only issue. 

In the WSL’s official rulebook, and specifically in Chapter 13 related to judging, there’s no clear info about whether the five categories that surfers are judged on are equally weighted or not. 

Is Speed, Power and Flow as important as Variety of Maneuvers?

Advertisement

Is Innovative and Progressive Maneuvers deemed equally as crucial as Combination of Major Maneuvers? 

On page 82, the rulebook states, “It’s important to note that the emphasis of certain elements is contingent upon the location and the conditions on the day, as well as changes of conditions during the day.”

Very ambiguous, and perhaps a deviously cunning way to remain vague regarding distribution of scores for a surfer’s waves. 

Don’t say which category’s more, or less, important, then lean on whichever one serves your defence the best.  

Advertisement

However, when you take the whole “maybe, might, possibly, could; never commit and everything’s good” approach, you will always come unstuck, eventually.  

So let me give you a perfect example of why such a lack of clarity illustrates how murky and inconsistent the WSL judging can be. 

The video below is of Griffin Colapinto at Haleiwa in 2019. 

Colapinto's Clutch Hail-Mary Air - Hawaiian Pro 2016

Advertisement

Dying seconds and he takes off on a closeout and chucks a huge frontside air. Lands it perfectly. Crowds cheer. Ross Williams in the commentary box loves it. Lots of wows. Clutch. Gets a 9.93/10. Three out of five judges give him a 10. 

Watching live, you might get caught up in the excitement of it all. 

However, objectively, we all know Haleiwa ain’t no one-turn wave. Never has been. And wasn’t on this day.

So you can immediately chuck out the whole, “It’s important to note that the emphasis of certain elements is contingent upon the location and the conditions on the day” caveat in the WSL rulebook. 

Advertisement

It’s Haleiwa.

We have a problem. Let’s go to the judges’ scoring categories. 

Commitment and Degree of Difficulty? 10 all day.
Innovative and Progressive Maneuvers? Pretty massive, let’s give him a 10.
Combination of Major Maneuvers? That’s a no. It was a one-turn closeout Hail Mary air. 

Variety of Maneuvers? No again. Just one air. 

Advertisement

Speed, Power and Flow? Objectively, no. It was a take-off to half-face bottom turn to massive air. But we might argue the case. 

Thus, even with our empty, blank rubric above, Griffin only adhered to 2/5 category criteria. Combination of Major Maneuvers wasn’t there, nor was Variety of Maneuvers. Even if you make the argument for Speed, Power and Flow successfully, it’s still only 3/5 criteria met. 

So how can he get a 9.93, including a 10 from three of the judges, when he only met 2/5 scoring criteria categories, or 3/5 at best on a reef wave that allows surfers multiple turns? 

To hammer my point home, here’s John John’s 10 at the most recent 2021 Haleiwa contest.

Advertisement
John John Florence Goes Perfect In Haleiwa Final | Michelob ULTRA Pure Gold Haleiwa Challenger

Frontside air to tail slide into a big layback hack into a nice tube and finished off with a faultless, frontside air reverse on the closeout section. 

Commitment and Degree of Difficulty? Yep
Innovative and Progressive Maneuvers? Yep
Combination of Major Maneuvers? Yep

Variety of Maneuvers? Yep

Advertisement

Speed, Power and Flow? Yep

JJF’s wave meets all criteria, he gets a 10. Fair enough. Griffin’s wave meets 3/5 criteria at best, he gets a 9.93. At the same location. 

WTF?

More specifically, who is actually affected and why is it such a big problem?

Advertisement

The Stakeholders

Pro Surfers: How often do we see surfers in heats frustrated, baffled, or incandescent with rage when they hear the scores announced over the loudspeaker? Pretty much every round of every contest. It sure makes it hard to please the judges when the judges don’t have anything to look at or guide you with. 

You want to know how detached from reality the scoring is for surfers? 

Watch this video of JJF and Jordy discussing all things surfing and contests.

Advertisement

From the four-minute mark, they talk judging and scores and both vehemently agree that the most important thing in a heat, without a shadow of doubt, is making sure you’re on the best wave.  

John Florence & Jordy Smith -- On The Process

Slight problem. Wave selection isn’t even in the five categories the judges use to score a wave.

Is that not the most insane thing you’ve ever come across in competitive sports at an organisational level?

Advertisement

The most important thing in a heat, according to two superstars of the sport, is a factor not even listed in the official WSL rulebook related to judging?

The Judges: I feel sorry for the judges. How are you supposed to adjudicate with any degree of consistent accuracy when your help guide is a blank page?

As someone in a similar position, I can tell you, unequivocally, those rubrics are indispensable lifesavers.

How so?

Advertisement

Imagine sitting in your office happily browsing BeachGrit when your door is suddenly assailed by furious bashing and crashing. Little Johnny is waving his essay in the air demanding to know why he got a D.

In those moments, there ain’t nothing like calmly, confidently pulling out those rubrics and asking Johnny to take a seat.
The conversation, paraphrased, then goes something like this:
“Oi, Johnny, did your essay have this?”
“No.”
“This?”
“No.”
“That?”
“No.”
“Then fuck off and cry somewhere else. And fix your fucking essay”

What can WSL judges show the surfers when they storm the judging tower?

A blank page full of empty boxes?

Advertisement

The Expert Fans: You can’t con the longtime fans who know their surfing inside out. Judging controversies and blowups on social media don’t make the sport more interesting, or engaging.

Ridiculous scoring turns the hardcore fans away.

The Novice Fans: If you’re trying to attract new people, you’ve gotta be able to explain to them exactly what’s happening on a wave and why a surfer is getting X score and Y score. Commentators can’t do that ‘cause their guess is as good, or bad, as anyone else’s.

If the new fans can’t grasp what is going on, they won’t stick around.

Advertisement

The Commentators: They’re in a hard position because they have to explain to the viewer what the surfer’s doing and how they’ll be rewarded. Nothing like making yourself look like a giant peckerhead in front of thousands of people on air when you give a wave a six and the judges give it a nine. Or vice-versa.

Commentators should be able to predict, with confidence, what the scores will be and be able to break down exactly why.

Especially for the novice fan.

Right now, they can’t do that with any kind of confidence so you get the endless drivel dished up that’s so often meaningless and banal, and, at times, humiliating for the commentators.

Advertisement

The WSL: Old Man Ziff and Cocaine Cowboy handsome E-Lo and all the characters up at Santa Monica HQ might have delusions of grandeur, but if you can’t get your scoring right, nothing progresses.

Nothing.

Disinterest and  indifference to pro surfing is at all-time high. Yeah, more people are in the water, but they ain’t marching to the WSL’s tune.

The WSL website is seldom even in the top five  surfing websites according to most available metrics.

Advertisement

How do they think they’re going to attract new global fans when judges, surfers, commentators, and fans can’t really explain the scoring, and it often makes no sense?

The Solution

The good thing is that there is so much room for improvement.

The first step’s pretty obvious, fill in the blank rubric.

Advertisement

It also needs to work with the judges on inter-rater reliability and (re)examine the categories’ cause I imagine their internal consistency would currently be a mess.

From there, I’ll let the BeachGrit commentariat add their views in the comments section.

But if you really want to know every step necessary, send me an email at: [email protected] and I’ll tell you how to fix it.

0 0 votes
Article Rating

Commented on Disqus? Log out, tap the Disqus button, and your old name and comments come back. The box is ours.

Join the discussion

Your comments are still here. Every one of them.

Twelve years of BeachGrit comments came across from Disqus. Connect and we will show you how many are yours. We get your username, nothing else.

Unclaimed
Handle
Comments
Posting since

Connect Disqus to reveal.

Subscribe
Notify of
73 Comments
Newest
Oldest Most Voted
Stanislav Franck

sad but true. Can’t give shorebreak airs at Pipe a high score eh!

Stanislav Franck

I’m probs in the massive minority here but fuck it. I reckon if you fall on a wave you should be penalised, same as you are in other subjectively judged sports like ice skating, gymnastics etc.

I don’t mean have your whole wave thrown out the window but you shouldn’t get a high 9 if you fall, regardless if you went bonkers on the turns before it.

Low wide stinkbug stance

Whats your take on that sick barrel slater got where he slipped off in the barrel but stood back up and made it out. Judges called it “incomplete”. I thought it should have been a 9 but they gave it some shit score.

I guarantee if i was paddling out in a normal surf and saw it, i would have told him it was sick, not shit for falling off!

Stanislav Franck

Can’t remember it off the top of my head, but as boring corpo companyman as it sounds, it should be clear in some capacity – rubric or something else. As long as it’s written down, we’re all reading from the same sheet, rather than guessing, which is my major beef.

But for the sake of committing, I’d say incomplete. It’s Kelly, so he’s made a million meaty barrels in his life… kinda like how I’m iffy on guys that make massive airs then fight the whitewash lying down for 10 seconds then stand up. Is that a clean make? Or just crazy flexible gymnastics?

Certainly ain’t no flow, that’s for sure…

Low wide stinkbug stance
Occ Topus

Good article about the shortcomings of WSL judging, Stan. A long read, yes… but at least it’s surf-related.
Unfortunately, the Wozzle’s problems run far deeper than just wave scoring.

At the end of the day, however, although I’m a fan of pro surfing, it’s not a big deal to me. Actually getting out in the ocean and riding waves personally is how I define surfing.

Stanislav Franck

Mate, I haven’t been near a contest since boardriders 30 years ago, so I’ve got no vested interest in the world tour. Competition? I grumble when one bloke paddles out!

I just can’t stand seeing such incompetence repeated year after year. In their grandiose visions, this is supposed to be a rich, global sport but it’s fucking amateur hour.

I think it’s sad that if my two young daughters ever say “hey dad, I wanna be a pro surfer” I’ll wack ’em across the chops with the new set of golf clubs I’ve bought them.

Beef & Beer

My best time for the Rubik’s cube back when I was 14 or 15 was 42 seconds, and I regularly did it around the minute mark.
Now over 40 years later I still do it between 3 and 5 mins with a skinful of beer and bong.
Bow down before my cubic wizardry…

Hot stuff

That’s amazing.
Seriously.

DavidC

Man I could never work those fuckers out – the best way I could solve them was peal of the colours & re-arrange them!

Chazz Michael Michaels

I’ve never seen anyone solve a Rubik’s cube that wasn’t a sad little cunt.

Jack Barlow

Is your life ruled by envy?

Beef & Beer

Stop doing it in front of a mirror then…

ricmatic

Good article, in a war and peace type of way

Stanislav Franck

Just trying to make the average BG article more than 100 words…

Picard Madeoff

Sophie was the best thing ever for WSL, she is missed!

Low wide stinkbug stance

Rubrics are cool if you can actually quantity the thing you’re defining. Won’t work in surfing because you’d get Christian Fletcher scored the same as Rob Machado for the same turns.

Surfers are always gonna complain when they lose on their last wave. Usually becuase they know they didn’t do enough. Occasionally you get flavour of the month surfers (e.g. young Slater) pushed by the judges and guys get robbed but not usually.

Fixing pro surfing depends on making surfing cool again. Tennis tour is not cool.

Stanislav Franck

Anything that’s subjective is hard to quantify in black and white but you can do a fucktonne better than the WSL. In figure skating, for example, they have multiple documents totaling well over 100 pages on scoring/judging from the various related rules etc.

The WSL’s PDF has 5 bullet points…

Mapski

“Combination” and “Variety” are the same thing. “Innovation” seems to be anything done since 1980(Kevin Reed, Matt Kechele, etc…). They should just let Slater define good surfing and give him titles 12 through 20 as a life time achievement award.

samwaters

Hahaha, does he extra points for punching his boards when he loses.

Slater has about much soul as an old worn out tennis shoe.

Mapski

Soul is your mythical criteria.

Chazz Michael Michaels

Do you find much soul in all the comment sections you’ve inhabited over the years?

c4

I think what they’re talking about with variety is to not do the same exact kind of backside top turn ten times in a row on the same wave, or even the same heat.

Low wide stinkbug stance

Yeah it’s weird because in the Hardman / Lynch era that’s what won you heats, especially on the backhand.

c4

Wiggolly’s top turn is sick and throws spray fifteen feet in the air but he does the same one every time, same with Nat Young. Medina and Owen wright are good at mixing it up by doing a foam climb, then a carving off the top etc.

P.S if Ben wanted to make himself useful he should write a story about Kevin Reed.

Mapski

I’ve got an old Breakout mag that has a Kevin Reed profile. Lots of photos of him boosting big airs on sweet looking Pearson twin fins.

c4

I guess he’s homeless now or something. I used to see him surf at steamers and he was an incredible talent.

Mapski

Saw him launch at the Katin pro am. Judges stiffed him.

@surfads

Wilko did alright with that approach

Jack Barlow

It’s Medinas only move besides an air.
You know exactly what he will do before takes off

Hot stuff

Yeah
Murder the thing.

@surfads

Yeah his win over parko at snapper was actually what I thought of first.

He was swinging it like a metronome.

c4

Seems like when surfers first get on tour the judges are OK with it. Maybe I’m imagining it but it seems like medina’s surfing has evolved since then.

One surfer that has gotten away with it it Caroline Marks. I guess they’re not as critical with the girls

DavidC

Could never understand how wet the judges get about her backhand – I can’t recall her ever blowing a tail, very conservative top turn!

c4

Safety turn

Low wide stinkbug stance

Marks and Tatiana.

Low wide stinkbug stance

He was way overscored in that final. I love the way he surfs and he’s git a bit of cunt about him (e.g. that drop in on slater), but parko won that final.

Chazz Michael Michaels

Your arse is hanging out again.

Do you even know what you’re looking at?

DavidC

Yeah, that hot run year he had the judge’s loved it – then the next year they hated it!

Low wide stinkbug stance

Wilko was on fire for about 12 months and the judges loved it. Very retro. I grew up with that kind of surfing and loved watching it.
But then it fell out of favour again and that was the end o Wilko.

Which does bring up the fickle state of judging I suppose.

ricmatic

surfing needs a bunch of new words.

Hot stuff

Yeet!!

ricmatic

Good one. What does it mean?

Hot stuff

As an exclamation, yeet broadly means “yes”. But it can also be a greeting, or just an impassioned grunt, like a spoken dab.

Stanislav Franck

Inclusivity

Gelato Pickle

Hmm not sure about this. Feels like a pivot back towards the days when judges were counting maneuverers and measuring length of ride. Surfing is too nuanced to be judged according to rubrics. Scores should come from the heart – backed up by a solid knowledge of the sport and its precedents of course. And as Hot Stuff says the best surfers do seem to be winning. So what if non-surfers from Oklahoma aren’t jumping on board in their droves because it’s hard to follow. Fuck ’em. Doesn’t mean there’s something wrong.

Stanislav Franck

The WSL’s existing five categories should ensure 4 to the beach can never come back.

Preston

Bingo. Well said Stan, but this assumes people actually care. Which I don’t think so in the context of ever becoming interesting to a non-surfing audience.

Stanislav Franck

I care coz I just found out how much tennis coaches charge. Which is even less than fucking golf coaches.

Sit down to pee

The problem can be summed up by the old fable my law professor used “how do you describe an elephant?”

AI (for ever) .

Every time an announcer said “Kelly” he got a extra point.

Pretty sure that’s how pro surfing judges work!

Urchin Sepsis

Rubicks cubes are for kooks

Stephen Wolfram

I tried to read this, started getting a headache. Might be the hangover headache kicking in though.

Stanislav Franck

I got a headache when I wrote it

NEGATRON

I’m about to start judging the National champs tomorrow and I couldn’t even read this whole article let alone understand the first part about rubric cubes. Not sure what I’m trying to say but it’s not good.

astro

Whatever they’re paying you is too much.

Manuka

You missed the point. He was talking about Stanley Rubric and the Woosle Clockwork brainwashing.

Phat-wan kerr

just stick to greased palm method. you are still going to get someone having a whinge about a result regardless. at least you get to hear it with full pocket.

samwaters

Milk toast, yes men, pro surfers, storming the judging tower–to bite the hand that feeds them?
Well, maybe in an alternate universe.
The days of Sonny and et al, are long gone.

NEGATRON

It still happens Freerider.

PacificNorthPest

Rubrics exist 1) to make College of Education grad students feel like they know something special 2) to make English department undergrads feel like someone ready their essay 3) to make it easy for K-12 teachers to shirk grading duties under the beard of “peer assessments.”

In short, they are the movie Brazil of pedagogy.

And as such, yes, perfect for the WSL.

@surfads

‘The movie Brazil of pedagogy’ is a 9.93 all day

Stanislav Franck

yep, they’re boring as fuck but if they’re well constructed they do a lot to eliminate the infuriatingly nonsensical scores that no-one can explain if/when called out.

Karl Von Fanningstadt

When asked directly about Griff’s score and whether the lack of an official rubric makes it harder for judges to satisfactorily determine what a 9 or 10 point ride actually is, WSL’s Chief Media Nonsense and Bullshitting Strategies Officer, Dave Prodan responded, “A 10-point ride?… I shall not today attempt further to define the kinds of material I understand to be embraced within that shorthand description; and perhaps I could never succeed in intelligibly doing so. But I know it when I see it, and the wave [Griff’s] involved in this case is exactly that.”

Seeking comment on that quote offered by Prodan, BeachGrit reached out to former Tour surfer and current WSL Judge, Ben Dunn, who didn’t know what was going on and could only offer up, “hmmmrmmris ghejesj hrrr Moore schhhejd,” or something like that (his mouth was stuffed too full of bread and marbles to be intelligible).

More as the story develops.

Hot stuff

Judging seems OK to me.
Gmed x3
JJF x2
Ital x1
Jordy, duck egg.

Stanislav Franck

As the great saying goes, even a clock’s right twice a day…

Hot stuff

Yeet!!

Hippy

Yeah man, you’re identifying the symptoms, not the disease.

Judging is the least of their failures.


73
0
Would love your thoughts, please comment.x
()
x