Nexus RaidOps evaluation methodology
How Scores Work
The simplest way to think about it is that NRO gives the player five scored measurements, then shows Adaptability & Improvement separately as a Mechanical trend visual. It does not turn the same Warcraft Logs signal into six different scores.
Each of the five scored categories produces a percentage-style result from 1 to 100 using the evidence that belongs to that category. The Improvement Trend instead compares current Mechanical execution with historical performance. Score and evidence confidence remain separate, so limited information does not silently become poor performance.
Evaluation category
Role Performance
Question: How well did the player perform the combat job they were brought to do?
We use Warcraft Logs information such as:
- Warcraft Logs overall role percentile on an included ranked kill
- Warcraft Logs item-level bracket percentile from that same ranked kill
- The specialization actually recorded on the ranked pull
- Damage or healing activity across the pulls included in the Calculation Run
- Damage, healing, item level, boss contribution, and damage-taken context retained beside the score
- Report, difficulty, fight, character, realm, region, class, and specialization identity used to select the ranking
The current automatic Raid Night Role Performance model is validated for DPS and healers. Role Parse Blend V2 uses the Warcraft Logs overall role percentile at 80% relative weight and the item-level bracket percentile at 20%. If one ranking component is unavailable, the available component is proportionally reweighted rather than replaced with a neutral value.
Raid-night damage or healing activity remains visible as diagnostic context, but it does not add or subtract Role Performance points. Active time already affects the output that produces the Warcraft Logs percentile, so scoring it again as a separate 25% component could count overlapping performance evidence twice and affect roles differently.
Tank and Support evidence is still collected, but NRO does not turn a tank's damage parse or a support player's damage ranking into a Role Performance grade. Those roles remain N/E until their own mitigation, defensive, control, and support-performance models are validated.
A Warcraft Logs percentile is accepted only when it belongs to a ranked kill included in the current Calculation Run and matches the specialization recorded for that pull. If the ranking or spec identity cannot be established, NRO keeps the local output evidence as context instead of manufacturing a score.
Boss-level reports may also show local output percentile, active time, and boss-target contribution for progression context. That encounter analysis is separate from the Raid Night Role Performance headline and does not substitute for a missing Warcraft Logs ranking.
Evaluation category
Utility and Team Contribution
Question: How well did the player use the extra tools available to them to help the raid?
This covers things outside their normal rotation and outside specifically assigned jobs, such as:
- Confirmed unassigned interrupts
- Validated dispels, purges, crowd control, rescues, grips, and externals
- Safe observed raid support such as movement support or approved off-role support
- Validated battle-resurrection and pull-recovery decisions
- Covering another player's missed responsibility when ownership is proven
- Warlock preparation support without multiplying credit by pull count
Today's logs reliably prove some useful actions, but they do not yet enumerate every player-owned chance that was missed. After the first score-eligible contribution, the provisional index uses a 20-point evidence floor. Normalized contribution frequency can add up to 75 more points with diminishing returns. It never invents a failure.
NRO does not yet have a complete class, specialization, and talent capability denominator. Because of that, the provisional score does not award points simply for using more distinct kinds of Utility. Breadth remains visible evidence until NRO can prove what tools the player's actual build had available. This prevents naturally broader class kits from receiving an automatic scoring advantage.
Pulls normalize the amount of positive evidence, but attendance never becomes a failure. Assignment-owned work remains in Assignment Execution. A raw cast that depends on its target, strategy, timing, or effectiveness remains visible evidence but does not automatically add provisional Utility credit until that context is validated.
Once an evidence source can certify the complete opportunity denominator, NRO will use the formal model: successful opportunities earn full credit, partial successes earn half, and confirmed player-owned misses earn zero. The four lanes below are reweighted when a lane truly had no opportunity.
Formal opportunity weighting, once coverage is complete
Evaluation category
Consistency
Question: If we put this player in the same situation again, can we expect roughly the same level of performance?
Consistency compares like-for-like pulls inside the current Raid Night. NRO keeps boss, difficulty, role, and observed specialization separate, then limits the comparison to pulls with similar progression and pull duration.
- Same player, boss, and difficulty
- Same evaluation role and observed specialization
- Similar boss-health progression
- Similar pull duration
- Validated Mechanical and Assignment execution
- Role-appropriate DPS or HPS when that signal is validated
Two comparable pulls are enough for a provisional Consistency score. Evidence strength remains Limited at first, becomes Moderate with five comparable pulls, and becomes High at eight or more.
Execution Stability uses the actual earned credit from Mechanical and Assignment opportunities. A 70% Assignment timing result therefore contributes 70% to that pull's Assignment execution rather than disappearing or being converted back into a binary pass.
Performance Stability measures how much the player's DPS or HPS moves around their own progression-matched local baseline. This is repeatability, not an absolute quality ranking. Role Performance remains responsible for answering how strong the player's actual output was.
Dependable Floor looks for unusually weak output relative to that same local baseline and begins contributing after five comparable performance pulls. Before then, the supported components are proportionally reweighted. Missing evidence is never replaced with a neutral score.
Tank and Support do not receive an invented DPS or HPS stability model. When no validated role-output signal exists, their Consistency score can come from Execution Stability alone, with reduced component coverage recorded in the evidence.
Cross-Night Repeatability belongs to the Team Season view. The Raid Night processor never pretends that one night contains multi-night evidence.
Single-Raid-Night component weighting
These are relative weights. NRO proportionally reweights only the components that have validated evidence; it does not insert a neutral value for a missing component.
Evaluation category
Assignment Execution
Question: Did the player complete the specific jobs the raid plan gave them?
This includes documented or leadership-confirmed assignments such as:
- Interrupts
- Soaks and immunities
- Dispels and crowd control
- Healing or defensive cooldowns
- Tank swaps and positioning
- Priority targets
- Baits and special positioning
- Add control
- Combat-resurrection priority
Assignments are weighted by importance:
We also account for timing, difficulty, whether the player was primary or backup, whether the assignment was actually possible, and whether another failure prevented them from completing it.
A documented or confirmed assignment always takes priority. NRO should not invent a missed cooldown, interrupt, or soak that the player was never clearly given.
For strict timed assignments, use within ±5 seconds earns full credit. Credit then decreases continuously: 10 seconds off earns 80%, 15 seconds earns 60%, 20 seconds earns 40%, 25 seconds earns 20%, and 30 seconds earns zero. Missed assignments and cooldowns consumed outside the valid assignment window earn zero.
AMZ, Darkness, Rallying Cry, and Zephyr use a separate effectiveness model. NRO measures how much of the intended incoming-damage window the actual defensive covered, so a useful defensive is graded by protection effectiveness instead of timing alone. If the planned window contained no meaningful damage, the opportunity is N/E rather than an artificial success or failure.
Evaluation category
Adaptability and Improvement
Question: Is the player's Mechanical execution improving, steady, or declining compared with their own historical baseline?
Adaptability & Improvement is not a sixth score. NRO displays it as a speedometer-style trend so the raid leader can see the player's current Mechanical execution against that player's normal Mechanical performance.
- Middle / AVG: the player's historical Mechanical average
- Blue needle: this Raid Night's Mechanical result relative to that average
- Gauge range: -20 points at the far left to +20 points at the far right
- Change: the exact +X.X or -X.X percentage-point difference
- Improving: +3.0 points or better
- Steady: between -2.9 and +2.9 points
- Declining: -3.0 points or worse
The overall gauge compares this Raid Night's Mechanical score with the player's average Mechanical score from prior Raid Nights at the same difficulty. The current Raid Night is excluded from its own baseline so it cannot pull the average toward itself.
Boss views compare this Raid Night's Mechanical result on that boss with the player's prior Raid Night average on the same boss and difficulty. Pull views can compare an individual pull with that boss baseline. The historical average always occupies the center of the speedometer; the gauge itself represents deviation from average, not another 0-100 performance score.
Normal, Heroic, and Mythic are always kept separate. The Improvement Trend never changes the Mechanical Execution score and is not included in five-score averages, rankings, strongest-score comparisons, or weakest-score comparisons.
Evaluation category
Mechanic Parse
Question: Of the mechanics the player had a fair opportunity to handle, how many did they handle correctly?
NRO first has to prove that a mechanic created a fair, player-owned opportunity. A formal Mechanic Parse requires at least three scored opportunities. One or two observations remain coaching evidence and do not become a formal 0 or 100.
Every validated scoreable opportunity currently counts equally in the formal success-rate score. The mechanic-level breakdown still shows the exact mechanic names, successful outcomes, failures, exclusions, and evidence used to defend the result.
Important protections include:
- Unavoidable damage does not count as a failure.
- Role-exempt or strategically accepted events are excluded.
- Assignment-owned work stays in Assignment Execution.
- Ambiguous or incomplete source evidence fails closed instead of becoming a score.
- Repeated damage ticks from one validated occurrence are grouped so one mistake is not multiplied.
- Failure-only mechanics can record proven contacts but cannot invent clean successes for uninvolved players.
Mechanic Parse is not a Warcraft Logs ranking and it is not simply avoidable damage taken. It is an opportunity-based measurement of whether the player handled validated encounter mechanics correctly.
Reading the result
What the final scores mean
All five scored categories use the same percentage-style 1–100 scale, while each category uses its own evidence and calculation. Adaptability & Improvement is displayed separately as a trend visual.
85–100
Exceptional
70–84.9
Strong
55–69.9
Solid
40–54.9
Developing
Below 40
Needs Attention
N/E
Not enough fair evidence