Technical hiring assessments for enterprise buyers
Asked as “coding assessment platform”, and as “technical interview tool”, on behalf of an enterprise B2B company. 45 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing · first-choice share
51%
Clear leader
51HackerRank18Coderbyte13CodeSignal18others
51% of first choices, clear leader.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for an enterprise B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
Show the three products at 0%, ordered by negative rate
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
All fifteen head-to-head pages: the top six products, each against each
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
01
02
03
04
05
06
07
08Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative70%
Key
01HackerRank51%
HackerRank51%02Coderbyte18%
Coderbyte18%03CodeSignal13%
CodeSignal13%04Codility11%
Codility11%05HackerEarth2%
HackerEarth2%06CoderPad0%
CoderPad0%07TestGorilla0%
TestGorilla0%08Mercer | Mettl0%
Mercer | Mettl0%What they warned about
Five of twelve models held their first choice under the paraphrase. Claude Haiku 4.5, Perplexity Sonar, Grok 4.1 Fast, Mistral Small, Llama 4 Maverick, Qwen 3.7 Flash and Kimi K2 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
HackerRank18%
13 of 72 labels negative · 9 of 12 models · 4 hard negative
“Platforms to Avoid for Predictable Costs | **HackerRank** | Per-candidate attempt limits ... overage fees” Kimi K2, budget prompt
CodeSignal17%
11 of 63 labels negative · 9 of 12 models · 1 hard negative
“Platforms to Avoid for Predictable Costs | **CodeSignal** | Credit-based pricing with overage fees” Kimi K2, budget prompt
Codility20%
12 of 59 labels negative · 7 of 12 models · 1 hard negative
“Platforms to Avoid for Predictable Costs | **Codility** | Credit-based system with monthly caps” Kimi K2, budget prompt
HireVue71%
5 of 7 labels negative · 5 of 12 models · 3 hard negative
“"HireVue's AI hiring tools have faced active litigation for age, disability, and accen" ... enterprise teams are moving away from platforms that rely on inferred AI scoring” Muse Glimmer 30B, negative prompt
What they cite
Citations exist only for the models that return a source list: fourteen of the twelve in this edition, and all six flagship models on the expanded tier.
Sites the answers cite
76 of 84 answers in this category came back with a source list, from 14 of 12 models: citations where the model returns them, or the search results it consulted. 1124 links across 217 sites, every framing counted. Ranked by the number of answers carrying the site or page.
vendor site · HackerRank55 answers · 141 citations · 14 models
vendor site · Codility44 answers · 62 citations · 13 models
vendor site · CodeSignal36 answers · 50 citations · 12 models
vendor site · Augment Code29 answers · 35 citations · 11 models
26 answers · 30 citations · 12 models
vendor site · CoderPad24 answers · 29 citations · 10 models
20 answers · 30 citations · 10 models
vendor site · Testlify20 answers · 24 citations · 10 models
vendor site · Intervue19 answers · 23 citations · 8 models
vendor site · Guideflow17 answers · 19 citations · 8 models
vendor site · TestGorilla16 answers · 21 citations · 10 models
vendor site · Coderbyte15 answers · 27 citations · 10 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
35 answers · 13 models
34 answers · 13 models
28 answers · 11 models
25 answers · 12 models
16 answers · 9 models
16 answers · 8 models
15 answers · 10 models
15 answers · 8 models
12 answers · 7 models
11 answers · 6 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best coding assessment platform”, “coding assessment platform”, “technical assessment platforms”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| HackerRank hackerrank.com | 51% | 248 | 33,100 | 1,116 | 58,699 | 22 | 4 | |
| Coderbyte coderbyte.com | 18% | 82 | 2,400 | 60 | 2,019 | 93 | ||
| CodeSignal codesignal.com | 13% | 173 | 14,800 | 548 | 152,420 | $5,323 | 23 | 9 |
| Codility codility.com | 11% | 199 | 3,600 | 114 | 3,042 | $108 | 3 | |
| HackerEarth hackerearth.com | 2% | 40 | 1,300 | 48 | 47,481 | 0 | 8 | |
| Adaface adaface.com | 2% | 22 | 260 | 2 | 20,658 | |||
| Testlify testlify.com | 2% | 45 | 480 | 6 | 43,586 | 0 | ||
| CoderPad coderpad.io | 0% | 133 | 18,100 | 269 | 34,657 | 9 | 2 | |
| AbilityScreen abilityscreen.com | 0% | 12 | 0 | 2 | ||||
| Karat karat.com | 0% | 23 | 14,800 | 58,074 | 5,890 |
Google's top ten for the three searches hold 20 sites; 3 of them are among the sites the models cited here (coderpad.io, codesignal.com, hackerrank.com). The first result for “best coding assessment platform” is algocademy.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best coding assessment platform for an enterprise B2B company?”Paraphrase“Which technical interview tool would you recommend to a large B2B company with thousands of employees?”Comparative“What are the top enterprise-grade technical assessment platforms and how do they differ?”Budget-constrained“What is the best coding assessment platform for a large company that needs predictable total cost across thousands of users?”Scale-constrained“We are a 5,000 person company with SSO, SOC 2 and procurement review requirements evaluating a coding assessment platform. What should we look at?”Negative“Which technical assessment platforms should a large enterprise avoid or be cautious about?”
Claude Haiku 4.5Codility, HackerRankno first choiceChangedCodilityCoderbyteno first choiceagainst: Codility, HackerRank, HireVue, Pluralsight
One alternative
iMochaTwo alternatives
CodeSignal, HackerEarthTwo alternatives
Codility, HackerRankGPT-5.4 miniHackerRankHackerRankHeldCodilityCodilityagainst: CodeSignal, HackerRankno first choiceagainst: Turing
Two alternatives
CodeSignal, CodilityTwo alternatives
CodeSignal, KaratFive alternatives
CodeSignal, CoderPad, HackerRank, Karat, Mercer | MettlGemini 3.5 FlashCodeSignalCodeSignalHeldHackerRankagainst: Glider.aiCoderbyteagainst: Codility, HackerRankno first choiceagainst: CodeSignal, Codility, HackerRank, HireVue, Karat, Mercer | Mettl, TestGorilla
Three alternatives
CoderPad, Codility, HackerRankFour alternatives
Byteboard, CoderPad, HackerRank, KaratFive alternatives
CodeSignal, CoderPad, Codility, HackerEarth, iMochaTwo alternatives
CodeSignal, TestDomePerplexity SonarHackerRankCodeSignalChangedCodeSignal, HackerRankCodeSignalno first choiceagainst: CodeSignal, Glider.ai, HackerEarth, LeetCode, TestGorilla
Two alternatives
CoderPad, CodilityTwo alternatives
HackerRank, IntervueFive alternatives
AbilityScreen, CoderPad, Codility, Mercer | Mettl, TestGorillaTwo alternatives
Codility, HackerRankGrok 4.1 FastCodility, HackerRankHackerRankChangedagainst: CodilityHackerRankAdafaceagainst: CodeSignal, CoderPad, CodilityHackerRankagainst: Codility, HackerRank, iMocha
Two alternatives
CodeSignal, CoderPadTwo alternatives
CodeSignal, CoderPadFour alternatives
CodeSignal, CoderPad, Codility, iMochaTwo alternatives
Coderbyte, HackerRankThree alternatives
CodeSignal, CoderPad, CodilityMistral SmallHackerRankCodeSignalChangedHackerRankCoderbyteno first choicenothing named
Two alternatives
CodeSignal, CodilityTwo alternatives
Codewave, HackerRankFive alternatives
CodeSignal, Codility, HackerEarth, Questionmark, TestGorillaOne alternative
CodilityDeepSeek V4 FlashHackerRankHackerRankHeldHackerRankCodeSignalagainst: Codility, HackerRank, TestGorilla, iMochaHackerRankagainst: CodeSignal, Codility, CodinGame, HackerEarth, HackerRank, HireVue, Mercer | Mettl, Qualified.io, TestGorilla
Three alternatives
CodeSignal, CoderPad, CodilityThree alternatives
CodeSignal, CoderPad, CodilityFive alternatives
CodeSignal, CoderPad, Codility, TestGorilla, iMochaOne alternative
GoodfitTwo alternatives
CodeSignal, CodilityLlama 4 Maverickno first choiceTestlifyChangedno first choiceno first choiceCodilitynothing named
Two alternatives
InCruiter, LeverTwo alternatives
CodeSignal, HackerRankQwen 3.7 FlashHackerEarthHackerRankChangedCodility, HackerRankCoderbyteagainst: CodeSignalno first choiceagainst: Codility, ExamSoft, HackerRank, Honorlock, Mercer | Mettl, ProctorU, Proctorio, SHL, TestGorilla
Two alternatives
CoderPad, HackerRankTwo alternatives
CodeSignal, CoderPadFour alternatives
AbilityScreen, CodeSignal, Karat, Mercer | MettlTwo alternatives
Codility, HackerRankKimi K2Codility, HackerRankHackerRankChangedagainst: KaratCodeSignal, HackerRankCoderbyteagainst: CodeSignal, Codility, HackerRankno first choiceagainst: CodeSignal, CoderPad, Codility, HackerRank
Two alternatives
CodeSignal, CoderPadOne alternative
CodeSignalThree alternatives
CoderPad, Codility, TestGorillaTwo alternatives
Bryq, TestGorillaGLM 4.7 FlashXHackerRankHackerRankHeldHackerRankHackerRankno first choiceagainst: HackerRank
Three alternatives
CodeSignal, CoderPad, CodilityThree alternatives
CodeSignal, CoderPad, CodilitySix alternatives
CodeSignal, CoderPad, Codility, DevSkiller, Mercer | Mettl, TestGorillaTwo alternatives
Adaface, CodeSignalMiniMax M2.5HackerRankagainst: CodeSignalHackerRankHeldHackerRankCoderbyteno first choicenothing named
Three alternatives
CoderPad, Codility, HackerEarthTwo alternatives
CodeSignal, HireVueSix alternatives
AbilityScreen, CoderPad, Coderbyte, Codility, HackerEarth, TestGorillaOne alternative
HackerRankBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Seventy-two rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:16 | yes | 9 | 10 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:28 | yes | 3 | 4 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 09:51 | yes | 15 | 25 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-10-01 10:26 | yes | 17 | 4 s |
| Direct recommendation | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 07:40 | yes | 21 | 10 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:04 | yes | 9 | 5 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:06 | yes | 21 | 40 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 08:47 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 10:20 | no | 0 | 34 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 08:44 | yes | 17 | 22 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:55 | yes | 18 | 127 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 08:26 | yes | 12 | 23 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:23 | no | 0 | 4 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:12 | yes | 5 | 5 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:34 | yes | 10 | 26 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-10-01 10:29 | yes | 23 | 5 s |
| Paraphrase | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 08:20 | yes | 25 | 10 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:52 | yes | 5 | 4 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:44 | yes | 24 | 23 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 09:39 | yes | 5 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 11:39 | no | 0 | 24 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 07:41 | yes | 19 | 19 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 11:46 | yes | 24 | 42 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 08:55 | yes | 15 | 24 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 09:50 | yes | 9 | 9 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 09:27 | yes | 7 | 9 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 12:14 | yes | 26 | 58 s |
| Comparative | Perplexity Sonar | sonar | 2026-10-01 08:04 | yes | 19 | 7 s |
| Comparative | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 10:28 | yes | 24 | 10 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 07:55 | yes | 14 | 12 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 08:06 | yes | 23 | 32 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 12:03 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 09:19 | yes | 10 | 26 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 08:47 | yes | 20 | 32 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 12:00 | yes | 22 | 93 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 07:56 | yes | 19 | 25 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 08:41 | yes | 15 | 9 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 08:23 | yes | 3 | 4 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 09:11 | yes | 17 | 26 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-10-01 08:51 | yes | 18 | 3 s |
| Budget constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 10:28 | yes | 20 | 9 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:58 | yes | 5 | 3 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 08:50 | yes | 24 | 23 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 08:18 | yes | 5 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 08:58 | yes | 18 | 130 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 10:59 | yes | 14 | 27 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 10:49 | yes | 22 | 52 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 11:17 | yes | 24 | 35 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 11:02 | no | 0 | 6 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 11:14 | yes | 3 | 9 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:56 | no | 0 | 17 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-10-01 08:12 | yes | 20 | 8 s |
| Scale constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 07:38 | yes | 17 | 9 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 07:54 | no | 0 | 8 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 11:55 | yes | 25 | 47 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 10:36 | yes | 5 | 2 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 11:42 | no | 0 | 30 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:20 | yes | 14 | 23 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 10:30 | yes | 15 | 46 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 12:06 | yes | 9 | 28 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:53 | yes | 18 | 9 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 07:46 | yes | 3 | 6 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 09:17 | yes | 26 | 29 s |
| Negative framing | Perplexity Sonar | sonar | 2026-10-01 10:42 | yes | 19 | 3 s |
| Negative framing | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 09:58 | yes | 22 | 8 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:29 | yes | 14 | 9 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 11:21 | no | 0 | 58 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 11:54 | yes | 5 | 2 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 07:52 | yes | 25 | 55 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:55 | yes | 22 | 23 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:47 | yes | 25 | 39 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 11:15 | yes | 19 | 39 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
None. Every name in this category resolved on its own.
Unresolved, counted raw
CodeScreen
LeetCode for Business
Qualified.io
Discontinued, still offered
No shut-down product was recommended here.