vercel/edge-runtime
main · 0f5504bPublicCached · audited 9 September 2026Edge Runtime installs cleanly but its documented quickstart, build, and test commands all fail on a clean clone, leaving the project's core promise unverified.
Install succeeds, but the README quickstart throws ERR_MODULE_NOT_FOUND, pnpm run build fails offline fetching Google Fonts, and pnpm test fails across five packages. CLI output lacks --json and documented exit codes. Version-support and CI-parity signals are clean, but clone-to-working-code fundamentals are broken.
BROKEN_QUICKSTARTfired
code: 'ERR_MODULE_NOT_FOUND'
}
Node.js v24.19.0
closes when: the documented quickstart reaches a verified outcome from a clean clone inside 15 min
What we ran
StageCommandExitElapsed
installpnpm install --recursive --loglevel=error — from .github/workflows/test.yml line 33026 s
buildpnpm run build — from package.json line 37 · cut at our 10-minute budget129 s
testpnpm test — from package.json line 41 · cut at our 10-minute budget117 s
executenode -e "import('edge-runtime').then(async ({EdgeRuntime}) => { const runtime = new EdgeRuntime(); const result = await runtime.evaluate('1 + 1'); console.log(result); })" — from docs/content/getting-started.mdx line 2010.1 s
verifynode -e "import('edge-runtime').then(m => { if (typeof m.EdgeRuntime !== 'function') throw new Error('EdgeRuntime export missing'); console.log('EdgeRuntime export OK'); })" — from docs/content/getting-started.mdx line 1810.1 s
Full stdout and stderr for every command is in the JSON export. 4 commands exited non-zero; the findings below carry each one.
Nine areas
Observedwe executed it — can reach 100
Reviewedread the code and its generated output — capped at 84
Estimatedprose only — capped at 69
AreaWeightScore barEvidenceScore
Time to first value max 10020 → 22Observed15
API max 6915 → 17Estimated30
SDK10 → 0fewer than two SDK packages sharing the product namenot scored—
CLI and configuration max 8410 → 11Reviewed45
Errors and recovery max 8412 → 13Reviewed40
Documentation max 10010 → 11Observed40
Local development max 1008 → 9Observed25
Testing and quality max 1008 → 9Observed35
Release and compatibility max 697 → 8Estimated65
Findings
Two, ranked by severity. Every one carries the command that proves it and a prompt that closes it.
P0onboarding and setup · execute stage · placeholder
Documented quickstart fails with ERR_MODULE_NOT_FOUND
The README-documented import of edge-runtime throws ERR_MODULE_NOT_FOUND immediately after a clean install, so new users cannot reach a verified outcome.
Observed
node -e "import('edge-runtime').then(async ({EdgeRuntime}) => { const runtime = new EdgeRuntime(); const result = await runtime.evaluate('1 + 1'); console.log(result); })"
Closes when
placeholder
placeholder
We never modify your repository. · Disagree with this finding?
P2
pnpm run build was not observed within DX Score's 10-minute execution budget
buildHard gates
A gate is a defect serious enough that no average can wash it out. One fired gate makes the verdict FAIL, whatever the number says.
GateResultWhat we checked
BROKEN_CANONICAL_INSTALLpasspnpm install --recursive --loglevel=error exits 0 from a clean clone with no credential prompt
NON_REPRODUCIBLE_BUILDunverifiedinstall, build and test did not finish inside our 10-minute execution budget — the standard allows 10 min, so nothing here has failed; we just didn't see the end of it
BROKEN_QUICKSTARTfirednode -e "import('edge-runtime').then(async ({EdgeRuntime}) => { const runtime = new EdgeRuntime(); const result = await runtime.evaluate('1 + 1'); console.log(result); })" exits 1 at the execute stage, so the documented quickstart never reaches a verified outcome
UNVERIFIABLE_CI_PARITYpassthe package.json test command pnpm test appears in .github/workflows/publish.yml, .github/workflows/test.yml, .github/workflows/update.yml, doc:README.md
UNTESTED_SUPPORTED_VERSIONpassevery version the repository claims to support appears in the CI matrix
UNSAFE_EXAMPLESpassno secret-shaped strings found in examples or docs
UNEXPLAINED_ERRORunverifiedno break or diagnose step executed — inventory-only evidence yields P2 findings, never this gate
UNDOCUMENTED_BREAKING_APInot yetneeds two versions to compare — coming in v2
SDK_API_DRIFTnot yetneeds an OpenAPI JSON spec and an SDK language to compare — not in v1
STALE_PUBLIC_REFERENCEnot yetneeds a generated reference to compare against behaviour — not in v1
engine 0.5.0devex-skills 2.9.4+de1abc8anthropic/claude-sonnet-5 · temperature 0runner dx_journey.pyjourney plannedsandbox universal · 2 vCPU1 hard gate fired