Sitelet https://github.com/luojiyin1987/hpc-sandbox-benchmarks/tree/main/apps/cli
Skip to content

Latest commit

 

History

History
 
 

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 

@sandbox-benchmarks/cli

Role: the entrypoint app — wires the five @sandbox-benchmarks/* packages into runnable commands.

Bins (bin, no exports):

  • bench-lifecycle — measure each provider's lifecycle (spawn→exec→snapshot→teardown) and control-plane (sandbox info/list) timings directly in the harness, the axes PTS cannot see. Flags: --iterations N (cold-start cycles/provider), --control-plane-samples N, --no-snapshot. Providers with absent creds skip; per-Metric distributions go to stdout JSON, a timing log to stderr.
  • bench-suite — run the full suite across the matrix.
  • plan-providers — print the selected provider ids as single-line compact JSON (honors BENCH_PROVIDERS); in Actions writes providers= via emitStepOutputs and logs through @actions/core.
  • plan-suites — print the selected suite names as single-line compact JSON (blank BENCH_SUITES = every suite — the targeted/pre-merge knob); in Actions writes suites= the same way.
  • plan-matrix — print the full provider × suite benchmark matrix as single-line compact JSON (cell listing for local inspection / discovery; CI fans out via plan-providers + plan-suites).
  • build-template — build a provider's sandbox template.
  • normalize — turn raw runs into normalized run documents.
  • aggregate — merge shard Runs into one candidate.
  • promote — promote normalized results to the published dataset.
  • leaderboard — render a Run as Markdown (LEADERBOARD.md); used by the dataset publish job.
  • bake / bench-smoke / stability — toolchain bake, single-cell smoke, cross-run stability gate.

Depends on: all five packages (workspace:*) + dotenv (catalog:).

What lives here: thin command wrappers under src/bin/; shared command helpers under src/lib/ (never imported across a package boundary). As an app it has no exports — nothing imports the CLI.

Run a bin directly during development: bun apps/cli/src/bin/plan-matrix.ts.