Sitelet https://github.com/ClickHouse/ClickBench/pull/2488
Skip to content

[DO NOT MERGE] chDB: test query memory guard on two-vCPU machines - #2488

Closed
ShawnChen-Sirius wants to merge 3 commits into
ClickHouse:mainfrom
ShawnChen-Sirius:codex/chdb-thread-memory-ab
Closed

ShawnChen-Sirius wants to merge 3 commits into
ClickHouse:mainfrom
ShawnChen-Sirius:codex/chdb-thread-memory-ab

Conversation

@ShawnChen-Sirius

Copy link
Copy Markdown
Contributor

Warning

DO NOT MERGE. This is a temporary benchmark-only pull request and will be closed after the comparison.

Purpose

Test whether max_threads_min_free_memory_per_thread=1 GiB unnecessarily reduces query parallelism on the two-vCPU ClickBench machines.

The new chdb-rc-no-final-lz4-i1-thread-memory-0 entry keeps the established configuration unchanged:

  • chDB 4.4.0 with chdb-core v26.9.0
  • auto_statistics_types=''
  • LZ4 with adaptive codec selection disabled
  • max_insert_threads=1
  • no OPTIMIZE FINAL

The only measured-path change is max_threads_min_free_memory_per_thread=0. It is set on each chDB session immediately before the timer starts, so the SET execution itself is excluded from query time.

max_insert_threads_min_free_memory_per_thread is intentionally unchanged: with max_insert_threads=1, the insert-side limiter cannot reduce parallelism further.

The release-candidate-only post-run profiler is omitted because v26.9.0 predates benchmark/load_profile.py. That profiler ran outside all measured windows and did not affect ClickBench results.

Intended comparison

Compare t3a.small and c6a.large with the chdb-rc-no-final-lz4-i1 results from #2463, focusing on Combined, Cold, Hot, and per-query ratios.

Validation

  • bash -n for every shell entry point
  • python3 -m json.tool for template.json
  • python3 validate-results.py (39,546 files validated; only six pre-existing Infobright warnings)
  • local query-wrapper smoke test using the official chdb-core v26.9.0 wheel

…a.2xlarge, c6a.4xlarge, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl)
@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Results for chdb-rc-no-final-lz4-i1-thread-memory-0 are ready for: c6a.2xlarge, c6a.4xlarge, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl.
The result files are committed as 164978f.
Preview of the benchmark page with these results

Logs:

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Results for chdb-rc-no-final-lz4-i1-thread-memory-0 are ready for: c6a.large, t3a.small.
The result files are committed as 2f53924.
Preview of the benchmark page with these results

Logs:

This branch is waiting to be deployed

1 waiting deployment
benchmark-approval — 2f53924e Waiting Oct 9, 2026 by robot-clickhouse via launch #715
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants