the-mindscape-of-bro-tsong/scripts
wantsong 3f6f00a82e Close Round 04.1 selector patch 2026-06-18 02:27:12 +08:00
..
README.md Close Round 04.1 selector patch 2026-06-18 02:27:12 +08:00
check_card_contract.py feat: build model library mvp foundation 2026-06-17 01:59:56 +08:00
check_model_card_sync.py feat: build model library mvp foundation 2026-06-17 01:59:56 +08:00
rebuild_indexes.py feat: build model library mvp foundation 2026-06-17 01:59:56 +08:00
run_round04_blind_routing.py Close Round 04.1 selector patch 2026-06-18 02:27:12 +08:00
run_round04_post_patch_verification.py Close Round 04.1 selector patch 2026-06-18 02:27:12 +08:00
run_selector_calibration_smoke.py Prepare Round 03.2 selector review bundle 2026-06-17 22:58:40 +08:00
run_selector_demo.py Close Round 04.1 selector patch 2026-06-18 02:27:12 +08:00
run_selector_regression.py feat: build model library mvp foundation 2026-06-17 01:59:56 +08:00
validate_model_library.py fix: harden qpi selector round 03.1 review 2026-06-17 22:10:58 +08:00

README.md

Scripts

This folder contains simple local scripts for validation and selector demos.

Current script:

  • validate_model_library.py
  • check_card_contract.py
  • rebuild_indexes.py
  • check_model_card_sync.py
  • run_selector_regression.py
  • run_selector_demo.py
  • run_selector_calibration_smoke.py
  • run_round04_blind_routing.py
  • run_round04_post_patch_verification.py

Run:

python scripts\validate_model_library.py

The script checks JSON parsing, required model fields, unique IDs, source references, excerpt references, regression case model references, and model/card index drift. It writes reports/validation_report.md.

Rebuild or check model/card indexes:

python scripts\rebuild_indexes.py --write
python scripts\rebuild_indexes.py --check

The index script regenerates models/model_index.json and cards/card_index.md from model JSON, card files, and regression cases. It writes reports/index_rebuild_report.md.

Run the card contract checker:

python scripts\check_card_contract.py

Run the selector demo:

python scripts\run_selector_demo.py

Run selector regression and model/card sync checks:

python scripts\run_selector_regression.py
python scripts\run_selector_calibration_smoke.py
python scripts\check_model_card_sync.py

run_selector_calibration_smoke.py checks selector calibration inputs, including strict no_call, no_call_or_low_priority, select_qpi_reject_ia, and IA heavy-depth gate expectations.

Run Round 04 blind routing evaluation:

python scripts\run_round04_blind_routing.py

This reads selector/round04_blind_inputs.json and writes reports/Round04_blind_routing_evaluation_report_2026-06-18.md. It does not score correctness or use expected routing labels.

Run Round 04.1 post-patch routing verification:

python scripts\run_round04_post_patch_verification.py

This reruns the frozen Round 04 input pool after selector rule patches and writes reports/Round04_1_post_patch_routing_verification_report_2026-06-18.md. It is not a second blind test.

Prefer Python standard library before adding dependencies.