Back to Six items, one score

Saved evidence · NLSS 2.0.1

Reproduce and inspect

Material 1.0 · NLSS 2.0.1 · R 4.5.2 · 18 September 2026.

Keep the starter and reference folders separate. The starter contains the study materials without answers. The reference includes the finished report, scripts, unrounded checks and original run evidence. No NLSS runtime is included.

Check the numbers independently

From an untouched extracted reference folder, run:

Rscript scripts/check-reference.R scale . ../scale-check-new.json

The checker reads the frozen CSV (or the power assumptions), fits the stated methods directly in R and compares unrounded results. It does not call NLSS's calculation code. The methods share their underlying R libraries; this is independent verification of the NLSS workflow, not an independently implemented mixed-model solver. Package versions are recorded in the saved requests and reference-values.json.

Noniterative tolerance is 1e-8 + 1e-7 * abs(reference); iterative estimates use 1e-6 + 1e-5 * abs(reference). Categories and row membership must match exactly. A check output path must be new. scripts/check-reference.R contains branches for the four example types; only the named case is executed.

runs.json maps each operation to its actual run. material-manifest.json and SHA256SUMS identify the delivered files. They describe the original package before any new runs. The manifest is a material list, not a substitute for NLSS's evidence.

Regenerate the data or replay an analysis

Rscript scripts/generate-data.R ../scale-regenerated.csv
Rscript scripts/check-figures.R scale . ../scale-figure-check-new.json

The fixed generator refuses to replace an existing file. Compare the regenerated SHA-256 with input-version.json. Do not select a new seed to obtain a more convenient result.

For an exact NLSS replay, work in a copy of the complete reference project, including hidden .nlss/ files. Ask your agent:

Prompt for your NLSS agent
Use NLSS replay-run on .nlss/runs/20260918T102405-35b14ea2740/request.json in this copied project. Preserve the original evidence and current working data. Explain any environment or integrity mismatch without weakening the verification.

The supported technical command is Rscript <installed-nlss>/scripts/R/run_nlss.R replay-run --request <copied-project>/.nlss/runs/20260918T102405-35b14ea2740/request.json. Replay adds a new run; it does not rewrite the original evidence or reproduce the agent's prose. Numerical checks, replay and report integrity answer different questions.

The authored report.md was saved through project-report with selected evidence and its revision explicitly verified. That integrity check does not certify scientific correctness. Original protocol presentation is retained: NLSS 2.0.1 can use a figure caption as its heading and number the alt text inconsistently. The report gives an explicit caption; the numerical graphical data are checked separately.

Original material: Mike Hammes. Licenses.