Repository navigation
cracktro: add CLI vs MCP slide to Cost Optimization - #78656
Merged
Merged
Conversation
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
…request data Mine same-workflow gh-proxy switches from run usage artifacts and add the cracktro refresh mini-skill to recompute them. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
…p discovery, files and pipes The MCP side now shows list_code_scanning_alerts pouring every field of every alert into context; the bash side discovers gh api with --help, writes every page to alerts.json and pipes out counts with jq/sort/uniq/head. Measured schema-overhead data moves to a single caption footnote. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
pelikhan
marked this pull request as ready for review
November 17, 2026 09:14
…-vs-mcp-slide # Conflicts: # .github/skills/cracktro/content-rules.md
Contributor
There was a problem hiding this comment.
🟡 Changes recommended
The cache can follow attacker-controlled symlinks and truncate developer-writable files, the new heading violates an exact-text test assertion, and block-scalar parsing misclassifies measurements, compromising the schema-overhead comparison.
4 open issues
What changed in this PR
Adds a CLI vs MCP slide to the cracktro deck’s Cost Optimization band, illustrating how CLI discovery, files, and pipes can reduce data entering agent context.
Changes:
- Adds an animated comparison with synthetic code-scanning examples and a measured first-request token caption.
- Adds a run-artifact miner and refresh instructions, including measurement limits and confounding factors.
- Updates the slide index, refresh registry, and public-content rules.
| File | Description |
|---|---|
docs/public/cracktro/deck.js |
Adds slide visuals, animation, commands, and speaker notes. |
.github/skills/cracktro/slides.md |
Registers the slide and its takeaway. |
.github/skills/cracktro/refresh/cli-vs-mcp.mjs |
Mines workflow usage artifacts for before/after comparisons. |
.github/skills/cracktro/refresh/cli-vs-mcp.md |
Documents measurement sources, refresh steps, and limitations. |
.github/skills/cracktro/data-refresh.md |
Links the new refresh guide. |
.github/skills/cracktro/content-rules.md |
Records the slide’s measured-data exception. |
Review effort: Balanced (adaptive)
| const CAP = +(process.env.CAP || 15); | ||
| const DAYS = +(process.env.DAYS || 7); | ||
| const NCTRL = +(process.env.CONTROLS || 15); | ||
| const CACHE = process.env.CACHE || join(tmpdir(), "cvm-cache"); |
| sfx.pop(7); | ||
| }); | ||
| }, | ||
| el: h("section", { class: "slide cvm" }, h("div", { class: "slide-head" }, h("div", { class: "kicker" }, "gh-proxy + cli-proxy · bash, files and pipes, not context"), h("h2", {}, letters("CLI"), letters("vs", "l-out"), letters("MCP", "l-grad"))), svg), |
| // Read the MCP side's compiled lock: GH_AW_MCP_CLI_SERVERS_LIST names servers that cli-proxy mounts as CLIs | ||
| // on PATH (no tool schemas in context). Frontmatter alone misses cli-proxy set by imports. | ||
| const lock = await git("show", `${x["-"] === "local" ? commit + "^" : commit}:.github/workflows/${wf}.lock.yml`).catch(() => ""); | ||
| const mcpCli = /GH_AW_MCP_CLI_SERVERS_LIST: .*`github`/.test(lock); |
|
|
||
| ## 6. Validation | ||
|
|
||
| - `node --check docs/public/cracktro/deck.js` and the preview at `#66` (row 66 of `slides.md`): boxes fit their 536-px rects; caption stays inside the 1620-px viewBox. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.



Adds a CLI vs MCP slide to the cracktro deck's Cost optimization band (row 66 in
.github/skills/cracktro/slides.md).Message
Fat API calls are where MCP hurts most. The left card shows a synthetic
list_code_scanning_alertscall: the response carries every field of every alert (rule, tool, latest instance, location, message, links), and every page of it goes straight into the context.With
tools.github.mode: gh-proxyandtools.cli-proxy: true, the agent works in bash:gh help | grep apiandgh api --help | grep paginate, so CLIs describe themselves a few lines at a time.gh api --paginate …/code-scanning/alerts > alerts.json, so every alert lands on disk and none of it enters the context.jq … | sort | uniq -c | sort -rn | head -2pulls out only the answer: counts by severity and the top files.The IN CONTEXT boxes are qualitative. Measured schema-overhead data is now just a caption footnote.
Measured data (rooted in run traces)
The new miner
.github/skills/cracktro/refresh/cli-vs-mcp.mjsreads theusageartifact of gh-aw runs before and after commits that switchtools.github.mode. The method is documented inrefresh/cli-vs-mcp.md. Snapshot 2026-11-17.MEASURED, schemas onlycaption with the ponytail first-request medians (16.7k → 12.8k), window, runs per side, snapshot and "whole run ≈ same". The flow itself is synthetic.Validation
node --check docs/public/cracktro/deck.jspasses.tests/talk.spec.tsnot run (docs/node_modulesmissing).