Skip to content

Add human review workflow for model predictions - #4

Draft
Kaushik-Kumar-CEG wants to merge 3 commits into
gsoc/prediction-injectionfrom
gsoc/review-workflow
Draft

Add human review workflow for model predictions#4
Kaushik-Kumar-CEG wants to merge 3 commits into
gsoc/prediction-injectionfrom
gsoc/review-workflow

Conversation

@Kaushik-Kumar-CEG

@Kaushik-Kumar-CEG Kaushik-Kumar-CEG commented Sep 7, 2026

Copy link
Copy Markdown
Collaborator

Adds the complete add-model-required-phrases workflow

It supports one rule, a directory or eligible installed ScanCode rules. The default mode reviews predictions interactively. It also supports read-only prediction, explicit score-based batch processing, dry runs, JSON output, and resumable sessions. The pinned public model works by default without a token

Usage:

python -m pip install ".[inference]"
add-model-required-phrases --rule path/to/example.RULE
add-model-required-phrases --rules-dir path/to/rules --predict-only
add-model-required-phrases --all --batch --auto-score 0.90 --review-score 0.70 --dry-run
add-model-required-phrases --resume path/to/session.jsonl

Test the complete package stack with:

./configure --dev
python -m pip install -e ".[inference]"
venv/bin/pytest -q
venv/bin/ruff check
make doc8
make docs-check

This PR is stacked on PR #3. Checking out this branch provides PRs #1 through #4 together, so the complete package can be installed and tested without manually combining branches

@Kaushik-Kumar-CEG
Kaushik-Kumar-CEG force-pushed the gsoc/review-workflow branch 3 times, most recently from 3e78346 to efcc86b Compare September 13, 2026 17:14
Signed-off-by: Kaushik Kumar <kaushikrjpm10@gmail.com>
Signed-off-by: Kaushik Kumar <kaushikrjpm10@gmail.com>
Signed-off-by: Kaushik Kumar <kaushikrjpm10@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant