Scholar Loop

An autonomous AI scientist: a multi-agent loop over literature, experiments, self-critique and write-up, with deterministic guards against reward-hacking and ha…

LLM Mart 3 views 63k listing impressions

A research loop that shows its work.

You steer. The model reads, proposes, experiments and writes.
Code checks every citation, number and claim against the record before it reaches the page.

tests python platform license release

Quick start · The web UI · What it does · How it works · The rules · Recorded runs


Why

Ask a language model to "do research" and you get a confident paper. The trouble starts when you check it: a citation that does not exist, a number nobody measured, a headline idea that was never actually run.

ScholarLoop keeps the model doing the thinking and puts a harness around it that keeps the books. When an output breaks a rule, the harness rejects it, hands the errors back, and the model tries again. You stay at the decisions that need judgment.

✨ What it does

🧭 Ideation you steer

It will not start from a bare topic. You say what you want to find out and your hunch; it maps directions from the literature, and at least one must challenge you.

🧪 Ideas that actually get tested

The idea you pick has to run as a treatment against a matched control. The loop cannot wander off and tune hyperparameters instead.

🔒 Scores the model cannot touch

Training only saves weights. A separate, frozen scorer produces every reported number, and the held-out split stays sealed during exploration.

⚖️ Review before prose

Four critics question every claim against the measurements. They can demand a control, which is frozen as a protocol before it runs. Nothing is written until you approve.

🔗 Every sentence traceable

Each sentence of the paper cites an approved statement, each statement its runs, each run its code version. Change the evidence and your approval is void.

🖥️ A web UI, under a hard budget

Run every stage from a local web UI or the command line. A dollar cap is checked before each model request, and the UI tells you which tools are free to run.

🚀 Quick start

git clone https://github.com/renee-jia/scholar-loop.git && cd scholar-loop
pip install -e ".[dev]"
python3 -m scholarloop.ui            # Windows: python -m scholarloop.ui

Your browser opens on http://127.0.0.1:8765. Click Explore a real run to walk through four recorded runs, from the author's steer to the reviewed paper and the evidence behind each sentence. No API key, no GPU.

From the project's README.

Comments (0)

Sign in to join the conversation.

No comments yet.