Module 05 · Cross-module loop
live · Cohere → Anthropic

The RAG answers. The judge grades it.

The whole system grading itself.

Cross-module chain (Module 4 RAG -> Module 1 judge): real Cohere retrieval + Anthropic-grounded answer, exported as Module-1 cases (rag_cases.jsonl) and judged by the LLM-as-judge through the passthrough adapter.

retrieval coherejudge claude-opus-4-8 · v23 cases

The loop, closed

Module 4 retrieves and answers; those answers become Module-1 cases; Module 1's LLM-as-judge scores them against the gold answer. Two modules, one feedback loop.

Chained cases
3
Judged pass
3/3
Mean score
1.00
Judge
opus-4-8
prompt v2

rag-0001 · How long do refunds take?

pass · 1.00
1Module 4 · retrieval (cohere)
refunds#0✓ relevantvec 0.677rerank 0.990

Refunds are processed within 5 business days of approval. A 15% restocking fee applies to opened items. Refunds are always issued to the original payment method, never as store credit.

returns#0vec 0.526rerank 0.690

Items may be returned within 30 days of delivery. The item must be unused and in its original packaging. Start a return from the Orders page in your account to receive a prepaid label.

billing#0vec 0.415rerank 0.002

Invoices are generated on the first of each month and payment is due within 15 days. Late payments incur a 2 percent monthly fee. Annual plans are billed once per year at a 10 percent discount.

2Answer produced

Refunds are processed within 5 business days of approval [1].

3Module 1 · judge (686in / 62out)
pass · 1.00gold · Within 5 business days of approval.

The answer is grounded in context [1] and matches the gold answer's key fact of 5 business days after approval.

rag-0002 · What is the API rate limit?

pass · 1.00
1Module 4 · retrieval (cohere)
api-limits#0✓ relevantvec 0.645rerank 0.983

The API allows 100 requests per minute per API key. Exceeding the limit returns HTTP 429 with a Retry-After header. Enterprise plans raise the rate limit to 1000 requests per minute.

billing#0vec 0.311rerank 0.000

Invoices are generated on the first of each month and payment is due within 15 days. Late payments incur a 2 percent monthly fee. Annual plans are billed once per year at a 10 percent discount.

returns#0vec 0.158rerank 0.000

Items may be returned within 30 days of delivery. The item must be unused and in its original packaging. Start a return from the Orders page in your account to receive a prepaid label.

2Answer produced

The API rate limit is 100 requests per minute per API key. Exceeding it returns HTTP 429 with a Retry-After header. Enterprise plans raise the limit to 1000 requests per minute. [1]

3Module 1 · judge (810in / 103out)
pass · 1.00gold · 100 requests/min per key; 1000/min on enterprise.

The answer is fully grounded in the retrieved context and matches the gold answer's key facts: 100 requests/min per key and 1000/min for enterprise plans, with accurate additional detail about HTTP 429 and Retry-After.

rag-0003 · How do I reset my password?

pass · 1.00
1Module 4 · retrieval (cohere)
password#0✓ relevantvec 0.690rerank 0.999

To reset your password, click Forgot password on the sign-in page. A reset link is emailed to you and expires in 60 minutes. If the email does not arrive, check spam or contact support.

billing#0vec 0.207rerank 0.000

Invoices are generated on the first of each month and payment is due within 15 days. Late payments incur a 2 percent monthly fee. Annual plans are billed once per year at a 10 percent discount.

shipping#0vec 0.112rerank 0.000

Standard shipping takes 5 to 7 business days. Expedited shipping is 2 business days for an additional $12. We currently ship only to the United States and Canada.

2Answer produced

To reset your password, click **Forgot password** on the sign-in page. A reset link will be emailed to you, and it expires in 60 minutes. If the email doesn't arrive, check your spam folder or contact support [1].

3Module 1 · judge (807in / 91out)
pass · 1.00gold · Click 'Forgot password'; a link is emailed and expires in 60 minutes.

The answer is fully grounded in context [1], matches all key facts of the gold answer (Forgot password, emailed link, 60-minute expiry), and adds correct supplementary info without hallucination.