Agent answer benchmark

One search is faster. A finished answer is not.

Eleven identical company-knowledge questions tested Slite Agent against an AI client using one Rovo MCP search and one synthesis pass. The comparison that matters is time to a usable natural-language answer.

The conclusion

Slite Agent answered in 20.8s. Rovo plus synthesis took 24.7s and used 6.6× the visible token footprint.

Rovo returned links and snippets 4.6 seconds sooner. Converting those snippets into a user-ready answer added 8.5 seconds and exposed more context to the client model.

Time to answer

The end-user comparison

Slite's agent time already includes retrieval and answer generation. Rovo's finished-answer time includes search plus the measured synthesis allocation.

Average latency per question · lower is better
Slite Agent answerRovo retrievalCodex synthesis
Estimated client-visible tokens per question
6.6× larger Rovo footprint
Findings

What the test exposed

Speed alone hides the structural difference between the products. Answer completeness and context cost tell the rest of the story.

11/11

Slite returned complete answers

Every fresh Slite Agent call produced a natural-language answer with citations against the supplied expected answer.

2/11

Rovo fully answered two

The single search call produced enough snippet context for questions 1 and 8. Seven answers were partial and two were missing.

6.6×

More visible context

Rovo sent search payloads to the client model before synthesis. Slite returned the completed answer directly in one MCP response.

Methodology

How the clean run worked

The test measures the tools as they are actually exposed through MCP, while keeping the question corpus and timing boundaries consistent.

Execution

  1. Each question started a fresh Slite Agent call and one Rovo search at the same time.
  2. Slite's timer stopped when its cited answer arrived.
  3. Rovo received no fetch and no second search. One synthesis pass converted the returned snippets into answers.
  4. The shared synthesis time was divided evenly across 11 questions and added to each Rovo search latency.

Measurement boundaries

Visible token estimate
Question + complete MCP payload, estimated as characters ÷ 4. Rovo also includes its synthesized answer.
Important limitation
Neither MCP exposes hidden server-side model usage. These are interface-footprint estimates, not provider billing totals.
Discarded load batch
A first all-at-once batch was excluded because both MCP transports serialized requests and queue position dominated latency.