AIQ Overview

Theme preference system; currently light.

Mem

Memory systems, readers, and writers.

  • 3 studies
  • 6 comparisons
  • 189 original files

Results

All memory comparisons

Complete + bound counts complete answers with source-matched quotes. Each row is a separate test.

Selected comparison ↓
Memory comparison overview
ComparisonComplete + boundResourcesEvidence scale
Readers · fixed-context replay → Luna / DeepSeek Flash 1017
  • DeepSeek Flash 101711/13
  • Luna medium11/13
$0.004811–$0.0193694.54–5.05 s / request13 inputs / profile2 profiles · one pass
Readers · fixed-context replay → Luna reasoning effort
  • Luna low10/13
  • Luna medium11/13
  • Luna none11/13
$0.004149–$0.0047273.63–4.95 s / request13 inputs / profile3 profiles · one pass
Systems · native retrieval → Native memory systems
  • OpenViking11/13
  • RAGFlow rc111/13
$0.006922–$0.024261Time: withheld from comparison13 inputs / profile2 profiles · one pass
Systems · nightly version check → Native memory systems
  • RAGFlow nightly11/13
Cost not reported4.74 s / request13 inputs / profile1 profile · one pass
Writers · extraction replay → Luna / DeepSeek Flash 1017 ViewingQuality not measuredDeepSeek Flash 1017 · Luna medium$0.001142–$0.0029144.57–8.31 s / request3 inputs / profile2 profiles · one pass
Writers · extraction replay → Luna reasoning effortQuality not measuredLuna low · Luna medium · Luna none$0.000709–$0.0011203.52–7.72 s / request4 inputs / profile3 profiles · one pass

Separate tests · no combined ranking.

说明

Costs are workload totals in USD; resource ranges span profiles within that row. Quote binding does not establish semantic entailment.

Writers · extraction replay

Luna / DeepSeek Flash 1017 · Extraction prompt replay

↑ All comparisons
Refine comparison

3 inputs / profile · 2 profiles · October 20, 2026

Test method

Writer time and cost

Resource use for the same inputs. Semantic writer quality was not measured.

Results & evidence ↓

Mean time

Seconds / input · lower is better

  • DeepSeek Flash 10174.57 s
  • Luna medium8.31 s

Settled cost

USD / test · lower is better

  • DeepSeek Flash 1017$0.002914
  • Luna medium$0.001142

Results and evidence

Sort columns. Open Details for the profile and original record.

Expand a row for all metrics
Sort
Writer · 3 paired inputs. Values are specific to this test. Actual settled USD for the three paired writer calls. Parsing compatibility is distinct from native ingestion acceptance.
Profile versionEvidenceDetails
Luna mediumgpt-6-luna38.312 s$0.001142
DeepSeek Flash 1017deepseek-v4.1-flash-101734.569 s$0.002914

One pass · — Not measured.

说明

USD totals are rounded to 6 decimals. The value tooltip and original record retain the recorded precision. Sorting is descriptive.

Actual settled USD for the three paired writer calls. Parsing compatibility is distinct from native ingestion acceptance.

Recorded finding

Three paired writer inputs. No semantic writer-quality score was measured. The extra Chinese input is excluded from this table.

Protocol and metric definitions

Three identical English extraction requests. The extra Chinese DeepSeek sample is available as a case and is excluded from this paired table.

Synthetic inputs · real provider calls · one pass · no repeated-trial interval.

Inputs: paired extraction requests. Time: mean request duration. Cost: settled USD for the selected workload. Output counts and JSON parsing are not quality scores.

Full conditions and limitations