AIQ Overview

Theme preference system; currently light.

Harness Rank

Task outcomes across model–harness combinations.

  • 3 harnesses in scope
  • 24 task specifications
  • No measurements
  • Draft 0.3.0

Harness scope

Harnesses included in the draft study
HarnessProposed modelReleaseStatusDocs
Codexgpt-6-solNot pinnedNot runDocs ↗
Hermesgpt-6-solNot pinnedNot runDocs ↗
Pigpt-6-solNot pinnedNot runDocs ↗

Draft · no measurements.

说明

Same model, provider route, tasks, and limits. Native harness instructions and context handling remain part of the comparison.

Proposed model: gpt-6-sol. Releases are not pinned; runtime compatibility is unqualified. Task specifications are authored; workspace packages and graders are pending.

Full comparison method and acceptance criteria
Refine comparisonSame model

Task matrix

24 task specifications · 3 acceptance gates each · no measured attempts.

Full task catalogue

Bug repair

6 specifications

Feature work

6 specifications

Local workflow

6 specifications

Refactor and migration

6 specifications
Estimated difficultyBasic (6)Medium (12)Hard (6)Open a task for its deliverables and acceptance gates.

No measured combinations

Review 24 task specifications