BENCHMARK · STRUCTURED OUTPUT

结构化输出评测Structured Output

JSON Schema 合规率与重试次数的统一评测框架,覆盖 5 类常用 Schema。当前为测试计划。 Unified framework for JSON Schema compliance and retries across 5 common schema types. Plan only.

测试方法Methodology

5 组 JSON Schema(对话、抽取、分类、多步流程、嵌套结构),固定提示词与 schema,温度 0;重复 20 次。合规率 = 通过 schema 校验的比例;重试次数 = 首次成功前平均重试次数。 5 JSON Schemas (chat, extraction, classification, multi-step, nested), fixed prompts, temperature 0, 20 runs. Compliance = share passing schema validation; retries = average attempts before first success.

任务设计Task design

任务Task说明Description
对话 Chat带工具调用的对话响应Chat responses with tool calls
抽取 Extraction实体/关系 JSON 输出Entity/relation JSON output
分类 Classification多标签分类输出Multi-label classification output
多步流程 Multi-step分步决策流程输出Step-by-step decision output
嵌套结构 Nested深层嵌套对象输出Deeply nested object output

待实测记录Pending measurements

Model IDSchema 合规率Compliance平均重试次数Avg retries字段精确率Field precision耗时Time
gpt-5.6-sol未实测未实测未实测未实测
gpt-5.6-luna未实测未实测未实测未实测
gpt-5.4未实测未实测未实测未实测
kimi-k3未实测未实测未实测未实测
kimi-k2.7-code未实测未实测未实测未实测
claude-opus-4-7未实测未实测未实测未实测
claude-sonnet-4-6未实测未实测未实测未实测
数据口径Data policy "未实测"表示尚未完成本站同一环境、同一提示词、重复采样的正式测试;正式数据填入时会标注测试日期与采样次数。不要将"未实测"理解为能力缺失或免费。 "Not tested" means the same-environment, same-prompt repeated sampling has not been run yet; published figures will include test date and sample count. "Not tested" does not mean incapable or free.

← 返回模型评测Back to benchmarks