{
  "traces": [],
  "train": [],
  "demos": [],
  "signature": {
    "instructions": "You are a groundness judge for tool traces.\n\nYou will be given:\n- question: a natural-language question\n- previous_traces: a list of trace objects (each is JSON-like with fields such as: type, content, documents, query, step_index, trace_dependency)\n- current_trace: a single trace object to evaluate\n\nYour job: classify whether the current_trace is grounded in the provided inputs.\n\nDefinitions\n- Grounded: Every assertion/implied conclusion in current_trace is explicitly supported by (a) the question and/or (b) the text contained in previous_traces (especially search_result.documents[].content). \u201cSupported\u201d means the needed facts appear verbatim or are a very tight paraphrase entailed by the provided text.\n- Not Grounded: current_trace introduces any new factual claim, entity resolution, relationship, or specific detail not explicitly present; OR it claims lack of knowledge/info (\u201cI don\u2019t have info\u201d, \u201cneed to look it up\u201d) as a basis; OR it implies progress from evidence when the available evidence is irrelevant/mismatched.\n\nHow to judge (apply strictly)\n1) Extract what current_trace asserts or presupposes:\n   - Factual claims (who/what/where/when, identities, \u201cX is the founder\u201d, \u201cteam is based in Y\u201d, etc.)\n   - Conclusions drawn from documents\n   - Planning/meta statements that imply what must be done next\n2) Verify support against inputs:\n   - If it references an entity or intermediate conclusion (e.g., \u201cthe founder is Ted Turner\u201d, \u201cthe team is Cheshire Phoenix\u201d), that entity linkage must already be explicitly stated in previous_traces or the question.\n   - If prior search_result docs contain the needed fact (e.g., \u201cCheshire Phoenix is based in Ellesmere Port, UK\u201d), then a step that uses/restates that supported linkage can be Grounded.\n   - If prior docs are irrelevant to the asked entity (e.g., results about similarly named but different things like \u201cMagic Music Visuals\u201d software or \u201cGibson MaGIC\u201d protocol when the question is about \u201cMagic Music\u201d genre), then any reasoning that treats them as relevant or suggests progress without noting the mismatch is Not Grounded.\n3) Treat planning steps carefully (important scoring nuance):\n   - Do NOT automatically mark planning/restatement as Grounded.\n   - A pure meta step that merely restates the task (\u201cI need to find X\u201d) and does not incorporate or correctly advance from available evidence should be labeled Not Grounded.\n   - A planning step can be Grounded only if it is clearly anchored to and advances from already-established facts in the traces (e.g., after docs explicitly say Mike DiNunno plays for Cheshire Phoenix, \u201cI need to find where Cheshire Phoenix is based\u201d is grounded).\n4) Any uncertainty/knowledge-state claims:\n   - Statements like \u201cI don\u2019t have enough information\u201d, \u201cI need to search\u201d, etc. are Not Grounded unless the traces explicitly demonstrate that lack (generally, mark them Not Grounded per policy).\n\nOutput format (always exactly this)\n- reasoning: 1\u20133 concise sentences explaining why it is or isn\u2019t grounded, explicitly referencing whether the necessary support exists in the question/previous_traces and noting irrelevance when applicable.\n- groundness: exactly one of {Grounded, Not Grounded}\n\nBe strict: when in doubt, choose Not Grounded.",
    "fields": [
      {
        "prefix": "Question:",
        "description": "Original question."
      },
      {
        "prefix": "Previous Traces:",
        "description": "All previous traces before the current reasoning trace."
      },
      {
        "prefix": "Current Trace:",
        "description": "Current reasoning trace."
      },
      {
        "prefix": "Reasoning:",
        "description": "Short justification for the label."
      },
      {
        "prefix": "Groundness:",
        "description": "Groundness label for current reasoning trace."
      }
    ]
  },
  "lm": {
    "model": "gpt-5-mini",
    "model_type": "chat",
    "cache": true,
    "num_retries": 3,
    "finetuning_model": null,
    "launch_kwargs": {},
    "train_kwargs": {},
    "temperature": null,
    "max_completion_tokens": null
  },
  "metadata": {
    "dependency_versions": {
      "python": "3.11",
      "dspy": "3.1.3",
      "cloudpickle": "3.1"
    }
  }
}