(no commit message)

This commit is contained in:
2026-03-08 23:46:33 -07:00
parent 070276de48
commit a6c6f71057
2 changed files with 14 additions and 10 deletions

View File

@@ -1,7 +1,7 @@
{ {
"model": null, "model": null,
"signature": { "signature": {
"description": "You are an essay-scoring judge. Score essays only. Return one score in the range 1-6 using the rubric below.\n\nAfter reading each essay and completing the analytical rating form, assign a holistic score based on the rubric\nbelow. For the following evaluations you will need to use a grading scale between 1 (minimum) and 6\n(maximum). As with the analytical rating form, the distance between each grade (e.g., 1-2, 3-4, 4-5) should be\nconsidered equal.\nSCORE OF 6: An essay in this category demonstrates clear and consistent mastery, although it may have a\nfew minor errors. A typical essay effectively and insightfully develops a point of view on the issue and\ndemonstrates outstanding critical thinking; the essay uses clearly appropriate examples, reasons, and other\nevidence taken from the source text(s) to support its position; the essay is well organized and clearly focused,\ndemonstrating clear coherence and smooth progression of ideas; the essay exhibits skillful use of language,\nusing a varied, accurate, and apt vocabulary and demonstrates meaningful variety in sentence structure; the\nessay is free of most errors in grammar, usage, and mechanics.\nSCORE OF 5: An essay in this category demonstrates reasonably consistent mastery, although it will have\noccasional errors or lapses in quality. A typical essay effectively develops a point of view on the issue and\ndemonstrates strong critical thinking; the essay generally using appropriate examples, reasons, and other\nevidence taken from the source text(s) to support its position; the essay is well organized and focused,\ndemonstrating coherence and progression of ideas; the essay exhibits facility in the use of language, using\nappropriate vocabulary demonstrates variety in sentence structure; the essay is generally free of most errors in\ngrammar, usage, and mechanics.\nSCORE OF 4: An essay in this category demonstrates adequate mastery, although it will have lapses in\nquality. A typical essay develops a point of view on the issue and demonstrates competent critical thinking; the\nessay using adequate examples, reasons, and other evidence taken from the source text(s) to support its\nposition; the essay is generally organized and focused, demonstrating some coherence and progression of ideas\nexhibits adequate; the essay may demonstrate inconsistent facility in the use of language, using generally\nappropriate vocabulary demonstrates some variety in sentence structure; the essay may have some errors in\ngrammar, usage, and mechanics.\nSCORE OF 3: An essay in this category demonstrates developing mastery, and is marked by ONE OR\nMORE of the following weaknesses: develops a point of view on the issue, demonstrating some critical\nthinking, but may do so inconsistently or use inadequate examples, reasons, or other evidence taken from the\nsource texts to support its position; the essay is limited in its organization or focus, or may demonstrate some\nlapses in coherence or progression of ideas displays; the essay may demonstrate facility in the use of language,\nbut sometimes uses weak vocabulary or inappropriate word choice and/or lacks variety or demonstrates\nproblems in sentence structure; the essay may contain an accumulation of errors in grammar, usage, and\nmechanics.\nSCORE OF 2: An essay in this category demonstrates little mastery, and is flawed by ONE OR MORE of\nthe following weaknesses: develops a point of view on the issue that is vague or seriously limited, and\ndemonstrates weak critical thinking; the essay provides inappropriate or insufficient examples, reasons, or\nother evidence taken from the source text to support its position; the essay is poorly organized and/or focused,\nor demonstrates serious problems with coherence or progression of ideas; the essay displays very little facility\nin the use of language, using very limited vocabulary or incorrect word choice and/or demonstrates frequent\nproblems in sentence structure; the essay contains errors in grammar, usage, and mechanics so serious that\nmeaning is somewhat obscured.\nSCORE OF 1: An essay in this category demonstrates very little or no mastery, and is severely flawed by\nONE OR MORE of the following weaknesses: develops no viable point of view on the issue, or provides little\nor no evidence to support its position; the essay is disorganized or unfocused, resulting in a disjointed or\nincoherent essay; the essay displays fundamental errors in vocabulary and/or demonstrates severe flaws in\nsentence structure; the essay contains pervasive errors in grammar, usage, or mechanics that persistently\ninterfere with meaning.", "description": "Score rod101 essays on a 1-10 scale.",
"properties": { "properties": {
"text": { "text": {
"__dspy_field_type": "input", "__dspy_field_type": "input",
@@ -12,21 +12,25 @@
}, },
"reasoning": { "reasoning": {
"__dspy_field_type": "output", "__dspy_field_type": "output",
"desc": "Step-by-step justification for the holistic essay score.", "desc": "Step-by-step justification for the assigned essay score.",
"prefix": "Reasoning:", "prefix": "Reasoning:",
"title": "Reasoning", "title": "Reasoning",
"type": "string" "type": "string"
}, },
"score": { "score": {
"__dspy_field_type": "output", "__dspy_field_type": "output",
"desc": "Holistic essay score on a 1-6 scale.", "desc": "Holistic essay score on a 1-10 scale.",
"enum": [ "enum": [
"1", "1",
"2", "2",
"3", "3",
"4", "4",
"5", "5",
"6" "6",
"7",
"8",
"9",
"10"
], ],
"prefix": "Score:", "prefix": "Score:",
"title": "Score", "title": "Score",
@@ -38,7 +42,7 @@
"reasoning", "reasoning",
"score" "score"
], ],
"title": "StringSignature", "title": "Rod101ScoringSig",
"type": "object" "type": "object"
} }
} }

File diff suppressed because one or more lines are too long