Optimized with Modaic :) 72.73% -> 81.82%

README.md

@@ -1,7 +1,7 @@
 ---
+confidence_threshold: 0.5
 is_arbiter: true
 probe_model: modaic/gpt-oss-120b-probe
 size: large
 supports_reasoning: true
-confidence_threshold: 0.5
+---
----

program.json

@@ -3,7 +3,7 @@
   "train": [],
   "demos": [],
   "signature": {
-    "instructions": "Classify the email as spam or not spam.",
+    "instructions": "You are given an email with two fields: subject and body.\n\nTask: classify the email as spam or not spam.\n\nOutput format (strict):\n- Return exactly two fields in this order:\n  1) is_spam: a single boolean value exactly \"True\" or \"False\"\n  2) completed: always output the literal marker \"[[ ## completed ## ]]\"\n- Do not output any other keys/fields/markers or any free-form text.\n\nClassification guidance:\n- Mark is_spam = False for legitimate, expected, or informational emails, including:\n  - Customer support replies and service communications (e.g., \u201cthank you for contacting\u2026\u201d, helpdesk/contact info, apologies, case handling).\n  - Feedback/survey requests from a company that look like standard customer communications (often include mailing address and preference/unsubscribe wording).\n  - Transaction/payment notifications that appear to be genuine (e.g., real PayPal-style receipts/notifications that include the recipient\u2019s full name and normal PayPal anti-phishing footer language). These are informational and not spam unless clear evidence indicates otherwise.\n\n- Mark is_spam = True when the email is unsolicited and/or shows signs of spam/phishing/scams, such as:\n  - Requests for passwords, verification codes, banking/card details, or other sensitive personal information.\n  - Urgent threats, \u201caccount locked\u201d pressure tactics, or instructions to click suspicious links/open attachments.\n  - Obvious impersonation, mismatched branding, or other strong indicators of fraud.\n\nImportant: Do not assume a payment/transaction email is spam just because it mentions money or includes a \u201cGet details\u201d call-to-action. If it resembles a standard legitimate PayPal notification (including full name and typical PayPal fraud-prevention footer), classify it as not spam.\n\nNo explanation is required; only produce the required fields in the required format.",
     "fields": [
       {
         "prefix": "Subject:",