{"id":"NfTCUFTageX7acGWrGIqz","title":"Decision text payloads for hs-decide-1-flash /v1/systemone","language":"bash","tags":[],"content":"#!/usr/bin/env bash\n# Decision-text payloads for hs-decide-1-flash via POST /v1/systemone\n# Reuses the payload shape from yesterday's probe (state + typed questions).\n# Point BASE at the transformers container (port 8000, known-good).\n# Stock llama.cpp on 8080 will 501 \"not a decision model\".\nKEY=\"sk-local\"\nBASE=\"http://192.168.50.35:8000\"\n\nreq() {\n  echo \"== $1 ==\"\n  curl -s \"$BASE/v1/systemone\" \\\n    -H \"Authorization: Bearer $KEY\" \\\n    -H \"Content-Type: application/json\" \\\n    -d \"$2\"\n  echo; echo\n}\n\n# A. Freshness choice: which doc reflects the CURRENT standup time? Expect D01.\nreq \"A freshness choice (expect D01)\" '{\n  \"model\": \"hs-decide-1-flash\",\n  \"state\": {\n    \"query\": \"What time is the standup now?\",\n    \"documents\": {\n      \"D00\": \"Daily standup is at 9:00 AM in the eng room.\",\n      \"D01\": \"Reminder: standup moved to 10:30 AM starting Monday.\"\n    }\n  },\n  \"questions\": {\n    \"current\": {\"type\": \"choice\", \"instructions\": \"Which document states the current standup time?\", \"criteria\": {\"D00\": null, \"D01\": null}}\n  }\n}'\n\n# B. Reranker-style relevance ladder. Expect D02=answers, D01=helps, D00=about something else.\nreq \"B relevance scores (expect D02 top)\" '{\n  \"model\": \"hs-decide-1-flash\",\n  \"state\": {\n    \"query\": \"How do I rotate the Hindsight API key?\",\n    \"documents\": {\n      \"D00\": \"Our office snacks budget increased this quarter.\",\n      \"D01\": \"Hindsight API keys are managed in the admin console under Settings; existing keys keep working until revoked.\",\n      \"D02\": \"To rotate the Hindsight API key: create a new key in the admin console, update HINDSIGHT_API_KEY, then revoke the old key.\"\n    }\n  },\n  \"questions\": {\n    \"D00\": {\"type\": \"score\", \"instructions\": \"How well does document `documents.D00` answer `query`?\", \"criteria\": [\"about something else\", \"same topic, no help\", \"helps\", \"answers\"]},\n    \"D01\": {\"type\": \"score\", \"instructions\": \"How well does document `documents.D01` answer `query`?\", \"criteria\": [\"about something else\", \"same topic, no help\", \"helps\", \"answers\"]},\n    \"D02\": {\"type\": \"score\", \"instructions\": \"How well does document `documents.D02` answer `query`?\", \"criteria\": [\"about something else\", \"same topic, no help\", \"helps\", \"answers\"]}\n  }\n}'\n\n# C. Noul yes/no: did the key actually get rotated? Expect yes high.\nreq \"C noul yes/no (expect yes)\" '{\n  \"model\": \"hs-decide-1-flash\",\n  \"state\": {\n    \"query\": \"Was the production API key rotated after the leak?\",\n    \"documents\": {\n      \"D00\": \"Postmortem: the leaked key was revoked the same day and a replacement key was issued to the service.\"\n    }\n  },\n  \"questions\": {\n    \"rotated\": {\"type\": \"noul\", \"instructions\": \"Was the production API key rotated?\"}\n  }\n}'\n\n# D. Distractor choice: similarly named people. Expect D02.\nreq \"D distractor (expect D02)\" '{\n  \"model\": \"hs-decide-1-flash\",\n  \"state\": {\n    \"query\": \"Who owns the billing pipeline?\",\n    \"documents\": {\n      \"D00\": \"J. Marsh owns the analytics pipeline.\",\n      \"D01\": \"The notifications pipeline has had no dedicated owner since October.\",\n      \"D02\": \"Jordan Marsh owns the billing pipeline, including invoice generation.\"\n    }\n  },\n  \"questions\": {\n    \"owner\": {\"type\": \"choice\", \"instructions\": \"Which document names the owner of the billing pipeline?\", \"criteria\": {\"D00\": null, \"D01\": null, \"D02\": null}}\n  }\n}'\n\n# E. Ambiguity calibration: two conflicting docs, no timestamps. Expect roughly even probabilities, not overconfidence.\nreq \"E ambiguity (expect ~50/50)\" '{\n  \"model\": \"hs-decide-1-flash\",\n  \"state\": {\n    \"query\": \"What is the gateway request timeout?\",\n    \"documents\": {\n      \"D00\": \"The gateway request timeout is 30 seconds.\",\n      \"D01\": \"The gateway request timeout is 60 seconds.\"\n    }\n  },\n  \"questions\": {\n    \"which\": {\"type\": \"choice\", \"instructions\": \"Which document states the current gateway request timeout?\", \"criteria\": {\"D00\": null, \"D01\": null}}\n  }\n}'\n","created_at":"2026-11-13T20:39:42.476Z"}