{"id":"ad3OnvN3_iVkg7JRa9lLt","title":"docker-compose.yml for hs-decide-1-flash CPU server","language":"yaml","tags":[],"content":"services:\n  hs-decide:\n    build:\n      context: .\n      dockerfile: Dockerfile\n    image: hs-decide-1-flash:cpu\n    container_name: hs-decide\n    restart: unless-stopped\n    ports:\n      # host port : container port. change the left side if 8000 is taken\n      - \"8000:8000\"\n    command: >\n      hindsight-decision-serve-transformers\n      hindsight-ai/hs-decide-1-flash\n      --port 8000\n      --api-key sk-local\n      --max-request-tokens 16384\n    environment:\n      # keeps it from stomping every core on the box, tune to taste\n      OMP_NUM_THREADS: \"4\"\n    volumes:\n      # caches the HF weights so they survive container rebuilds\n      - hf-cache:/root/.cache/huggingface\n    deploy:\n      resources:\n        limits:\n          # fp32 0.8B weights ~3.2GB plus activations\n          memory: 6g\n\nvolumes:\n  hf-cache:","created_at":"2026-11-12T10:01:24.590Z"}