SDK
Quick Start
Verify your first policy with the SDK.
1. Authenticate
export BOTMANIFOLD_API_KEY=bm_...2. Verify a policy
from botmanifold import BotManifoldClient
client = BotManifoldClient()
report = client.verify.run("policy.zip", scenario="messy_room")
print(report.verdict) # Verdict.SAFE, Verdict.UNSAFE or Verdict.ERROR
print(report.composite_score) # 0 to 100
print(report.report_url) # the full report in the web apprun uploads the ZIP and waits for the result (up to 5 minutes by default). Pass wait=False
to get the job id back immediately and poll with client.verify.wait(job_id).
3. From the command line
botmanifold verify policy.zip --scenario messy_room
botmanifold verify policy.zip -s messy_room --output report.json4. Test a policy locally first
botmanifold serve my_policy.py --port 8765serve starts your policy as an HTTP server and prints a pairing token. To develop a policy
without the full platform, botmanifold mock-server episode.jsonl starts a mock evaluation
server that replays a recorded episode from a JSONL file.