Spaces:

---

HuggingAI4Engineering

/

CADGenBench

like 45

Running

Hi! Submissions are currently broken for everyone at the evaluation-dispatch stage. Evidence from the public results.jsonl in HuggingAI4Engineering/cadgenbench-submissions:

• Last successfully scored submission: 2026-07-18 ("Indian Peafowl").
• All 8 submissions since 2026-07-19 have status "failed" (5 different submitters: Green Pheasant, junde x2, jdilla1277, jspark x2, HrubyOnRails x2).
• Failure reasons on Jul 19-20:
  HfHubHTTPError: 402 Payment Required for url 'https://huggingface.co/api/jobs/michaelr27'
• Failure reasons on Jul 21 (including both of mine):
  403 Forbidden: You don't have the required permissions to complete this action on namespace

So it looks like the Jobs billing on the eval namespace (EVAL_JOB_NAMESPACE = "michaelr27" in the Space's submit.py) lapsed on ~Jul 19, and the namespace is now blocked. Zips still validate, upload, and get pending rows fine — only the eval Job dispatch fails, for every submitter.

Could you restore the Jobs billing and requeue the failed submissions since Jul 19 (or let us know to resubmit)?

Thanks for maintaining the benchmark!