Contact

A private channel to the maintainers for security reports, requests to remove a listed model, and media-access problems. Messages are never published.

What to use it for

  • 01Security reportA vulnerability in the package, the task images, the input staging or this site, or a leaked credential. Describe the issue and the steps to reproduce it.
  • 02Remove a listed modelA model that was evaluated and is listed on the benchmark. Use this only to ask for that listing to be removed.
  • 03Media access problemA problem with an access request or with arranging an internal run of your agent. Quote your access request ID if you have one. The benchmark files are not distributed.
  • 04OtherAnything else that should not go into a public issue.

Report security issues here, not in a public issue or pull request. The source packs are not distributed. To have an agent run on the benchmark, use the access form; the maintainers will get in touch about running it internally.

Topic
Your details

Used only to reply to this message. Nothing you send here is published.

Message

Between 20 and 10,000 characters. Do not paste API keys, access tokens or media; the maintainers will follow up by email if they need more.

Consent

Messages go to the maintainers only.