Simreal-MLBench
[Public preview] Externally scored agentic ML research benchmark: 60 tasks, real competition ground truth. Open protocol, operated evaluation.
- 269
- Python
- Apache-2.0
- 8 wk ago
Simreal-AI
Built from Simreal-AI's public GitHub profile. Not on Take My Repo yet, so there are no posts or updates here.
[Public preview] Externally scored agentic ML research benchmark: 60 tasks, real competition ground truth. Open protocol, operated evaluation.
[Public alpha] Probability forecasting protocols, delayed-reward agent rollouts, and verifiable real-world task environments.
[Public preview] Hard human-written reasoning puzzles: 749 answered items in 15 topics (707 scored core), with protocol and scorer.
[Public preview] The first public quant trading benchmark scored against what professional traders actually made on the same asset
[Public preview] An advanced AI Benchmark for math, produced by mathmo at St John's College, Cambridge.