scaleapi
The Data Platform for AI
Built from scaleapi's public GitHub profile, San Francisco. Not on Take My Repo yet, so there are no posts or updates here.
SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
Creating realistic RL environments requires collaboration between researchers, engineers, and domain experts across many dimensions: artifacts, environments tools, dynamism of the environment, reproducibility, and more. There is no open source framework for building these environments effectively. Until now.
Extends next.js <Link> to allow invoking getInitialProps when prefetching a page
RSI Bench is an ongoing effort to evaluate whether AI agents can develop the capabilities required to advance AI R&D.
The official Python SDK for Scale API, the Data Platform for AI
Opensource repository containing task and image data for DrugDiscoveryBench
VeRO is an evaluation harness for using coding agents to optimize LLM-based agents and workflows. It treats agent code as a versioned artifact — making changes, evaluating results, and hill-climbing toward better performance using git version control.
New testbed of interactive SWE tasks for coding agents, set in a realistic multi-turn developer driven environment
Code repository for ICLR 2026 paper "ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agents" (https://www.arxiv.org/abs/2511.07685)
The official Python SDK for Nucleus, part of Scale API, the Data Platform for AI