The authors formulate laboratory benchmark construction as a compilation problem.
Compiler turns scientific protocols into certified simulated laboratory tasks
SciHorizon-eLab generates executable procedures, simulation environments and step-level evaluation criteria from natural-language experiment protocols.
Top University
Computer Network Information Center, Chinese Academy of Sciences · Beihang University
Research Digest··2 min read
Qin et al.
Why this paper
From Computer Network Information Center, Chinese Academy of Sciences and Beihang University · Released code
In one line
SciHorizon-eLab compiles natural-language scientific protocols into certified simulation tasks for embodied agent benchmarking.
What it released
Code
What we could check
- ✓Code link in the paper (github.com)
- ·No weights link found
- ·No dataset link found
- ·No compute details found
- ·No stated limitations found
- ✓Reports numbers on named benchmarks
Observed from the paper text and links we have. Absence here means we did not find it, not that it does not exist.
§