378 papers this week12 active threadsbusiest: Agent Harness Optimization

Research

Evaluation & benchmarks

AI agents fail end-to-end physics research due to shallow reasoning and missing intuition

The authors introduce FrontierPhysics, a benchmark with 56 research tasks created by 42 physicists based on their own work. They evaluated 22 models across 26 configurations and found that no configuration passed more than 46 out of 168 rollouts. Manual review revealed that the main weaknesses are insufficiently rigorous reasoning and limited expert intuition, not gaps in physics knowledge.

today
Robotics & embodied AI

Robot policies that read early vision layers handle camera shifts better

Fan et al. introduce NEO-VLA, a robot control model with no separate vision encoder: raw image patches are fed directly into a shared vision-language backbone along with the instruction, and an action module reads intermediate representations from several depths. They report that action-relevant visual signals often peak well before the final representation, and that reading those earlier layers improves control, especially when the backbone is frozen.

today
Evaluation & benchmarks

AI models answer financial facts they claim not to know

The authors introduce FinDendro, a benchmark of 2,226 dated U.S. financial facts from 1999 to 2026, covering macroeconomic data, stock prices, and Federal Reserve decisions. They measure whether models can answer correctly and whether their self-assessed knowledge matches their factual accuracy. The key finding is that frontier models like GPT-5 answer a majority of facts correctly even when they say they do not know them, and date instructions remove claims of knowledge without changing accuracy, meaning standard safeguards against backtest leakage are ineffective.

today
Safety & security

AI chatbots' psychological risk factors can be monitored without measuring user harm

The authors propose a shift from measuring psychological harm directly in LLM conversations to detecting observable AI behaviors that are risk factors for such harm. They operationalize eight behaviors, create a synthetic dataset of 47,062 AI responses, and compare detectors. A classifier–judge cascade achieves macro precision 0.86 and recall 0.76, and reduces LLM-judge calls by 97% on WildChat while showing that detections cluster within conversations.

today
Robotics & embodied AI

Robots can improve on untrained tasks by practising diverse ones

Korniak and colleagues studied whether a generalist robot policy, a model controlling many different tasks, can improve broadly rather than merely specialize during adaptation. They report that learning from interaction across diverse manipulation tasks can also improve performance on tasks excluded from that adaptation, with the strongest results coming from methods that learn to estimate the value of actions.

today

The Field

Agents

all →

AI agents learn to recover, not consistently choose better actions

today

AI agents improve when their surrounding software is automatically redesigned

today

Search results order and dead-end histories bias AI agents' final answers

today

Omitting reasoning from training data does not harm AI agents on standard benchmarks

today

Language models

all →

Giving harder inputs more attempts helps little on hard LLM workloads

today

Language models reason better when they think aloud only at key steps

today

Language models can merge specialists without matching their training capacity

today

Language models can learn facts while misjudging what they know

yesterday

Reinforcement learning

all →

Selective token supervision cuts two thirds of training tokens while improving AI accuracy

today

Language models can improve writing by judging their own drafts

today

Budgeting rewards per prompt helps language models train past reasoning plateaus

today

Browser-game training makes AI webpage generation surpass a frontier model

yesterday

Vision

all →

AI models can improve image understanding and generation from their outputs

today

Language models trained only on text can partly locate video events

today

Image search models can retain left-right information but ignore it

today

AI that identifies radiological findings first can diagnose unseen diseases

yesterday

Generative media

all →

AI video generation gains emotional fidelity when rewards trust only reliable cues

today

Video generators can nearly halve history storage while improving reconstruction quality

today

Motion model understands and generates in one shared space

yesterday

Generating video directly in pixels can beat models that compress first

yesterday

Speech & audio

all →

Real-time AI soundtracks for video now sync as well as offline models

today

AI agents locate sounds better after training with written reasoning

yesterday

One audio model can now describe, generate and edit 3D sound scenes

2 days ago

Voice model matches text reasoning without separate transcription step

3 days ago

Safety & security

all →

Prompt compression weakens refusal of harmful requests in AI models

today

Privacy-preserving watermarks for AI text allow aggregate tracking without individual surveillance

today

AI models predict training data side effects better than humans

today

AI models can pass deletion checks yet diverge during later training

today

Evaluation & benchmarks

all →

Flexible classical models match neural networks for event prediction, but not on ICU data

today

How data is split can swing encrypted traffic classifier scores by 40 points

today

AI assistants face a $1.7 trillion wish list of life tasks

today

AI judges reverse correct verdicts after a false note

today

Efficiency & systems

all →

Language models can generate text five times faster by drafting ahead

today

Chunked prefill, not cache architecture, drives LLM serving engine speed differences

today

Recycling high-scored unexposed candidates boosts feed discovery without engagement loss

today

AI search indexes can be built up to 50 times faster

today

Code & software

all →

Verified code often passes formal checks but misses the real spec

today

Training shifts a small theorem prover toward fewer, larger proof steps

2 days ago

Agentic framework formally verifies GPU kernels against PyTorch references

2 days ago

Reusing past attempts to steer data collection trains better coding agents

2 days ago

AI for science & health

all →

Distributed runtime scales AI molecular dynamics to 30 million atoms

today

AI forecasting model adapts to sensor changes, guarantees uncertainty at new locations

yesterday

AI models sample more protein folding stages, but miss folded endpoints

yesterday

AI protein design improves by separating suggested changes from evaluation

yesterday

Theory

all →

Privacy-protecting averages can lose accuracy when data variation is unknown

today

Fooling all classifiers is as hard as matching the best classifier

yesterday

Noise injection reveals when machine learning cannot identify patterns

yesterday

A small positional signal replaces costly relaxation layers when training symmetry-aware models

yesterday