TabFM is a 400M-parameter foundation model for tabular data that works zero-shot, meaning it can make predictions on new tasks without any training or tuning. It was trained entirely on synthetic data generated from structural causal models, learning general representations that transfer to real-world tasks.
Across all 51 benchmark datasets in TabArena (38 classification and 13 regression), zero-shot TabFM ranks first among default tabular foundation models and even outperforms tuned AutoML pipelines. This is significant because it eliminates the need for per-dataset workflows like training tree ensembles or running AutoML searches from scratch.
The model works by formulating supervised tabular prediction as in-context learning, producing calibrated predictions in a single forward pass. Two extensions over the same frozen weights improve performance further: multi-view feature expansion with ensembling (TabFM+), and LLM-guided data processing (TabFM-Auto).