Many practical problems in industry and science involve making predictions from tabular data, like rows of numbers, text, or images. Traditionally, each new prediction task required training a separate model, which is time-consuming and computationally expensive. This is a barrier for many applications.
Kumo Tabular introduces a family of three model sizes (small, medium, and large) that can make predictions on new tables without any additional training. The models are pretrained only on artificial tables and use an in-context learning transformer that reads labeled examples and predicts the rest. Architectural innovations allow them to handle tables with millions of rows and hundreds of thousands of columns.
The largest Kumo model ranks first on eight different benchmarks covering regression, large tables, and mixed data types. It also predicts up to 36 times faster than the previous best model on one benchmark while maintaining top accuracy. The models, code, and training data are released openly.
