EasyMath: A 0-shot Math Benchmark for SLMs

EasyMath is a compact benchmark for practical math reasoning in small language models. It covers thirteen categories, from basic arithmetic and order of operations to word problems, algebraic expressions, edge cases, and omits specialist topics. We tested 23 models (14M to 4B parameters) using exact, numerical, and symbolic checks on free-form answers in a zero-shot setting. Accuracy rises with size and training, chain-of-thought adds modest gains, and consistency improves at scale.

@article{karki2025_2505.14852,
  title={ EasyMath: A 0-shot Math Benchmark for SLMs },
  author={ Drishya Karki and Michiel Kamphuis and Angelecia Frey },
  journal={arXiv preprint arXiv:2505.14852},
  year={ 2025 }
}