Race against the teens – Benchmarking mechanized math on pre-university problems

Takuya Matsuzaki, Hidenao Iwane, Munehiro Kobayashi, Yiyang Zhan, Ryoya Fukasaku, Jumma Kudo, Hirokazu Anai, Noriko H. Arai

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)


This paper introduces a benchmark problem library for mechanized math technologies including computer algebra and automated theorem proving. The library consists of pre-university math problems taken from exercise problem books, university entrance exams, and the International Mathematical Olympiads. It thus includes problems in various areas of pre-university math and with a variety of difficulty. Unlike other existing benchmark libraries, this one contains problems that are formalized so that they are obtainable as the result of mechanical translation of the original problems expressed in natural language. In other words, the library is designed to support the integration of the technologies of mechanized math and natural language processing towards the goal of end-to-end automatic math problem solving. The paper also presents preliminary experimental results of our prototype reasoning component of an end-to-end system on the library. The library is publicly available through the Internet.

Original languageEnglish
Title of host publicationAutomated Reasoning - 8th International Joint Conference, IJCAR 2016, Proceedings
EditorsNicola Olivetti, Ashish Tiwari
PublisherSpringer Verlag
Number of pages15
ISBN (Print)9783319402284
Publication statusPublished - 2016
Externally publishedYes
Event8th International Joint Conference on Automated Reasoning, IJCAR 2016 - Coimbra, Portugal
Duration: Jun 27 2016Jul 2 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference8th International Joint Conference on Automated Reasoning, IJCAR 2016

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)


Dive into the research topics of 'Race against the teens – Benchmarking mechanized math on pre-university problems'. Together they form a unique fingerprint.

Cite this