  Numerous real-world decision-making problems can be formulated and solved
using Mixed-Integer Linear Programming (MILP) models. However, the
transformation of these problems into MILP models heavily relies on expertise
in operations research and mathematical optimization, which restricts
non-experts' accessibility to MILP. To address this challenge, we propose a
framework for automatically formulating MILP models from unstructured natural
language descriptions of decision problems, which integrates Large Language
Models (LLMs) and mathematical modeling techniques. This framework consists of
three phases: i) identification of decision variables, ii) classification of
objective and constraints, and iii) finally, generation of MILP models.
  In this study, we present a constraint classification scheme and a set of
constraint templates that can guide the LLMs in synthesizing a complete MILP
model. After fine-tuning LLMs, our approach can identify and synthesize logic
constraints in addition to classic demand and resource constraints. The logic
constraints have not been studied in existing work.
  To evaluate the performance of the proposed framework, we extend the NL4Opt
dataset with more problem descriptions and constraint types, and with the new
dataset, we compare our framework with one-step model generation methods
offered by LLMs. The experimental results reveal that with respect to the
accuracies of generating the correct model, objective, and constraints, our
method which integrates constraint classification and templates with LLMs
significantly outperforms the others. The prototype system that we developed
has a great potential to capture more constraints for more complex MILPs. It
opens up opportunities for developing training tools for operations research
practitioners and has the potential to be a powerful tool for automatic
decision problem modeling and solving in practice.
