MisCaltral: Reducing Numeric Hallucinations of Mistral with Precision Numeric Calculation

Abstract

This paper introduces MisCaltral, an innovative enhancement to the Mistral 7B large language model (LLM), which integrates an external numeric calculator to address the challenge of numerical precision. Traditional LLMs, including Mistral 7B, struggle with accurately processing numeric data, a limitation that significantly hampers their application in fields requiring exact numeric computations. MisCaltral overcomes this by leveraging a specialized calculator module for precise mathematical operations, synergizing linguistic understanding with numerical accuracy. Through extensive experiments, MisCaltral demonstrates a notable improvement in numeric calculation accuracy, particularly in complex financial scenarios, compared to the un-augmented Mistral model. The study not only highlights the enhanced numeric capabilities of MisCaltral but also discusses the broader implications of such integrations in real-world applications and future LLM development. This research marks a significant step forward in the evolution of LLMs, paving the way for more sophisticated and reliable AI models that can adeptly handle a blend of linguistic and numeric data.