numerical_reasoning
PROFIT (Processing and Reasoning Over Financial Information in Text): A benchmark designed to evaluate language models across five tasks of increasing complexity in numerical reasoning using SEC filings
- 0
- Python
- 14 mo ago
PROFIT (Processing and Reasoning Over Financial Information in Text): A benchmark designed to evaluate language models across five tasks of increasing complexity in numerical reasoning using SEC filings
Data and software artifacts for the EMNLP 2024 (Main) paper "What Are the Odds? Language Models Are Capable of Probabilistic Reasoning"