Focusing on Numbers (FoN)

Paper Report

Manuscript of running this project

After setting up safe-rlhf structure in safe-rlhf:

SFT

bash scripts/sft-my.sh

Eval

git clone https://github.com/GAIR-NLP/abel.git

And after setting up env of abel;

cd abel
bash evaluation/eval.sh

Score evaluation

cd ..
python score.py --base_line abel/outputs/ra_outputs/math/70b.jsonl --pred_file abel/outputs/onlynum_outputs/math/70b.jsonl