rui/humaneval#51

Open

rays1024 wants to merge 20 commits intomainfrom

Commits on Apr 25, 2023

Commits on Apr 26, 2023

try to pass CI check
yilunzhao
committed

Commits on Apr 27, 2023

Merge branch 'main' into yilunzhao/llm_implementation
niansong1996
committed
modify process_output function in exectutor.py to handle the case that llama-based model uses empty string as tokenizer_eos_token
yilunzhao
committed

Commits on May 5, 2023

fix error related to llama eos_token
yilunzhao
committed

Commits on May 6, 2023

add starcoder, gpt-neox-20b; test gpt-j-6b
yilunzhao
committed

Commits on May 19, 2023

archieve code for NeurIPS exps; add gpt-4, pythia, replit, dolly, starchat, etc
yilunzhao
committed

Commits on Jul 9, 2023

merged with llm_implementation
rays1024
committed

Commits on Jul 11, 2023

Commits on Jul 14, 2023

updated humaneval.yaml
rays1024
committed

Commits on Jul 20, 2023

added mkdir code
rays1024
committed

Commits on Jul 25, 2023

Commits on Jul 27, 2023

execution now uses codex prompt and cutoff method
rays1024
committed

Commits on Aug 1, 2023

no cutoff at execution to check for raw output
rays1024
committed

Commits on Aug 2, 2023

Commits on Aug 5, 2023

add one space in front of model output if needed
rays1024
committed