Skip to content

Pull requests: huggingface/trl

New pull request New
86 Open 2,249 Closed
86 Open 2,249 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

docs: add ZeRO paper (1910.02054) to paper_index
#4551 opened Nov 20, 2025 by JenWei0312 Loading…
3 of 5 tasks
1
Fix bug with GRPO trainer when tokenizer outputs token_type_ids
#4549 opened Nov 20, 2025 by d0rbu Loading…
1 of 5 tasks
Add PSPO trust region method as alternative to clipping in GRPOTrainer
#4548 opened Nov 19, 2025 by MCDwyer Loading…
2 of 5 tasks
@kashif
fix: add vllm_group_port
#4545 opened Nov 19, 2025 by pointerhacker Loading…
3 of 5 tasks
1
Add GRPO Wordle OpenEnv Colab
#4542 opened Nov 18, 2025 by sergiopaniego Loading…
5 tasks
1
Add target_parameters to LoraConfig
#4536 opened Nov 18, 2025 by jonnyli1125 Loading…
5 tasks
1
Add compute_metrics parameter for GRPOTrainer
#4534 opened Nov 17, 2025 by colinzhaoxp Loading…
1
[GRPO] Sequence-level TIS & MIS
#4530 opened Nov 16, 2025 by LeonEricsson Loading…
5 tasks
1
Add Qwen3VLGRPOTrainer for Qwen3-VL GRPO training
#4529 opened Nov 16, 2025 by NDNM1408 Loading…
Make skip_special_tokens configurable
#4521 opened Nov 13, 2025 by taha-yassine Loading…
3 of 5 tasks
1
2
fix tokenize bug for ppo_tldr example
#4520 opened Nov 13, 2025 by kaixuanliu Loading…
3
[GRPO] switch grpo liger loss to triton version
#4519 opened Nov 13, 2025 by kashif • Draft
5 tasks
1
adding [SimPER](https://arxiv.org/abs/2502.00883)
#4486 opened Nov 6, 2025 by leeparkuky Loading…
2 of 5 tasks
1
Move RLOOTrainer to trl.experimental.rloo
#4484 opened Nov 6, 2025 by behroozazarkhalili Loading…
1
1
Move PRMTrainer to trl.experimental.prm
#4483 opened Nov 6, 2025 by behroozazarkhalili Loading…
1
1
[ORPO] Move ORPOTrainer to experimental
#4480 opened Nov 6, 2025 by behroozazarkhalili Loading…
1
10
Move KTOTrainer to experimental module
#4475 opened Nov 5, 2025 by behroozazarkhalili Loading…
1
1
Move OnlineDPOTrainer to experimental module
#4473 opened Nov 5, 2025 by behroozazarkhalili Loading…
1
1
Add attention_mask to signature_columns
#4459 opened Nov 5, 2025 by shubhamjain0594 Loading…
5 tasks
7
Add num_generations_eval parameter for efficient evaluation
#4458 opened Nov 5, 2025 by mingxuetian Loading…
1
6
added 10 papers (+trainer cross-links) for #4407
#4441 opened Nov 3, 2025 by SSusantAchary Loading…
4 tasks done
24
docs: add KTO (2402.01306) to Paper Index + link ref to KTOTrainer
#4440 opened Nov 3, 2025 by SSusantAchary Loading…
1
refactor: Move Mergekit integration to experimental submodule
#4438 opened Nov 3, 2025 by behroozazarkhalili Loading…
1
3
docs: Unify model examples to use trl-lib namespace
#4431 opened Nov 2, 2025 by behroozazarkhalili Loading…
1
6
docs: Expand speeding up training guide with acceleration methods
#4428 opened Nov 2, 2025 by behroozazarkhalili Loading…
1
6
ProTip! Filter pull requests by the default branch with base:main.