Skip to content

Pull requests: huggingface/trl

New pull request New
93 Open 2,204 Closed
93 Open 2,204 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add vLLM quantization option for colocate
#4496 opened Nov 6, 2025 by sergiopaniego • Draft
7 tasks
1
ScaleRL: Add CISPO Loss
#4495 opened Nov 6, 2025 by pramodith Loading…
4 of 5 tasks
24
Buffer samples based on group level stds.
#4492 opened Nov 6, 2025 by pramodith Loading…
3 of 5 tasks
2
[DOCS] update and fix openenv
#4490 opened Nov 6, 2025 by burtenshaw Loading…
6
adding [SimPER](https://arxiv.org/abs/2502.00883)
#4486 opened Nov 6, 2025 by leeparkuky Loading…
2 of 5 tasks
Move XPOTrainer to trl.experimental.xpo
#4485 opened Nov 6, 2025 by behroozazarkhalili Loading…
1
1
Move RLOOTrainer to trl.experimental.rloo
#4484 opened Nov 6, 2025 by behroozazarkhalili Loading…
1
1
Move PRMTrainer to trl.experimental.prm
#4483 opened Nov 6, 2025 by behroozazarkhalili Loading…
1
1
Move PPOTrainer to trl.experimental.ppo
#4482 opened Nov 6, 2025 by behroozazarkhalili Loading…
1
1
[ORPO] Move ORPOTrainer to experimental
#4480 opened Nov 6, 2025 by behroozazarkhalili Loading…
1
10
refactor: Move NashMDTrainer to experimental module
#4477 opened Nov 5, 2025 by behroozazarkhalili Loading…
1
1
Move KTOTrainer to experimental module
#4475 opened Nov 5, 2025 by behroozazarkhalili Loading…
1
1
Move GKDTrainer to experimental module
#4474 opened Nov 5, 2025 by behroozazarkhalili Loading…
7 tasks done
1
1
Move OnlineDPOTrainer to experimental module
#4473 opened Nov 5, 2025 by behroozazarkhalili Loading…
1
1
refactor: Move CPOTrainer to experimental module
#4470 opened Nov 5, 2025 by behroozazarkhalili Loading…
1
1
Add attention_mask to signature_columns
#4459 opened Nov 5, 2025 by shubhamjain0594 Loading…
5 tasks
3
Add num_generations_eval parameter for efficient evaluation
#4458 opened Nov 5, 2025 by mingxuetian Loading…
1
2
Prevent upcasting layers in prepare_model_for_kbit_training
#4457 opened Nov 5, 2025 by sergiopaniego Loading…
5 tasks
3
fix: fix a little bug in GRPOTrainer
#4452 opened Nov 5, 2025 by SolarWindRider Loading…
5
Add kernels to Docker images
#4445 opened Nov 3, 2025 by ishitab02 Loading…
2 of 5 tasks
1
3
added 10 papers (+trainer cross-links) for #4407
#4441 opened Nov 3, 2025 by SSusantAchary Loading…
4 tasks done
23
docs: add KTO (2402.01306) to Paper Index + link ref to KTOTrainer
#4440 opened Nov 3, 2025 by SSusantAchary Loading…
1
refactor: Move judges to experimental submodule
#4439 opened Nov 3, 2025 by behroozazarkhalili Loading…
1
8
refactor: Move Mergekit integration to experimental submodule
#4438 opened Nov 3, 2025 by behroozazarkhalili Loading…
1
3
docs: Unify model examples to use trl-lib namespace
#4431 opened Nov 2, 2025 by behroozazarkhalili Loading…
1
6
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.