Skip to content

Pull requests: pytorch/torchtune

New pull request New
54 Open 1,342 Closed
54 Open 1,342 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

add a "division by zero" check in chunked loss handling in kd_losses.py CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2239 opened Jan 9, 2025 by insop Loading…
6 of 14 tasks
5
Adds validation loss to LoRA fine tune single device CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2238 opened Jan 8, 2025 by MaxFrax Loading…
2 of 13 tasks
5
[EZ] Fix config bug where interpolation happens too early CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2236 opened Jan 7, 2025 by EugenHotaj Loading…
3 of 13 tasks
6
Add Ascend NPU as a backend for single device recipes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2234 opened Jan 7, 2025 by Nicorgi Loading…
1 of 4 tasks
8
fix convert_weights not working for Qwen2.5 HF checkpoints CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported
#2233 opened Jan 6, 2025 by zhangtemplar Loading…
5
Refactored modules/tokenizers to be a subdir of modules/transforms CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2231 opened Jan 5, 2025 by Ankur-singh Loading…
6 of 14 tasks
3
Adds clip_grad_norm to all recipe config that supports it CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2220 opened Dec 31, 2024 by thomasjpfan Loading…
3 of 13 tasks
1
2
[WIP] Add 2D Parallelism (FSDP + Tensor Parallel) LoRA CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2204 opened Dec 24, 2024 by matthew-hippocratic Loading…
7 tasks done
5
llama 3.1 has correct max_seq_len for all versions CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2203 opened Dec 23, 2024 by akashc1 Loading…
4 of 13 tasks
7
[RFC] Online and offline adaptive batching in torchtune. CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2199 opened Dec 22, 2024 by krammnic Loading…
1
Add Phi4 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2197 opened Dec 21, 2024 by krammnic Loading…
6 of 13 tasks
7
Integrate new released Falcon3 Family base models
#2171 opened Dec 18, 2024 by abdalgader-a Loading…
5
Fixing docstring linter CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2163 opened Dec 17, 2024 by SalmanMohammadi Loading…
1 of 4 tasks
2
Add example recipes for CPU and XPU CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2160 opened Dec 16, 2024 by zxd1997066 • Draft
3 of 13 tasks
4
[RFC] Image Generation Dataset CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. rfc Request for comments
#2140 opened Dec 10, 2024 by calvinpelletier Loading…
23
[RFC] Step-based checkpointing in torchtune CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. rfc Request for comments
#2105 opened Dec 3, 2024 by joecummings Loading…
5
Adding reverse and symmetric KLD losses CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2094 opened Nov 30, 2024 by insop Loading…
9 of 13 tasks
20
Check for attr self._writer in case of import errors on TensorboardLogger CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2092 opened Nov 28, 2024 by joecummings • Draft
13 tasks
1
Implement activation offloading and opt_in_bwd in knowledge_distillation recipes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2088 opened Nov 27, 2024 by AnuravModak Loading…
2
PPO Performance Improvements CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. rlhf Anything related to reinforcement learning w/ human feedback
#2066 opened Nov 25, 2024 by SalmanMohammadi Loading…
1
26
Do not require lr_scheduler for all other recipes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2051 opened Nov 22, 2024 by thomasjpfan Loading…
2 of 13 tasks
1
2
[WIP] compile graph breaks CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2027 opened Nov 19, 2024 by felipemello1 • Draft
1 of 4 tasks
1
full dpo CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1966 opened Nov 7, 2024 by jxmsML • Draft
1 of 13 tasks
5
[DO NOT LAND] compile more modules CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1938 opened Nov 1, 2024 by felipemello1 • Draft
1 of 4 tasks
2
Llama Vision PEFT CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1937 opened Oct 31, 2024 by pbontrager Loading…
6 of 11 tasks
4
ProTip! Updated in the last three days: updated:>2025-01-06.