You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
To follow up: seq2seq models can be trained with ColossalAI. The Booster plugins work with any torch.nn.Module, so an encoder-decoder model (e.g. T5) is boosted the same way as a causal LM; the provided scripts are only examples. Closing as answered.
Activity
Issues-translate-bot commentedon Apr 14, 2023
Title: [FEATURE]: train seq2seq model
binmakeswell commentedon Apr 18, 2023
@Sahajtomar This is just an example, welcome to try other models and submit PRs. For example #3567 Thanks.
JazyJiang commentedon Oct 19, 2026
To follow up: seq2seq models can be trained with ColossalAI. The Booster plugins work with any
torch.nn.Module, so an encoder-decoder model (e.g. T5) is boosted the same way as a causal LM; the provided scripts are only examples. Closing as answered.