Skip to content

[DOC]: Lack of clear examples/doc of multiple nodes with multiple GPUs聽#2921

Closed

Description

@binmakeswell

馃摎 The doc issue

At present, examples like GPT/OPT are mainly single-node multi-GPUs, and README and document are not clear enough.

Activity

  1. chingfeng2021 commented on Mar 2, 2023

    @chingfeng2021

    yes not clear

  2. JazyJiang commented on Oct 19, 2026

    @JazyJiang
    Collaborator

    Closing as completed. Multi-node launching is now documented in https://colossalai.org/docs/basics/launch_colossalai: colossalai run with --host or --hostfile (plus --include / --exclude), and launching with SLURM. Any example under examples/ can be run across nodes this way.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions