DeepSpeed not working?

[SuperMaximus1984]

Please how to activate DeepSpeed and utilize 10x faster inference?
When I utilize use_deepspeed = True I encounter this error:

/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/torch/nn/utils/weight_norm.py:30: UserWarning: torch.nn.utils.weight_norm is deprecated in favor of torch.nn.utils.parametrizations.weight_norm.
  warnings.warn("torch.nn.utils.weight_norm is deprecated in favor of torch.nn.utils.parametrizations.weight_norm.")
/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/pydantic-2.4.2-py3.9.egg/pydantic/_internal/_config.py:317: UserWarning: Valid config keys have changed in V2:
* 'allow_population_by_field_name' has been renamed to 'populate_by_name'
* 'validate_all' has been renamed to 'validate_default'
  warnings.warn(message, UserWarning)
/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/pydantic-2.4.2-py3.9.egg/pydantic/_internal/_fields.py:128: UserWarning: Field "model_persistence_threshold" has conflict with protected namespace "model_".

You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.
  warnings.warn(
/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/pydantic-2.4.2-py3.9.egg/pydantic/_internal/_config.py:317: UserWarning: Valid config keys have changed in V2:
* 'validate_all' has been renamed to 'validate_default'
  warnings.warn(message, UserWarning)
Traceback (most recent call last):
  File "/mnt/d/Python Stuff/tortoise-tts/tortoise/do_tts.py", line 32, in <module>
    tts = TextToSpeech(models_dir=args.model_dir, use_deepspeed=True, kv_cache=True, half=True)
  File "/mnt/d/Python Stuff/tortoise-tts/tortoise/api.py", line 248, in __init__
    self.autoregressive.post_init_gpt2_config(use_deepspeed=use_deepspeed, kv_cache=kv_cache, half=self.half)
  File "/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/TorToiSe-2.8.0-py3.9.egg/tortoise/models/autoregressive.py", line 379, in post_init_gpt2_config
    import deepspeed
  File "/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/deepspeed-0.8.3-py3.9.egg/deepspeed/__init__.py", line 15, in <module>
    from . import module_inject
  File "/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/deepspeed-0.8.3-py3.9.egg/deepspeed/module_inject/__init__.py", line 3, in <module>
    from .replace_module import replace_transformer_layer, revert_transformer_layer, ReplaceWithTensorSlicing, GroupQuantizer, generic_injection
  File "/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/deepspeed-0.8.3-py3.9.egg/deepspeed/module_inject/replace_module.py", line 803, in <module>
    from ..pipe import PipelineModule
  File "/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/deepspeed-0.8.3-py3.9.egg/deepspeed/pipe/__init__.py", line 3, in <module>
    from ..runtime.pipe import PipelineModule, LayerSpec, TiedLayerSpec
  File "/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/deepspeed-0.8.3-py3.9.egg/deepspeed/runtime/pipe/__init__.py", line 3, in <module>
    from .module import PipelineModule, LayerSpec, TiedLayerSpec
  File "/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/deepspeed-0.8.3-py3.9.egg/deepspeed/runtime/pipe/module.py", line 16, in <module>
    from ..activation_checkpointing import checkpointing
  File "/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/deepspeed-0.8.3-py3.9.egg/deepspeed/runtime/activation_checkpointing/checkpointing.py", line 25, in <module>
    from deepspeed.runtime.config import DeepSpeedConfig
  File "/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/deepspeed-0.8.3-py3.9.egg/deepspeed/runtime/config.py", line 30, in <module>
    from ..monitor.config import get_monitor_config
  File "/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/deepspeed-0.8.3-py3.9.egg/deepspeed/monitor/config.py", line 70, in <module>
    class DeepSpeedMonitorConfig(DeepSpeedConfigModel):
  File "/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/deepspeed-0.8.3-py3.9.egg/deepspeed/monitor/config.py", line 82, in DeepSpeedMonitorConfig
    def check_enabled(cls, values):
  File "/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/pydantic-2.4.2-py3.9.egg/pydantic/deprecated/class_validators.py", line 222, in root_validator
    return root_validator()(*__args)  # type: ignore
  File "/home/max/anaconda3/envs/tortoise/lib/python3.9/site-packages/pydantic-2.4.2-py3.9.egg/pydantic/deprecated/class_validators.py", line 228, in root_validator
    raise PydanticUserError(
pydantic.errors.PydanticUserError: If you use `@root_validator` with pre=False (the default) you MUST specify `skip_on_failure=True`. Note that `@root_validator` is deprecated and should be replaced with `@model_validator`.

[fakerybakery]

Ah, another issue with Pydantic. Try creating a new venv/conda env, uninstalling pydantic, and reinstalling tortoise.

pip uninstall pydantic
pip install git+https://github.com/neonbjb/tortoise-tts