Accelerate

A library that enables the same PyTorch code to be run across any distributed configuration. More information: https://huggingface.co/docs/accelerate/index.

accelerate env

accelerate config

accelerate estimate-memory name/model

accelerate test --config_file path/to/config.yaml

accelerate launch path/to/script.py --cpu

accelerate launch path/to/script.py --multi_gpu --num_machines 2