Framework
DeepSpeed
DeepSpeed is an open-source AI framework from Microsoft, launched in 2020, made for developers and businesses.
A library for training and running very large models across many GPUs.
Main jobs: Model training. It is open source and free to use. You can use it on your own server, offline on your own machine and through an API.
Markdown version of https://godooo.ai/en/framework/deepspeed. Every page on this site has one: add .md to its address.
At a glance
- Type
- Framework
- Made by
- Microsoft
- Launched
- 2020
- Galaxy
- Models & APIs
- Open source
- Yes · Apache-2.0
- Source code
- github.com/deepspeedai/DeepSpeed
- GitHub stars
- 43,158
- How you run it
- Self-host · Runs offline · API
- Made for
- Developers · Businesses
- Website
- deepspeed.ai
What it can do
Model trainingmain jobunconfirmed
“DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.”— deepspeed.ai, 2026-09-24
unconfirmedproposed by a machine, awaiting calibration
Alternatives
- PyTorchOpen source, freeAlso does: Model training
- TensorFlowOpen source, freeAlso does: Model training
- TransformersOpen source, freeAlso does: Model training
- JAXOpen source, freeAlso does: Model training
- Megatron-LMOpen source, freeAlso does: Model training
- MLXOpen source, freeAlso does: Model training
- nanoGPTOpen source, freeAlso does: Model training
- Hugging FaceFree plan + paid upgradesAlso does: Model training
- ModelScopeOpen source, freeAlso does: Model training
- AudioCraftOpen source, freeAlso does: Model training
- DiffusersOpen source, freeAlso does: Model training
- Kohya's GUIOpen source, freeAlso does: Model training
Connections
- Built with
- PyTorch
Questions
What is DeepSpeed?
DeepSpeed is an open-source AI framework from Microsoft, launched in 2020, made for developers and businesses. A library for training and running very large models across many GPUs.
Is DeepSpeed free?
Yes. DeepSpeed is open source (Apache-2.0) and free to use.
Is DeepSpeed open source?
Yes, under the Apache-2.0 license. The source code is at https://github.com/deepspeedai/DeepSpeed.
Can DeepSpeed run locally?
Yes. DeepSpeed can run offline on your own machine. It can also be self-hosted on your own server.
What can DeepSpeed do?
Main jobs: Model training.
Who makes DeepSpeed?
DeepSpeed is made by Microsoft.
What are open-source alternatives to DeepSpeed?
Open-source ones: PyTorch, TensorFlow, Transformers, JAX, Megatron-LM, MLX, nanoGPT and ModelScope. Others: Hugging Face.
Sources
- www.deepspeed.ai/checked 2026-09-24
- github.com/deepspeedai/DeepSpeed