# DeepSpeed

Framework · https://godooo.ai/en/framework/deepspeed

> DeepSpeed is an open-source AI framework from Microsoft, launched in 2020, made for developers and businesses.

A library for training and running very large models across many GPUs.

Main jobs: Model training. It is open source and free to use. You can use it on your own server, offline on your own machine and through an API.

## At a glance

- **Type:** [Framework](https://godooo.ai/en/browse#framework)
- **Made by:** [Microsoft](https://godooo.ai/en/org/microsoft)
- **Launched:** 2020
- **Galaxy:** [Models & APIs](https://godooo.ai/en/galaxy/builders)
- **Open source:** Yes · Apache-2.0
- **Source code:** [github.com/deepspeedai/DeepSpeed](https://github.com/deepspeedai/DeepSpeed)
- **GitHub stars:** 43,158
- **How you run it:** Self-host · Runs offline · API
- **Made for:** Developers · Businesses
- **Website:** [deepspeed.ai](https://www.deepspeed.ai)

## What it can do

- **[Model training](https://godooo.ai/en/capability/model-training)** — main job, _proposed by a machine, awaiting calibration_. “DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.” (read on [deepspeed.ai](https://www.deepspeed.ai/), 2026-09-24)

## Alternatives

- **[PyTorch](https://godooo.ai/en/framework/pytorch)** (Open source, free): Also does: Model training
- **[TensorFlow](https://godooo.ai/en/framework/tensorflow)** (Open source, free): Also does: Model training
- **[Transformers](https://godooo.ai/en/framework/transformers)** (Open source, free): Also does: Model training
- **[JAX](https://godooo.ai/en/framework/jax)** (Open source, free): Also does: Model training
- **[Megatron-LM](https://godooo.ai/en/framework/megatron-lm)** (Open source, free): Also does: Model training
- **[MLX](https://godooo.ai/en/framework/mlx)** (Open source, free): Also does: Model training
- **[nanoGPT](https://godooo.ai/en/framework/nanogpt)** (Open source, free): Also does: Model training
- **[Hugging Face](https://godooo.ai/en/product/huggingface)** (Free plan + paid upgrades): Also does: Model training
- **[ModelScope](https://godooo.ai/en/product/modelscope)** (Open source, free): Also does: Model training
- **[AudioCraft](https://godooo.ai/en/framework/audiocraft)** (Open source, free): Also does: Model training
- **[Diffusers](https://godooo.ai/en/framework/diffusers)** (Open source, free): Also does: Model training
- **[Kohya's GUI](https://godooo.ai/en/product/kohya-ss)** (Open source, free): Also does: Model training

## Connections

- **Built with:** [PyTorch](https://godooo.ai/en/framework/pytorch)

## Questions

### What is DeepSpeed?

DeepSpeed is an open-source AI framework from Microsoft, launched in 2020, made for developers and businesses. A library for training and running very large models across many GPUs.

### Is DeepSpeed free?

Yes. DeepSpeed is open source (Apache-2.0) and free to use.

### Is DeepSpeed open source?

Yes, under the Apache-2.0 license. The source code is at https://github.com/deepspeedai/DeepSpeed.

### Can DeepSpeed run locally?

Yes. DeepSpeed can run offline on your own machine. It can also be self-hosted on your own server.

### What can DeepSpeed do?

Main jobs: Model training.

### Who makes DeepSpeed?

DeepSpeed is made by Microsoft.

### What are open-source alternatives to DeepSpeed?

Open-source ones: PyTorch, TensorFlow, Transformers, JAX, Megatron-LM, MLX, nanoGPT and ModelScope. Others: Hugging Face.

## Sources

- [deepspeed.ai](https://www.deepspeed.ai/) — checked 2026-09-24
- [github.com](https://github.com/deepspeedai/DeepSpeed)

---

Last updated 2026-09-24 · sources checked 2026-09-24 · Markdown version of https://godooo.ai/en/framework/deepspeed. Every page on this site has one: add .md to its address.
