openharmony-mlx/awesome-gpt-oss.md

Awesome gpt-oss

This is a list of guides and resources to help you get started with the gpt-oss models.

• Inference
  • Local
  • Server
  • Cloud
• Examples / Tutorials
• Tools

Inference

Local

• Ollama
  • How to run gpt-oss locally with Ollama
  • Ollama & gpt-oss launch blog
  • Check out the models Ollama
• LM Studio
  • LM Studio & gpt-oss launch blog
  • Use gpt-oss-20b with LM Studio
  • Use gpt-oss-120b with LM Studio
• Hugging Face & Transformers
  • How to run gpt-oss with Transformers
  • Hugging Face & gpt-oss launch blog
  • Collection of Hugging Face examples
• NVIDIA
  • gpt-oss on RTX

Server

• vLLM
  • How to run gpt-oss with vLLM
• NVIDIA
  • Optimizing gpt-oss with NVIDIA TensorRT-LLM
  • Deploying gpt-oss on TensorRT-LLM

Cloud

• Groq
  • Groq & gpt-oss launch blog
  • gpt-oss-120b model on the GroqCloud Playground
  • gpt-oss-20b model on the GroqCloud Playground
  • gpt-oss with built-in web search on GroqCloud
  • gpt-oss with built-in code execution on GroqCloud
  • Responses API on Groq
• NVIDIA
  • NVIDIA launch blog post
  • NVIDIA & gpt-oss developer launch blog post
  • Use gpt-oss-120b and gpt-oss-20b on NVIDIA's Cloud
• Cloudflare
  • Cloudflare & gpt-oss launch blog post
  • gpt-oss-120b on Cloudflare Workers AI
  • gpt-oss-20b on Cloudflare Workers AI

Examples & Tutorials

• OpenAI harmony response format

Tools

• Example python tool for gpt-oss
• Example browser tool for gpt-oss

Contributing

Feel free to open a PR to add your own guides and resources on how to run gpt-oss. We will try to review it and add it here.