OpenAI launched a brand new free and open GPT mannequin yesterday that may run on a PC, and now Microsoft is making that simple to do for Home windows customers. The light-weight gpt-oss-20b mannequin is now accessible on Home windows AI Foundry, and will likely be coming quickly to macOS, too.
You’ll want a PC or laptop computer with not less than 16GB of VRAM, so that you’ll want one of many prime GPUs from Nvidia or the number of Radeon GPUs with enough VRAM. The gpt-oss-20b mannequin is optimized for code execution and gear use, and Microsoft says it’s “good for constructing autonomous assistants or embedding AI into real-world workflows, even in bandwidth-constrained environments.”
Microsoft has pre-optimized gpt-oss-20b for native inference, and it hints that assist for extra gadgets is coming quickly. That might imply we see a extra optimized model for Copilot Plus PCs sooner or later sooner or later, very like how Microsoft has been including quite a lot of native AI fashions to Home windows lately.
Microsoft’s speedy addition of OpenAI’s newest mannequin to the Home windows AI Foundry comes as Amazon was equally fast to undertake the brand new open-weight GPT-OSS fashions for its cloud providers. It’s the primary time you possibly can run an OpenAI mannequin regionally on Home windows, nevertheless it’s additionally the primary time Microsoft’s largest cloud competitor has had entry to the newest OpenAI fashions — including one other dynamic to the difficult OpenAI and Microsoft partnership.