Microsoft and NVIDIA will make it easier for developers to use AI models on Windows

By: Bohdan Kaminskyi | 16.11.2023, 20:24
Microsoft and NVIDIA will make it easier for developers to use AI models on Windows
NVIDIA

Microsoft and NVIDIA have announced updates that will make it easier to run and configure artificial intelligence models on Windows PCs.

Here's What We Know

Microsoft has introduced Windows AI Studio, a hub for accessing and customising pre-built AI models. Developers will be able to access tools from Azure AI Studio and customise and test models according to the needs of the project.

At the same time, NVIDIA announced an update to TensorRT-LLM, which optimises the running of large language models on the GPU. This tool will now work on GeForce RTX 30 and 40 graphics cards. There will also be support for OpenAI's Chat API.

This will allow developers to run AI models locally on their PCs without resorting to the cloud. According to the companies, such improvements will make it easier to create AI applications for Windows.

Source: The Verge