The free tier runs on rate limits - up to 40 requests per minute (RPM) for most models, with no per-token billing. Your personal rate limit is shown in the top-right of the dashboard.
A unified generative model for protein, enzyme, binder and antibody design. RFD4-Proteina is a unified generative model for protein design, produced through a collaboration between NVIDIA's Generative ...
vLLM is a high-performance inference engine for serving LLMs at datacenter scale. However, getting the desired performance requires significant background knowledge and configuration experience, ...
You will choose a recipe for your device, run its commands, and test the model's API and tool calling. Along the way, you will see how the recipe uses memory, batches requests, and selects the code ...
If you want to run a workload or a model that won't fit on a single DGX Spark, you can connect two or more Sparks into a cluster and distribute the workload or model across the devices. However, this ...
You will use NVIDIA Sync to set up a two-Spark cluster, then use a supplied recipe to run one model across both devices. The recipe launcher starts a container on each Spark and runs vLLM across the ...
You will use NVIDIA Sync to connect to a DGX Spark or Station, then download a vLLM container and a model for your device. Then, you will add a supplied launch script ...
Agents are a new way to use a PC. Tell it what you want, and it figures out how to do it. For example, it can help set up your new RTX Spark for you, just ask it to install a list of apps optimized ...
Software 1.0 profile blocks MIG mutation and platform fixes Expected behavior: the Software 1.0 profile is capability-scoped to guidance, diagnostics, read-only MIG inspection, and explicitly ...
Open WebUI is a self-hosted chat application that you can run entirely on your hardware platform. This gives you privacy and security because everything stays on your system. The Open WebUI ...
Your new RTX Spark is amazing at local content creation. It accelerates 3D, Video and 2D workflows. But it does much more! Thanks to its Tensor Cores, unified memory and NVIDIA RTX technology, it can ...