Nvidia

NVIDIA offers free access to their powerful Nemotron models through their NVIDIA Build platform. In this post, I’ll walk you through how to get a free API key and configure it in VS Code to use models like nvidia/nemotron-3-ultra-550b-a55b directly in VS Code. Also you can choose any other model from here. Prerequisites VScode needs to be above 1.27 it needs to have customendpoint supporting Getting Your Free NVIDIA API Key Go to build.nvidia.com Sign in or create an NVIDIA account Navigate to the model you want to use (e.g., Nemotron 3 Ultra) Click “Get API Key” button Note: In my experience, the “Get API Key” button in the UI didn’t work properly (it appeared to do nothing). If this happens to you, here’s how to get your API key: ...

Setting up NVIDIA CUDA on Debian 13 (Trixie/Sid) to run Large Language Models (LLMs) can be a bit of a journey, especially if you’re transitioning from the default open-source drivers to the proprietary stack required for GPGPU workloads. Over the last few days, I’ve been working on getting llama.cpp to run with CUDA on my laptop to see how much of a difference it makes compared to pure CPU execution. ...