Try NIM
A small companion to this post. Paste your NVIDIA NIM API key, pick a model, type a prompt, and copy the command into your terminal. Your key never leaves your browser. This page does not make API calls; it generates a request you run locally, so the only host that ever sees your key is NVIDIA.
Stored only in this browser's localStorage on this domain.
Run the command in any terminal. The first time, you may need
pip install openai for the Python version. The curl version
needs nothing beyond curl, which ships with macOS, Linux, and recent Windows.