gpu
2 posts tagged “gpu”.
-
The 42 KB context audit
The reader was serving a quarter of the context the model was trained for, and the plan said there was nothing above it worth reaching for. One unit error, one constant, and 12 GB of headroom.
-
The GPU is rented; the box is not
One $23.37 server owns the bytes. One 48 GB L40S exists only while someone is calling it — and a public URL that starts a GPU is a billing surface before it is an API.