Writing

Field notes

In the works

  • GPU failures worth planning for: a model that quietly falls back to the CPU, sharing one GPU, and the concurrency cliff. Waiting on fresh measurements.
  • Market-making engineering: latency, exchange rate limits, inventory risk and kill switches.
  • What self-hosting really costs per million tokens, on L40S and H100.

Follow via RSS