Created a light xbar (open source menubar widget) tool for Mac users to display their Claude tokens in their menu bar.
- topline: session usage %, time to session reset and run-rate comparison (▲ if using session usage heavier than linear run-rate comparison, ▼ or = otherwise).
- 7-day: weekly usage, and weekly run-r...
5
Am thinking of creating a proxy server to route traffic to classmate’s servers once the queue reaches a certain depth. Yo uhh mmm.
So we given VMs that has GPUs and an open ended task to serve vLLMs of a certain model (no restriction on quantised variants etc). Course instructors would be blasting/stress testing it on Monday - will be a last server standing thing. Optimising the fuck out of my vLLM now. this is the most fun I’ve had in a while.
1
4
So we given VMs that has GPUs and an open ended task to serve vLLMs of a certain model (no restriction on quantised variants etc). Course instructors would be blasting/stress testing it on Monday - will be a last server standing thing. Optimising the fuck out of my vLLM now. this is the most fun I’ve had in a while.
3
11
a few data analysts were killed by a stray chart today