Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Just keep going! 2TB of swap disk for 0.0000001 t/sec




Hang on, starting benchmarks on my Raspberry Pi.

By the year 2035, toasters will run LLMs.

On a lark a friend setup Ollama on a 8GB Raspberry Pi with one of the smaller models. It worked by it was very slow. IIRC it did 1 token/second.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: