Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
monster_truck
14 days ago
|
parent
|
context
|
favorite
| on:
macOS 26.2 enables fast AI clusters with RDMA over...
Even if it wasn't outright beneficial for decoding by itself, it would still allow you to connect a second machine running a smaller, more heavily quantized version of the model for speculative decoding which can net you >4x without quality loss
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: