Skip to content

Cryptic News

Today I learned that iMessage automatically…

2024-05-13 by Rodrigo Ghedin - (0 min read)

Layer-wise inferencing + batching: Small VRAM doesn't limit LLM throughput anymore

Observation on the real-time strategy genre