Skip to content

Cryptic News

ChatGPT opines on cruciferous vegetables, Decameron, and Scheherazade

2024-05-13 by Mark Dominus - (0 min read)

Layer-wise inferencing + batching: Small VRAM doesn't limit LLM throughput anymore

Today I learned that iMessage automatically…