DFlash 2 decodes at close to 3× the speed of autoregressive decoding, about a third of the compute per token, with the same output.
llm
inference
FoldFold allExpandExpand allAre you sure you want to delete this link?Are you sure you want to delete this tag?
The personal, minimalist, super fast, database-free, bookmarking service by the Shaarli community
