[[Coherent]] — 리스크
260319 arxiv 모음
Efficient Reasoning on the Edge
Efficient Reasoning on the Edge
Large language models (LLMs) with chain-of-thought reasoning achieve state-of-the-art performance across complex problem-solving tasks, but their verbose reasoning traces and large context requirements make them impractical for edge deployment. These challenges include high token generation costs, large KV-cache footprints, and inefficiencies when distilling reaso
관련 노트
- [[260323_Coherent_리스크]]
- [[Coherent]]