EUNO.NEWS
Toggle Menu
All
(20292)
+229
AI
(3103)
+13
DevOps
(906)
+6
Software
(10480)
+161
IT
(5755)
+49
Education
(48)
Notice
All
(20292)
+229
Categories
AI
(3103)
+13
DevOps
(906)
+6
Software
(10480)
+161
IT
(5755)
+49
Education
(48)
Notice
All
(20292)
+229
AI
(3103)
+13
DevOps
(906)
+6
Software
(10480)
+161
IT
(5755)
+49
Education
(48)
Notice
Sources
Tags
Search
zh
한국어
English
中文
1个月前
·
ai
[Paper] DSD:一种用于边缘‑云敏捷大模型服务的分布式投机解码方案
大型语言模型(LLM)推理通常面临高解码延迟以及在异构边缘‑云环境中的可扩展性受限。现有的…