EUNO.NEWS EUNO.NEWS
  • All (2352) +197
  • AI (546) +17
  • DevOps (141) +1
  • Software (988) +123
  • IT (672) +55
  • Education (5) +1
  • Notice
  • All (2352) +197
    • AI (546) +17
    • DevOps (141) +1
    • Software (988) +123
    • IT (672) +55
    • Education (5) +1
  • Notice
  • All (2352) +197
  • AI (546) +17
  • DevOps (141) +1
  • Software (988) +123
  • IT (672) +55
  • Education (5) +1
  • Notice
Sources Tags Search
한국어 English 中文
  • 1周前 · ai

    [Paper] DSD：一种用于边缘‑云敏捷大模型服务的分布式投机解码方案

    大型语言模型（LLM）推理通常面临高解码延迟以及在异构边缘‑云环境中的可扩展性受限。现有的…

    #speculative decoding #LLM serving #edge‑cloud inference #distributed inference #adaptive window control
EUNO.NEWS
RSS GitHub © 2025