EUNO.NEWS EUNO.NEWS
  • All (2364) +206
  • AI (546) +17
  • DevOps (142) +2
  • Software (996) +129
  • IT (675) +57
  • Education (5) +1
  • Notice
  • All (2364) +206
    • AI (546) +17
    • DevOps (142) +2
    • Software (996) +129
    • IT (675) +57
    • Education (5) +1
  • Notice
  • All (2364) +206
  • AI (546) +17
  • DevOps (142) +2
  • Software (996) +129
  • IT (675) +57
  • Education (5) +1
  • Notice
Sources Tags Search
한국어 English 中文
  • 1周前 · ai

    [Paper] DSD：一种用于边缘‑云敏捷大模型服务的分布式投机解码方案

    大型语言模型（LLM）推理通常面临高解码延迟以及在异构边缘‑云环境中的可扩展性受限。现有的…

    #speculative decoding #LLM serving #edge‑cloud inference #distributed inference #adaptive window control
EUNO.NEWS
RSS GitHub © 2025