- formatting
- images
- links
- math
- code
- blockquotes
•
•
•
•
•
-
大模型推理框架 vLLM 源码解析（一） - marsggbo
1. Quick Start 创建如下代码，命名为 run.py from vllm import LLM, SamplingParams prompts = [ "Have you followed marsggbo in Zhihu?", "你一键三连了吗？" ] # 输入prompts sam
•
•
•
•
•
1. Quick Start 创建如下代码，命名为 run.py from vllm import LLM, SamplingParams prompts = [ "Have you followed marsggbo in Zhihu?", "你一键三连了吗？" ] # 输入prompts sam