--- title: "LLM 网关 - 工程与架构 - AI·外脑 | 思行致远" canonical: "https://siyuanailab.com/knowledge/ai-core/engineering/llm-gateway/" dateModified: "2026-06-29" datePublished: "2026-06-29" --- 打开 AI·外脑目录 AI·外脑 [返回专栏首页](https://siyuanailab.com/knowledge/) × 站内搜索 ⌕ 主要栏目 - [AI 核心概念](https://siyuanailab.com/knowledge/ai-core/) - [工作流](https://siyuanailab.com/knowledge/workflows/) - [工具配置与选型](https://siyuanailab.com/knowledge/toolkits/) - [信源与标准](https://siyuanailab.com/knowledge/sources/) - [场景案例 待开发](https://siyuanailab.com/knowledge/scenarios/) - [职业与能力](https://siyuanailab.com/knowledge/career/) 专题 - [从这里开始](https://siyuanailab.com/knowledge/start/) - [获取与安装](https://siyuanailab.com/knowledge/install/) - [建设日志](https://siyuanailab.com/knowledge/ops/) [AI 核心概念子目录](https://siyuanailab.com/knowledge/ai-core/) [基础概念 **9**](https://siyuanailab.com/knowledge/ai-core/foundations/) - [01-01 人工智能](https://siyuanailab.com/knowledge/ai-core/foundations/artificial-intelligence/) - [01-02 生成式 AI](https://siyuanailab.com/knowledge/ai-core/foundations/generative-ai/) - [01-03 大语言模型](https://siyuanailab.com/knowledge/ai-core/foundations/large-language-model/) - [01-05 机器学习](https://siyuanailab.com/knowledge/ai-core/foundations/machine-learning/) - [01-06 神经网络](https://siyuanailab.com/knowledge/ai-core/foundations/neural-network/) - [01-07 Transformer 架构](https://siyuanailab.com/knowledge/ai-core/foundations/transformer-architecture/) - [01-08 参数](https://siyuanailab.com/knowledge/ai-core/foundations/parameters/) - [01-09 训练数据](https://siyuanailab.com/knowledge/ai-core/foundations/training-data/) - [01-10 预训练](https://siyuanailab.com/knowledge/ai-core/foundations/pre-training/) [模型与机制 **12**](https://siyuanailab.com/knowledge/ai-core/models/) - [02-01 Token](https://siyuanailab.com/knowledge/ai-core/models/token/) - [02-02 上下文窗口](https://siyuanailab.com/knowledge/ai-core/models/context-window/) - [02-03 注意力机制](https://siyuanailab.com/knowledge/ai-core/models/attention-mechanism/) - [02-04 嵌入/向量](https://siyuanailab.com/knowledge/ai-core/models/embedding/) - [02-05 检索增强生成](https://siyuanailab.com/knowledge/ai-core/models/retrieval-augmented-generation/) - [02-06 微调](https://siyuanailab.com/knowledge/ai-core/models/fine-tuning/) - [02-07 提示词工程](https://siyuanailab.com/knowledge/ai-core/models/prompt-engineering/) - [02-09 思维链](https://siyuanailab.com/knowledge/ai-core/models/chain-of-thought/) - [02-10 推理](https://siyuanailab.com/knowledge/ai-core/models/reasoning/) - [02-11 幻觉](https://siyuanailab.com/knowledge/ai-core/models/hallucination/) - [02-12 对齐](https://siyuanailab.com/knowledge/ai-core/models/alignment/) - [02-13 温度/采样参数](https://siyuanailab.com/knowledge/ai-core/models/temperature/) [Agent 与智能体系统 **8**](https://siyuanailab.com/knowledge/ai-core/agents/) - [03-01 智能体](https://siyuanailab.com/knowledge/ai-core/agents/ai-agent/) - [03-02 多智能体系统](https://siyuanailab.com/knowledge/ai-core/agents/multi-agent-system/) - [03-04 工具调用](https://siyuanailab.com/knowledge/ai-core/agents/tool-use-function-calling/) - [03-05 记忆系统](https://siyuanailab.com/knowledge/ai-core/agents/memory-system/) - [03-06 规划能力](https://siyuanailab.com/knowledge/ai-core/agents/planning/) - [03-07 委托机制](https://siyuanailab.com/knowledge/ai-core/agents/delegation/) - [03-08 模型上下文协议](https://siyuanailab.com/knowledge/ai-core/agents/model-context-protocol/) - [03-09 智能体工作流](https://siyuanailab.com/knowledge/ai-core/agents/agentic-workflow/) [工程与架构 **7**](https://siyuanailab.com/knowledge/ai-core/engineering/) - [04-01 AI 工程学](https://siyuanailab.com/knowledge/ai-core/engineering/ai-engineering/) - [04-02 LLM 网关](https://siyuanailab.com/knowledge/ai-core/engineering/llm-gateway/) - [04-04 测试时计算](https://siyuanailab.com/knowledge/ai-core/engineering/test-time-compute/) - [04-06 上下文工程](https://siyuanailab.com/knowledge/ai-core/engineering/context-engineering/) - [04-07 Vibe Coding](https://siyuanailab.com/knowledge/ai-core/engineering/vibe-coding/) - [04-08 人参与循环](https://siyuanailab.com/knowledge/ai-core/engineering/human-in-the-loop/) - [04-09 评估方法](https://siyuanailab.com/knowledge/ai-core/engineering/evaluation-methods/) [交互与提示 **4**](https://siyuanailab.com/knowledge/ai-core/interaction/) - [05-01 系统提示词](https://siyuanailab.com/knowledge/ai-core/interaction/system-prompt/) - [05-03 少样本提示](https://siyuanailab.com/knowledge/ai-core/interaction/few-shot-prompting/) - [05-04 角色提示](https://siyuanailab.com/knowledge/ai-core/interaction/role-prompting/) - [05-05 提示词注入](https://siyuanailab.com/knowledge/ai-core/interaction/prompt-injection/) [安全与治理 **4**](https://siyuanailab.com/knowledge/ai-core/safety/) - [06-01 AI 安全](https://siyuanailab.com/knowledge/ai-core/safety/ai-safety/) - [06-03 智能体治理](https://siyuanailab.com/knowledge/ai-core/safety/agent-governance/) - [06-04 模型偏见](https://siyuanailab.com/knowledge/ai-core/safety/model-bias/) - [06-05 数据隐私](https://siyuanailab.com/knowledge/ai-core/safety/data-privacy/) 工程与架构 · 04-02 # LLM 网关（LLM Gateway） 杨思远 / 思行致远 · 2026/6/29 · 置信度：高 LLM网关模型管理AI工程 位于应用和多个模型供应商之间的统一入口，用于管理调用、路由、限流、日志和成本。 # LLM 网关（LLM Gateway） > 位于应用和多个模型供应商之间的统一入口，用于管理调用、路由、限流、日志和成本。 --- ## 一、是什么 - 位于应用和多个模型供应商之间的统一入口，用于管理调用、路由、限流、日志和成本。 - 类比：像公司前台和调度中心，所有模型请求先经过它。 - 关键澄清： | 它不是什么 | 它是什么 | | --- | --- | | 不是一个新模型 | 管理模型访问的基础设施层 | ## 二、为什么重要 - 它让团队能统一接入不同模型，并保留治理和观测能力。 - 不懂它会怎样：没有网关，多模型调用会分散在各处，成本和风险难追踪。 ## 三、日常怎么理解 - 用一句话讲给非技术朋友听：LLM 网关是所有模型调用的总入口。 - 常见场景：同一个产品同时调用 OpenAI、Claude、Gemini 或本地模型。 - **模型路由（Model Routing）**：根据任务、成本、速度、质量或故障状态，动态选择最合适模型的机制。类比：像派单系统，简单单给便宜快的，疑难单给专家。关键澄清：模型路由不是普通负载均衡，而是按任务特征选择模型或供应商的策略。路由规则不清会造成质量波动和排查困难。常见场景：摘要走便宜模型，复杂推理走强模型，故障时切备用模型。永远用最强模型未必最省事，最强模型常常更贵更慢，未必适合所有任务。 ## 四、常见误解 | 误解 | 真相 | | --- | --- | | 小项目不需要网关思维 | 哪怕不搭完整网关，也要有统一封装和日志。 | ## 五、延伸阅读 - 本知识库相关：模型路由、API密钥即护栏 - [待补信源：Wikipedia 或 Gartner LLM Gateway 定义] ## 适用场景与行动 **场景：**适合用来建立 AI 核心概念的共同语言。 **适合谁：**非技术创业者、AI 产品使用者、内容与业务负责人 **下一步：**先用一句话复述这个概念，再判断它和你的业务场景有什么关系。 这张卡片由杨思远基于真实工作流和实测经验整理。 如发现信息过时或有误，可通过 [/contact](https://siyuanailab.com/contact) 反馈。 [上一张：AI 工程学](https://siyuanailab.com/knowledge/ai-core/engineering/ai-engineering/) [下一张：测试时计算](https://siyuanailab.com/knowledge/ai-core/engineering/test-time-compute/) [返回当前分类](https://siyuanailab.com/knowledge/ai-core/engineering/) [返回 AI·外脑入口](https://siyuanailab.com/knowledge/)