[Doc] Fix user guide error for v0.11.0-dev #5107
Conversation
Signed-off-by: MengqingCao <[email protected]>
Signed-off-by: wangxiyuan <[email protected]>
![gemini-code-assist[bot]](https://avatars.githubusercontent.com/in/956858?s=60&v=4){kind=small}
There was a problem hiding this comment.
Code Review
This pull request updates documentation to align with the v0.11.0 release, including version numbers, feature statuses, and links. My review identified a couple of incorrect links in the feature support matrix which could negatively impact users. The feedback provided aims to correct these documentation errors.
| | Guided Decoding | 🟢 Functional | See detailed note: [Structured Output Guide][guided_decoding] | | ||
| | Tensor Parallel | 🟢 Functional | Make TP >4 work with graph mode. | | ||
| | Pipeline Parallel | 🟡 Planned | Broken in this version, will fix in next release. | | ||
| | Expert Parallel | 🟢 Functional | See detailed note: [Expert Load Balance (EPLB)][graph_mode] | |
There was a problem hiding this comment.
The link for "Expert Parallel" points to the "Graph Mode Guide", which does not seem to contain information about Expert Load Balance (EPLB). The relevant configuration details for EPLB are in the "Additional Configuration" guide. Please update the link to point to the correct document.
For example, you could change the reference to [eplb] and add a new link definition for it at the end of the file:
[eplb]: https://docs.vllm.ai/projects/ascend/en/v0.11.0-dev/user_guide/configuration/additional_config.html
| | Expert Parallel | 🟢 Functional | See detailed note: [Expert Load Balance (EPLB)][graph_mode] | | |
| | Expert Parallel | 🟢 Functional | See detailed note: [Expert Load Balance (EPLB)][eplb] | |
| | Quantization | 🟢 Functional | W8A8 available; working on more quantization method support (W4A8, etc) | | ||
| | Graph Mode | 🔵 Experimental| Experimental, see detailed note: [vllm-ascend#767][graph_mode] | | ||
| | Sleep Mode | 🟢 Functional | | | ||
| | Quantization | 🟢 Functional | See detailed note: [Quantization Guide][qaunt] | |
There was a problem hiding this comment.
There's a typo in the link reference for the "Quantization Guide". It's written as [qaunt], but the link is defined as [quant]. This results in a broken link.
| | Quantization | 🟢 Functional | See detailed note: [Quantization Guide][qaunt] | | |
| | Quantization | 🟢 Functional | See detailed note: [Quantization Guide][quant] | |
2 participants
Pick from #5098 to fix the doc error