Commit dc225e1
[v0.13.0][Lora][BugFix] Fix crash on base model requests with LoRA enabled (#6457)
problem: when use lora in compile mode, request lora module is
successful,but request base model will be failed and model will be core
down.
### What this PR does / why we need it?
when we start a model with lora , request lora is ok, but requesting
base model will case the model process core down【dangerous problem】
Related-issues: #6279
### Does this PR introduce _any_ user-facing change?
not introduce_any_user-facing change
### How was this patch tested?
vLLM version: v0.13.0 rc2
Signed-off-by: l00832868 <[email protected]>
Co-authored-by: l00832868 <[email protected]>1 parent cb1212f commit dc225e1
1 file changed
+2
-3
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2131 | 2131 | | |
2132 | 2132 | | |
2133 | 2133 | | |
2134 | | - | |
2135 | 2134 | | |
2136 | | - | |
| 2135 | + | |
2137 | 2136 | | |
2138 | 2137 | | |
2139 | 2138 | | |
| |||
2189 | 2188 | | |
2190 | 2189 | | |
2191 | 2190 | | |
2192 | | - | |
| 2191 | + | |
2193 | 2192 | | |
2194 | 2193 | | |
2195 | 2194 | | |
| |||
0 commit comments