-
Notifications
You must be signed in to change notification settings - Fork 2.2k
【fleet】support Dpo lora #3617
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
【fleet】support Dpo lora #3617
Conversation
|
Thanks for your contribution! |
Codecov Report❌ Patch coverage is ❌ Your patch status has failed because the patch coverage (26.31%) is below the target coverage (75.00%). You can increase the patch coverage or adjust the target coverage. Additional details and impacted files@@ Coverage Diff @@
## develop #3617 +/- ##
==========================================
Coverage ? 32.60%
==========================================
Files ? 431
Lines ? 81889
Branches ? 0
==========================================
Hits ? 26701
Misses ? 55188
Partials ? 0 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
|
/re-run all-failed |
|
/re-run all-failed |
| model_config.max_sequence_length = data_args.max_seq_len | ||
| model_config._attn_implementation = model_args.attn_impl | ||
| model_config.is_lora = model_args.lora | ||
|
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
qwen3vl lora也需要fallback,需要确定去掉这个对qwen3vl影响,否则会报错
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
qwen3vl 本地已验证,没有报错
|
/re-run all-failed |
lugimzzz
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
c4254f2
|
/re-run all-failed |
1 similar comment
|
/re-run all-failed |
Before submitting
testsfolder. If there are codecov issues, please add tests cases first.PR types
Others
PR changes
Others
Description
支持dpo-lora, qwenvl3 lora 使用fleet 组网