Skip to content

Allow the e2e tests to run in parallel on different scheduling shards. #829

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
davidLif wants to merge 3 commits into
base: main
Choose a base branch
from
Draft

Allow the e2e tests to run in parallel on different scheduling shards. #829

davidLif wants to merge 3 commits into from

Conversation

@davidLif
Copy link
Collaborator

@davidLif davidLif commented Jan 4, 2026 •
edited
Loading

Description

Allow the e2e tests to run in parallel on different scheduling shards.
2- "On PR" CI workflow will use 2 shards to run e2e tests.

Related Issues

Fixes #

Checklist

Note: Ensure your PR title follows the Conventional Commits format (e.g., feat(scheduler): add new feature)

  • Self-reviewed
  • Added/updated tests (if needed)
  • Updated documentation (if needed)

Breaking Changes

Additional Notes

@davidLif davidLif force-pushed the DavidL/AllowE2eParallelRunTake2 branch from 00ea8a7 to 2c50a08 Compare January 4, 2026 11:50
@davidLif
1- Wait for helm install in kai-scheduler at run-e2e-kind.sh
6aaf154 
2- Allow the set_parallel_testing_shard.yaml to query for the worker nodes and cut the workers to 2 shards.
@github-actions
Copy link

github-actions bot commented Jan 4, 2026

Merging this branch will not change overall coverage

Impacted Packages Coverage Δ 🤖
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/configurations 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/configurations/feature_flags 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/context 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/fillers 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/pod_group 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/queue 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/shardconfig 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/wait 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/suites/allocate/predicates 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/suites/allocate/priority 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/suites/consolidation 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/suites/preempt 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/suites/reclaim 0.00% (ø)
Coverage by file

Changed files (no unit tests)

Changed File Coverage Δ Total Covered Missed 🤖
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/configurations/config.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/configurations/feature_flags/hierarchy_fairness_type.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/configurations/feature_flags/knative_grouping.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/configurations/feature_flags/placement_strategy.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/configurations/feature_flags/restrict_node_scheduling.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/context/connectivity.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/context/context.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/fillers/filler_jobs.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/batch_job.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/cronjob.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/deployment.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/namespace.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/node.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/persistent_volume.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/pod.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/pod_group/pod_group.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/priority_class.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/queue/queue.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/replicaset.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/statefulset.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/shardconfig/shardconfig.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/wait/pod.go 0.00% (ø) 0 0 0

Please note that the "Total", "Covered", and "Missed" counts above refer to code statements instead of lines of code. The value in brackets refers to the test coverage of that file in the old version of the code.

Changed unit test files

  • github.com/NVIDIA/KAI-scheduler/test/e2e/suites/allocate/predicates/restrict_node_scheduling_test.go
  • github.com/NVIDIA/KAI-scheduler/test/e2e/suites/allocate/predicates/taint_toleration_test.go
  • github.com/NVIDIA/KAI-scheduler/test/e2e/suites/allocate/priority/order_test.go
  • github.com/NVIDIA/KAI-scheduler/test/e2e/suites/consolidation/consolidation_test.go
  • github.com/NVIDIA/KAI-scheduler/test/e2e/suites/preempt/preempt_distributed_test.go
  • github.com/NVIDIA/KAI-scheduler/test/e2e/suites/reclaim/hierarchy_level_fairness_test.go
  • github.com/NVIDIA/KAI-scheduler/test/e2e/suites/reclaim/reclaim_distributed_test.go

@github-actions
Copy link

github-actions bot commented Jan 4, 2026

Merging this branch will not change overall coverage

Impacted Packages Coverage Δ 🤖
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/configurations 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/configurations/feature_flags 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/context 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/fillers 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/pod_group 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/queue 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/shardconfig 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/wait 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/suites/allocate/predicates 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/suites/allocate/priority 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/suites/consolidation 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/suites/preempt 0.00% (ø)
github.com/NVIDIA/KAI-scheduler/test/e2e/suites/reclaim 0.00% (ø)
Coverage by file

Changed files (no unit tests)

Changed File Coverage Δ Total Covered Missed 🤖
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/configurations/config.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/configurations/feature_flags/hierarchy_fairness_type.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/configurations/feature_flags/knative_grouping.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/configurations/feature_flags/placement_strategy.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/configurations/feature_flags/restrict_node_scheduling.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/context/connectivity.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/context/context.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/fillers/filler_jobs.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/batch_job.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/cronjob.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/deployment.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/namespace.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/node.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/persistent_volume.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/pod.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/pod_group/pod_group.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/priority_class.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/queue/queue.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/replicaset.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/resources/rd/statefulset.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/shardconfig/shardconfig.go 0.00% (ø) 0 0 0
github.com/NVIDIA/KAI-scheduler/test/e2e/modules/wait/pod.go 0.00% (ø) 0 0 0

Please note that the "Total", "Covered", and "Missed" counts above refer to code statements instead of lines of code. The value in brackets refers to the test coverage of that file in the old version of the code.

Changed unit test files

  • github.com/NVIDIA/KAI-scheduler/test/e2e/suites/allocate/predicates/restrict_node_scheduling_test.go
  • github.com/NVIDIA/KAI-scheduler/test/e2e/suites/allocate/predicates/taint_toleration_test.go
  • github.com/NVIDIA/KAI-scheduler/test/e2e/suites/allocate/priority/order_test.go
  • github.com/NVIDIA/KAI-scheduler/test/e2e/suites/consolidation/consolidation_test.go
  • github.com/NVIDIA/KAI-scheduler/test/e2e/suites/preempt/preempt_distributed_test.go
  • github.com/NVIDIA/KAI-scheduler/test/e2e/suites/reclaim/hierarchy_level_fairness_test.go
  • github.com/NVIDIA/KAI-scheduler/test/e2e/suites/reclaim/reclaim_distributed_test.go

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@davidLif