Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[runtime] Add FIFO scheduling #1405

Open
iyzhang opened this issue Sep 20, 2024 · 0 comments
Open

[runtime] Add FIFO scheduling #1405

iyzhang opened this issue Sep 20, 2024 · 0 comments
Assignees
Labels
enhancement Enhancement Request on an Existing Feature

Comments

@iyzhang
Copy link
Contributor

iyzhang commented Sep 20, 2024

Context

Our current scheduler only has a round-robin scheduling policy, which is good for fairness but not for tail latency.

Proposed Solution

Add an additional scheduling policy for FIFO.

Alternative Solutions

We could replace the round-robin scheduler totally with FIFO but having both is useful.

@iyzhang iyzhang added the enhancement Enhancement Request on an Existing Feature label Sep 20, 2024
@iyzhang iyzhang self-assigned this Sep 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Enhancement Request on an Existing Feature
Projects
None yet
Development

No branches or pull requests

1 participant