Skip to content

[Serve] sky serve status should show ready replicas at the top and ordered by the version #3052

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
Michaelvll opened this issue Jan 30, 2024 · 1 comment · May be fixed by #5188
Open

[Serve] sky serve status should show ready replicas at the top and ordered by the version #3052

Michaelvll opened this issue Jan 30, 2024 · 1 comment · May be fixed by #5188
Labels
enhancement New feature or request P0 serve features/bugs related to sky serve

Comments

@Michaelvll
Copy link
Collaborator

Currently the sky serve status show the replicas by the order of ID. However, the latest READY replicas should be more important and interesting to the user. Also, when the number of replicas increase, the current implementation hides the latest replicas, which is unexpected.

sky serve status
Services
NAME        VERSION  UPTIME      STATUS  REPLICAS  ENDPOINT            
code-llama  3        2h 15m 59s  READY   1/6       x.x.x.x:30002  

Service Replicas
SERVICE_NAME  ID  VERSION  IP             LAUNCHED    RESOURCES                    STATUS        REGION    
code-llama    1   1        -              -           -                            FAILED        -         
code-llama    2   1        x.x.x.x  2 hrs ago   1x Azure({'A100-80GB': 2}))  READY         eastus    
code-llama    3   1        -              -           -                            FAILED        -         
code-llama    4   1        -              -           -                            FAILED        -         
code-llama    5   1        -              -           -                            FAILED        -         
code-llama    6   1        -              -           -                            FAILED        -         
code-llama    7   1        -              1 min ago   1x Azure({'A100-80GB': 2}))  PROVISIONING  westus3   
code-llama    8   2       x.x.x.x  1 min ago   1x Azure({'A100-80GB': 2}))  STARTING      eastus    
code-llama    9   2        -              5 mins ago  1x Azure({'A100-80GB': 2}))  PROVISIONING  eastus    
code-llama    10  3        -              2 mins ago  1x GCP({'L4': 8}))           PROVISIONING  us-east4  
... (use --all to show all replicas)

Several things we should do:

  1. Make sure the later versions show at the top
  2. Have the ready replicas shown first
@Michaelvll
Copy link
Collaborator Author

cc'ing @cblmemo

@Michaelvll Michaelvll added enhancement New feature or request P0 labels Jan 30, 2024
@dtran24 dtran24 mentioned this issue Feb 19, 2024
Closed
6 tasks
@Michaelvll Michaelvll mentioned this issue Mar 9, 2024
Merged
6 tasks
@cblmemo cblmemo added the serve features/bugs related to sky serve label Jun 21, 2024
@mert-cemri mert-cemri linked a pull request Apr 11, 2025 that will close this issue
Open
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request P0 serve features/bugs related to sky serve
Projects
None yet
Milestone
No milestone
2 participants
@Michaelvll @cblmemo