Skip to content
This repository has been archived by the owner on Oct 5, 2023. It is now read-only.

How to find and display only some models by traits #798

Open
neubig opened this issue May 25, 2023 · 3 comments
Open

How to find and display only some models by traits #798

neubig opened this issue May 25, 2023 · 3 comments

Comments

@neubig
Copy link
Contributor

neubig commented May 25, 2023

I tried to run Zeno with 100 models, and then only wanted to take a look at the top-performing ones. Is there a good way to do this?

Right now I am stuck in reports view, and see this with a bar chart:

Screen Shot 2023-05-25 at 12 19 51 AM

this with a table:
Screen Shot 2023-05-25 at 12 23 32 AM

and this with a line chart:
Screen Shot 2023-05-25 at 12 22 55 AM

The line chart does allow me to find at least one top-scoring models by mousing-over the highest points (and some of the dots are hidden).

It'd be nice if it were possible to:

  1. Sort the table by score (also maybe swap the rows and columns?)
  2. Even better, "slice" models by accuracy or other features, to only view a certain portion of them. It would also be useful to be able to do this with other traits, such as the model hyper-parameters.
@neubig neubig changed the title How to find and display only top-scoring models How to find and display only some models May 25, 2023
@neubig neubig changed the title How to find and display only some models How to find and display only some models by traits May 25, 2023
@cabreraalex
Copy link
Member

🤯 I love it super power user. Both of those sound reasonable, with the table being the easiest. We'll have to think of how to filter out models though...

@cabreraalex
Copy link
Member

@stevenyh3 could you look into potentially supporting the table where the rows are models and column are metrics/maybe some simple sorting? This might already be possible.

@stevenyh3
Copy link
Contributor

stevenyh3 commented May 25, 2023

For now, I think the rows and columns are able to swap like the attached picture. But metrics are only feasible in the layer dropdown now. I'll try to support multiple metrics as columns(x-axis), and add sort feature in the near future.

image

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants