feat: model prices and latency in browser, Waypoint-style settings tabs
- Model browser: per-million input/output price on every row; time to first token (p50) and tokens/s for the busiest OpenRouter provider, fetched lazily for visible rows and cached 10 minutes. - Fix: Free badge and free-first sorting (prices are strings), and the list was empty until typing. - Settings: text-only tabs styled like Waypoint's; drop the heading that repeated the tab name.
This commit is contained in:
1 parent
b4d962047b
commit
564e3ea8b3
4 files changed
+187
-83
No files matched your search
@@ -133,10 +133,12 @@ This is useful for automation tools, Stream Deck, or scripting.
|
||||
|
||||
## Model Selection
|
||||
|
||||
Wherever you need to select an AI model (post-processing, proofreading, title generation), NibbleAI provides a **Browse models** button that opens a searchable dialog of available OpenRouter models:
|
||||
Wherever you need to select an AI model (post-processing, proofreading, title generation, property filler), NibbleAI provides a **Browse** button that opens a searchable dialog of available OpenRouter models:
|
||||
|
||||
- Models are fetched live from `openrouter.ai/api/v1/models`
|
||||
- Free models appear first (marked with a **Free** badge)
|
||||
- Each row shows the price per million input/output tokens
|
||||
- With an OpenRouter key configured, each visible row also shows time to first token (p50) and output speed (tokens/s) over the last 30 minutes, for the provider that served the most requests. Loaded once you stop typing; cached for 10 minutes
|
||||
- Type to filter by name, ID, or description
|
||||
- You can still type a model ID manually if you prefer
|
||||
|
||||
|
||||
Reference in new issue
Block a user