feat: model prices and latency in browser, Waypoint-style settings tabs

- Model browser: per-million input/output price on every row; time to first token (p50) and tokens/s for the busiest OpenRouter provider, fetched lazily for visible rows and cached 10 minutes.
- Fix: Free badge and free-first sorting (prices are strings), and the list was empty until typing.
- Settings: text-only tabs styled like Waypoint's; drop the heading that repeated the tab name.
This commit is contained in:
olivier committed 2026-10-12 16:28:59 -04:00
1 parent b4d962047b
commit 564e3ea8b3
4 files changed
+187 -83

No files matched your search

+3 -1
View File
@@ -133,10 +133,12 @@ This is useful for automation tools, Stream Deck, or scripting.
## Model Selection
Wherever you need to select an AI model (post-processing, proofreading, title generation), NibbleAI provides a **Browse models** button that opens a searchable dialog of available OpenRouter models:
Wherever you need to select an AI model (post-processing, proofreading, title generation, property filler), NibbleAI provides a **Browse** button that opens a searchable dialog of available OpenRouter models:
- Models are fetched live from `openrouter.ai/api/v1/models`
- Free models appear first (marked with a **Free** badge)
- Each row shows the price per million input/output tokens
- With an OpenRouter key configured, each visible row also shows time to first token (p50) and output speed (tokens/s) over the last 30 minutes, for the provider that served the most requests. Loaded once you stop typing; cached for 10 minutes
- Type to filter by name, ID, or description
- You can still type a model ID manually if you prefer