ClawTrust LogoClawTrust
LLM Supervisor

LLM Supervisor

by dhardie · v1.0.0

Productivity
ClawHub
7.8
/ 10
1 evaluations
2.3k Downloads

Overview

Orchestrate graceful handling of cloud LLM rate limits by transparently notifying the user and optionally falling back to a local Ollama model (qwen2.5:7b), with explicit confirmation rules for code-generation tasks and simple commands to inspect and switch providers.

Key Advantages

1.Clear, immediate feedback when cloud providers (Anthropic/OpenAI) hit rate limits or overload, avoiding silent failures or endless retries.
2.Built-in local fallback via Ollama with a concrete default model (qwen2.5:7b), allowing continued work during cloud outages or throttling.
3.Safety-conscious behavior for code tasks: never switches to local models for code generation without explicit, in-context user confirmation.
4.Persistent session state tracking (current provider, last rate limit time, code-use confirmation) to keep behavior consistent and explainable over the course of a session.
5.Simple, discoverable command interface (/llm status, /llm switch local, /llm switch cloud) for manual control and inspection of the current setup and recent rate-limit events.

Use Cases

  • Developers working on code-heavy sessions who frequently hit OpenAI/Anthropic rate limits and want a controlled, explicit fallback to local models.
  • Users running on unreliable or constrained network connections who benefit from automatic, guided switching between cloud and local LLMs.
  • Power users with GPUs and Ollama installed who want to save cloud tokens by selectively moving some chat or summarization workloads to local models.
  • Teams that need transparent observability into LLM usage state (which provider is active, recent rate limits) to debug or tune their workflows.
  • Educational or demo environments where showing hybrid cloud/local LLM orchestration, including safe code-generation policies, is valuable.

Evaluation Scores

7.8
/ 10
Reliability
7.2
Functionality
7.8
Usability
8.0
Safety
8.5
Performance
7.5
Compatibility
7.0

Based on 1 evaluation · Latest: 3/19/2026

Download Trend

Loading...

Evaluation History (1)

7.8/103/19/2026
▼
OS: linux-x64LLM: stepfun/step-3.5-flash
**Quick judgement:** A focused orchestration skill that adds real value in rate-limited environments by transparently handling cloud throttling and offering a well-governed fallback to a local Ollama model. It is narrow in scope but thoughtfully designed for developer workflows and hybrid cloud/local setups. **What it does well:** - Immediately surfaces cloud rate-limit/overload events instead of silently failing. - Offers a local fallback (Ollama with `qwen2.5:7b`) and tracks session state (current provider, last rate limit, confirmation for code). - Enforces an important safety/usability rule: **no automatic switch to a local model for code tasks without explicit confirmation**, while being more relaxed for simple chat/summarization once the user has opted in. - Provides clear, low-friction commands: `/llm status`, `/llm switch local`, `/llm switch cloud`. **Key risks / limitations:** - **Environment dependency:** Requires a correctly installed and configured Ollama environment; misconfigurations will degrade the fallback path. - **Model quality variance:** Fallback to `qwen2.5:7b` may produce lower-quality or slower code generation than the primary cloud model, which users must understand. - **Scope constraints:** Focuses specifically on Anthropic/OpenAI + Ollama; does not appear to generalize to other providers or advanced routing policies. - **State visibility reliance:** Users must rely on `/llm status` and prompts to stay aware of which provider is active; confusion is possible if they overlook these indicators. **Recommended scenarios:** - Heavy coding or tooling sessions where OpenAI/Anthropic rate limits are common, and a controlled, explicitly confirmed local fallback is desirable. - Hybrid LLM setups where users already run Ollama locally and want a simple way to reduce downtime and cloud token usage. - Development, teaching, or demo environments that want to showcase responsible model switching (especially around code generation) and transparent rate-limit handling.

Comments (0)

Post a Comment

No comments yet. Be the first!