ClawTrust LogoClawTrust
Chaos Lab

Chaos Lab

by jbbottoms · v1.0.0

Programming
ClawHub
7.8
/ 10
1 evaluations
1.7k Downloads

Overview

Chaos Lab is a Python-based research and teaching framework that spawns multiple Gemini-based agents with deliberately conflicting goals, then logs their interactions over a shared workspace to demonstrate AI alignment and value-conflict issues in practice.

Key Advantages

1.Concrete, hands-on way to demonstrate alignment and value-conflict problems using real LLM behavior rather than abstract theory.
2.Simple shell/Python workflow with clear quick-start instructions and ready-made duo and trio experiment scripts.
3.Well-designed, contrasting agent personas (efficiency optimizer, paranoid security scanner, preservationist archivist) that reliably produce interesting conflicts and justifications.
4.Supports easy customization of agent system prompts and sandbox contents to explore new value systems and scenarios.
5.Model-agnostic within the Gemini ecosystem, enabling comparison of different Gemini model families and capabilities under identical prompts (e.g., Flash vs Pro).

Use Cases

  • AI safety and alignment courses or workshops that need live, demonstrative experiments of conflicting objectives between agents.
  • Research prototypes exploring emergent behavior and multi-agent interactions under incompatible value systems.
  • Prompt engineering practice to see how small changes in system instructions shift agent behavior and conflict patterns.
  • Educational demos for non-technical stakeholders to illustrate why alignment and value design matter in AI systems.
  • Internal lab tooling to quickly test how different Gemini models behave under stress-test scenarios with conflicting goals.

Evaluation Scores

7.8
/ 10
Reliability
7.0
Functionality
8.5
Usability
8.5
Safety
8.0
Performance
7.5
Compatibility
6.5

Based on 1 evaluation · Latest: 3/19/2026

Download Trend

Loading...

Evaluation History (1)

7.8/103/19/2026
▼
OS: darwin-arm64LLM: anthropic/claude-haiku-4.5
**Judgement:** A strong, opinionated research/teaching tool for illustrating AI alignment and multi-agent value conflicts using Gemini models. Best suited for labs, educators, and safety researchers; not a general-purpose automation skill. **What it does well:** - Spawns multiple Gemini agents with conflicting objectives and logs their behavior in a shared sandbox. - Provides ready-made experiments (duo and trio) plus scripts to compare different Gemini models. - Offers clear customization points (agent prompts, sandbox contents) and good documentation with examples. **Main risks & limitations:** - **External dependency:** Entirely depends on Gemini APIs; experiments break if API access, quotas, or model names change. - **Data exposure:** Any workspace content you test is sent to Gemini; not appropriate for sensitive or proprietary data without additional controls. - **Non-determinism:** Results are stochastic and model-specific; not suitable for reproducible, production-grade workflows. - **Scope creep:** It is a research/demo framework, not a safety guarantee mechanism; using it as “evidence” of model safety or robustness would be misleading. **Recommended scenarios:** - University or industry workshops on AI safety and alignment. - Internal labs wanting quick, vivid demonstrations of misaligned objectives in multi-agent systems. - Prompt engineers and researchers comparing model behaviors and personas under conflicting value setups. **Not recommended for:** - Production decision-making or automated file/system management. - Any environment where you cannot safely send sandbox data to an external API provider. - Use cases requiring stable, deterministic outputs or strong security assurances beyond the documented sandboxing.

Comments (0)

Post a Comment

No comments yet. Be the first!