realm_id determines which raw
config document is read and written.
Realm-scoped config
An ordinary non-global realm keeps these files in its resolved realm directory:config.toml(user settings)config_state.json(generation counter for CAS)realm_manifest.json(pinned backend + metadata)
global config document and its config-generation sidecar are the
exception: they are home-rooted at ~/.rkat/config.toml and
~/.rkat/config_state.json. Global config can be inherited, but a global
realm’s runtime state is never inherited.
For CLI commands, the normal non-global location is project-local:
project-root is the nearest ancestor containing .rkat. Outside an
existing project, it falls back to the exact invocation context. The invocation
context itself is never walked up for workspace realm identity or MCP trust
discovery, so identity and the local storage candidate are intentionally
separate facts. An explicit --state-root bypasses candidate probing.
For daemon/API surfaces that do not receive a --state-root, the default state
root is the platform data directory:
- macOS:
~/Library/Application Support/meerkat/realms/<realm>/ - Linux:
~/.local/share/meerkat/realms/<realm>/ - Windows:
%APPDATA%\meerkat\realms\<realm>\
Realm config inheritance
A realm config doc may declare aparent, and resolution walks a single chain
head -> parent -> ... -> global. A terminal non-global realm appends
global when a global section is configured. The chain can also end before
global when no global config has been materialized.
- Config inherits along the chain: models, MCP servers, hooks, skills, limits, and auth bindings are composed parent-first with child-wins.
- State never inherits: sessions, session stores, event stores, and the
.rkat/projection stay realm-local to the consuming (head) realm.
global realm’s config document is home-rooted at ~/.rkat/config.toml
(a single well-known location, not a per-workspace file), which is why a single
rkat auth login is inherited by every workspace realm via the chain tail. See
Realm inheritance for the full model, including
credential read-inherit / write-strict-owner and the add/override-but-not-remove
rules for MCP servers and hooks.
Effective precedence
For an agent build in a given realm, effective precedence is:- Built-in defaults
- A configured
globalroot and explicit ancestors, folded root-first - The head realm’s own
config.toml - Per-request runtime parameters (for example model, system prompt, or tool toggles on create/resume calls)
config get / config set
operate on the raw head doc (a read/write split), so an inherited entry is
read through composition but never flattened into the child’s own doc on write.
Environment variables still matter, but they are primarily part of runtime credential resolution, not a general config layer that mutates the loaded realm config. In practice:
- realm config remains the canonical persisted settings surface
- provider credentials can still come from
RKAT_*or provider-native env vars at resolve time - bindings and auth profiles decide how those credentials are used at runtime
Config APIs and CAS
RPC, REST, and MCP all expose the same config envelope:configgenerationrealm_idinstance_idbackend
resolved_paths in diagnostic/admin contexts. Treat that field as optional rather than universal across all public config envelopes.
Writes support optimistic concurrency:
config/setandconfig/patchaccept optionalexpected_generation- stale writes return generation conflict
Merge semantics
Meerkat uses three update models:- Layered config loading (
defaults -> file -> runtime) uses field-wise merge:
- scalar/option values: last non-default wins
- section values (for example
store,comms,compaction): replace whole section - hook entries: append/extend
- Realm-chain composition folds each realm doc parent-first with child-wins:
- per-provider model defaults: union, child-wins per provider (a child overrides its anthropic default while inheriting the parent’s openai default)
- MCP servers: map-key union, child-wins per name (add or override, never remove)
- hooks and skill sources: append parent-first (child cannot remove inherited entries)
- limits and other config sections: per-field child-wins (a child can tighten
max_sessionswhile inheriting other caps) - the binding/backend/auth maps are not merged across realms: each realm’s binding resolves its
backend_profile/auth_profileonly within its own section (the owning realm)
- Runtime patch APIs (
config/patch,PATCH /config) use RFC 7396 JSON merge-patch semantics.
config/set when replacing the whole config intentionally, and config/patch for surgical updates.
Presence-based override (Option fields)
Config.max_tokens and agent.max_tokens_per_turn are optional. None means
“inherit / use the template default” and is resolved at point-of-use
(resolved_max_tokens / resolved_max_tokens_per_turn). Because merge is
presence-based (an explicit value wins, regardless of whether it equals the
default), a child realm can override a non-default parent value back down to
the default - something a != default heuristic could not express.
CLI behavior
CLI config commands operate on the selected realm:--realm, CLI derives a stable workspace realm (ws-...) from the
current directory, or from --context-root when supplied.
What About ~/.rkat/config.toml And .rkat/config.toml?
~/.rkat/config.toml is the home-rooted config document for the reserved
global realm. rkat auth login writes the [realm.global] binding
section here; once configured, it is the implicit chain tail for workspace
realms.
The project-root .rkat/config.toml still exists for rkat init, legacy
single-file loading, and explicitly layered hook discovery. Do not confuse it
with the active non-global realm document at
<state-root>/<realm>/config.toml, which is the canonical raw head store used
by CLI/RPC/REST/MCP runtime composition.
Backend and storage settings
Session backend is pinned per realm inrealm_manifest.json (sqlite, jsonl, or memory).
--realm-backend only matters on first creation of a realm.
Compaction settings
Compaction runtime policy is configurable in realm config:session-compaction is enabled, AgentFactory maps these values into
the runtime CompactionConfig. If auto_compact_threshold is omitted,
cataloged models scale the token trigger to 80 percent of their context window.
Built-in provider clients also attach the current provider’s approximate
request-byte cap to each lowered request; the byte trigger fires at 80 percent
of that cap. max_request_bytes is an optional operator override, especially
useful for a self-hosted gateway whose limit is not in the catalog.
Compaction is checked against both token and serialized-request pressure.
Inline media can exhaust a provider byte limit long before the token estimate
reaches its threshold.
Retry and stream watchdog settings
LLM retry policy (RetryPolicy) is configurable in realm config:
call_timeout is a tri-state override for the hard per-LLM-call deadline:
omitted inherits the profile-derived default, "disabled" turns it off, and
a duration sets it explicitly.
stream_inactivity_timeout is the per-provider-stream inactivity
watchdog. It is on by default with a 300-second window: an LLM call
whose stream reports no events for the window is aborted with the retryable
StreamStalled failure and flows through normal retry handling. Each received stream
event re-arms the window, so long-but-alive responses are unaffected. Set
stream_inactivity_timeout = "disabled" to opt out, or a duration
("120s") for an explicit window. Unlike call_timeout it never inherits
from the model profile; omitted means the built-in 300s default. The
watchdog covers all built-in provider clients; a custom AgentLlmClient
that does not report stream liveness fails open (no watchdog; only the
hard call timeout applies).
Unknown provider failures also enter the machine-authorized bounded retry path.
Explicit terminal classes such as invalid requests, authentication failures,
missing models, content filtering, context overflow, and oversized requests
remain non-retryable. With the default max_retries = 3, a persistently
unknown failure can make four provider attempts before returning
retry_exhausted.
Turn and agent-lifetime bounds
The timeouts above bound one segment of a turn: a single LLM call, a single provider stream, a single tool call. Their sum is a separate fact with a separate owner:max_turn_duration is the aggregate bound. Its clock is re-armed at every run
entry, so it measures one turn end-to-end no matter how many LLM calls,
retries, and tool batches that turn contains. Exceeding it takes the existing
time terminal, TurnTerminalOutcome::TimeBudgetExceeded, which surfaces as
AgentError::TerminalFailure { outcome: TimeBudgetExceeded, .. }. Note the
asymmetry with the other budget dimensions, which is deliberate: an exhausted
token or tool-call budget is an orderly stop that still answers the caller,
while an exhausted deadline is a hard failure. A turn past its deadline can no
longer promise what it did or when it will answer, so it fails closed rather
than reporting a warning and continuing.
max_duration is not a per-turn deadline. Its clock starts when the
session’s agent is built and is never re-armed, so it measures the agent’s
whole lifetime including idle time between turns. Setting it low to bound a
turn will terminalize a later turn that did no work.
Both are unset by default: turns are unbounded in aggregate unless a
deployment declares a ceiling. The bound is enforced at segment boundaries, so
it never tears down a tool call that is already running; the effective ceiling
is max_turn_duration plus the longest segment already in flight (at most one
per-tool-call timeout, since calls in a batch run their clocks together).
limits.max_sessions controls active-session admission; persisted history
does not consume the limit. RPC, REST, and MCP snapshot this value when their
session service builds its admission semaphore. Changing config does not resize
an already-running service; rebuild or restart it to apply the new limit.
HTML Presentation Defaults
HTML rendering is surface-requested; config chooses the default template and optional custom templates:--browser or the corresponding presentation mode.
Model fallback settings
The model fallback chain is realm-scoped configuration. Emptychain means
“use the catalog default chain”; a non-empty chain is an explicit ordered
operator policy:
auth_binding. This means an explicit custom chain can retry the same
model/provider through a different credential binding. Catalog-default chains
stay inside the selected non-env auth realm and skip providers that are not
registered there.
Use enabled = false to disable runtime model failover. If a lower-precedence
layer disabled fallback or supplied a custom chain, set
use_catalog_default_chain = true in a higher-precedence layer to restore the
built-in catalog chain.
Fallback activation is still runtime-governed: the generated recovery
authority must classify the LLM failure as recoverable, and the core run loop
must decide the retry is pre-stream safe. Network/call timeouts never trigger
model fallback, and cross-model fallback is suppressed after user-visible text
or reasoning stream output has been emitted. On activation, Meerkat recomputes
the active model’s tool capability filter and token limits before retrying.
