123AIChat logo123AIChat

Architecture

Engineered for high-trust internal collaboration.

The stack prioritizes local reliability: concurrent WebSocket handling, persistent event flow, and AI orchestration that never blocks base communication.

Runtime Layer

Rust + Axum + Tokio powers concurrent connections and isolates WebSocket task failures from core messaging operations.

Data Layer

SurrealDB (embedded RocksDB) stores user, channel, and message data with support for semantic vectors and full-text retrieval.

AI Layer

Ollama-backed inference with semaphore-protected queueing keeps local model execution stable across multiple agents.

Delivery Layer

Single-binary distribution embeds frontend assets, simplifying internal rollout for desktop and browser clients.