Database — SQLite Schema

General Information

• File: data/citadel.db
• Mode: WAL (Write-Ahead Logging) — concurrent reads
• Foreign keys: enabled
• Busy timeout: 5000ms
• Cache: 64MB
• Migrations: shared/migrations/001-044

ER Diagram (Phase 65)

erDiagram
    users ||--o{ projects : owns
    users ||--|| account_settings : has
    users ||--o{ recovery_keys : holds
    users ||--o{ subscriptions : pays
    users ||--o{ invites : creates
    users ||--o{ chat_messages : sends
    users ||--o{ trial_credits : claims
    users ||--o{ activity_log : generates

    projects ||--o{ project_phases : tracks
    projects ||--o{ pinned_notes : pins
    projects ||--o{ chat_messages : contains
    projects ||--o{ timeline_events : records
    projects ||--o{ github_links : links
    projects ||--o{ skill_benchmarks : runs
    projects ||--o{ marketplace_cache : caches

    github_links ||--o{ github_events : receives

    invites }o--|| users : "consumed by"
    subscriptions ||--o{ stripe_events : "logs idempotency"

    users {
        TEXT id PK
        TEXT email UK
        TEXT password_hash
        TEXT role "admin · user"
        TEXT google_id UK
        TEXT github_id UK
        INTEGER email_verified
        INTEGER two_factor_enabled
        TEXT last_login
    }

    projects {
        INTEGER id PK
        TEXT technical_name
        TEXT owner_id FK
        TEXT display_name
        INTEGER is_archived
        TEXT model_mode "strict|optimize (#520, migration 060)"
    }

    chat_messages {
        INTEGER id PK
        TEXT project_name
        TEXT worker_id
        TEXT role "user · assistant · system"
        TEXT content "AES-256-GCM if encrypted=1"
        INTEGER encrypted
        TEXT timestamp
    }

    subscriptions {
        TEXT user_id PK
        TEXT plan "free · min · max · beta"
        TEXT stripe_customer_id
        TEXT status
    }

    invites {
        TEXT code PK "arc-XXXX-XXXX"
        TEXT created_by FK
        TEXT used_by FK
        TEXT parent_invite_code
        TEXT status "active · used · revoked"
    }

    recovery_keys {
        INTEGER id PK
        TEXT user_id FK
        TEXT encrypted_key
        TEXT key_hint "first 4 chars"
    }

    trial_credits {
        TEXT email PK
        INTEGER credits_used
        TEXT first_used_at
    }

30+ tables across 35 migrations. Auth + projects + workspace data + intelligence + billing + beta gating + context-export audit. All FK constraints enforced.

Tables

users — Users

projects — Projects

UNIQUE(technical_name, owner_id)

account_settings — Account settings

chat_messages — Chat history

INDEX(project_name, worker_id, timestamp DESC)

recovery_keys — Recovery keys (Phase 45.4)

INDEX(user_id)

github_links — GitHub repo bindings (Phase 49.3)

UNIQUE(project_name, owner, repo) — multi-repo per project allowed. INDEX(project_name), INDEX(webhook_secret)

github_events — GitHub event log (Phase 49.3.1)

INDEX(project_name, created_at DESC), INDEX(link_id)

skills_global — Global skills

skills_project_forks — Skill forks

UNIQUE(project_name, skill_id)

skill_evolution_logs — Skill change history

skill_update_requests — Skill PRs (Sage)

skill_benchmarks — Skill A/B tests

pinned_notes — Pinned notes

project_phases — Roadmap phases

UNIQUE(project_name, phase_id)

activity_log — Activity log

INDEX(created_at DESC), INDEX(project_name, created_at DESC), INDEX(event_type, created_at DESC), INDEX(actor, created_at DESC)

system_configs — System settings

marketplace_analysis_cache — Marketplace cache

Cache of skill compatibility analysis from the marketplace.

ephemeral_tokens — Short-lived tokens (issue #27)

Persistent store for one-time tokens: OAuth state, password reset, email verification. Before migration 022 these tokens lived in an in-memory Map and were lost on every master restart, breaking Google/GitHub login (invalid_state).

INDEX(type), INDEX(expires_at). One-time use: consume() reads the payload and deletes the row in a single transaction.

project_issues — Issues per project (issue #53, Phase 53.14)

SQLite SSOT for issues, replacing per-project issues/issues.json. The file remains on disk as a derived export (mirror), gitignored — the DB is authoritative.

PK (project_name, id) — each project has its own independent id space. INDEX (project_name, status) — the most frequent filter (open only). Operations live in issueQueries (shared/db.ts): list/get/nextId/insert/upsert/replaceAll/bulkImport. replaceAll — atomic transaction; bulkImport — INSERT OR IGNORE for idempotent re-seed.

Migration 036 (#187, 2026-05-23): ALTER TABLE project_issues ADD COLUMN assignee TEXT. New statuses (in_progress, blocked, deferred) are validated at the application level (IssueStatus union in shared/db.ts), not via a CHECK constraint (SQLite does not allow adding constraints through ALTER TABLE).

Migration 046 (#327, 2026-06-03): ALTER TABLE project_issues ADD COLUMN created_by TEXT NOT NULL DEFAULT 'legacy'. The lifecycle is extended with a new draft status. handleCreateIssue forces status='draft' when assignee=null (otherwise immediately 'open'), and requires worker_id (body or auth fallback). handleUpdateIssue auto-promotes draft → open on first assignee assignment and rejects close for a never-assigned issue (FR-ISS-101/102/103). Pre-existing rows are backfilled via DEFAULT as 'legacy'.

onboarding_progress — Post-wizard checklist state (issue #56, Phase 54.1)

Per-user derived cache over the activity_log event stream (SSOT). The UI reads it with a single query instead of aggregating over events. Replayable: dismiss/replay do not change state, only dismissed_at.

INDEX on completed_at for funnel analytics (#61 Phase 54.6). Operations live in onboardingQueries (shared/db.ts): getProgress/recordEvent/dismiss/replay. recordEvent is idempotent on (chat_id, step, status) — a repeated identical call returns changed=false and does not write to activity_log. Whitelist: 5 steps × 2 statuses (completed, skipped). skipped does NOT increment completed_count. The skipped → completed transition adds to the count. All mutations emit events into activity_log with event_type LIKE 'onboarding_%' — the true SSOT for funnel metrics; the table columns are a derived cache.

platform_audit_log — Super-admin secret rotation trail (Phase 57, Sentinel #103)

Append-only log of mutations on vault platform-secrets via the Platform Settings UI. SSOT for post-incident forensics ("which admin rotated the Anthropic key at 03:14 UTC?"). Vault.json itself does not record this — value-only.

INDEXES: idx_platform_audit_ts (recent across keys), idx_platform_audit_user (per-admin trail), idx_platform_audit_key (rotation history per key). Append-only invariant: no UPDATE/DELETE handlers; UI exposes read-only recent() + lastRotated() via platformAuditQueries in shared/db.ts. Every action (success+fail) writes a row.

auth_events — End-user authentication event log (Migration 027, issue #130)

Append-only log of auth events for security auditing and incident investigation. Separate from platform_audit_log (admin-only vault) — this table covers the end-user auth flow with IP.

INDEXES: idx_auth_events_ts (newest first), idx_auth_events_user (per-user history), idx_auth_events_ip (per-IP threat detection), idx_auth_events_event (event+result filter). authEventQueries.insert/recent in shared/db.ts. Logged in master-bot/routes/auth.ts (register/login/oauth/magic-link) and master-bot/routes/cli.ts (device_code_approve).

Migrations

Relationships (Foreign Keys)

• skills_project_forks.skill_id → skills_global.id (CASCADE DELETE)
• skill_evolution_logs.skill_id → skills_global.id (CASCADE DELETE)
• skill_update_requests.skill_id → skills_global.id (CASCADE DELETE)
• skill_benchmarks.request_id → skill_update_requests.id (CASCADE DELETE)

All CASCADE — deleting a skill removes all of its forks, history, PRs and benchmarks.

ER diagram (textual)

users ─1:N──> projects
            ├── chat_messages
            ├── pinned_notes
            ├── project_phases
            └── skills_project_forks ──> skills_global
                                          ├── skill_evolution_logs
                                          ├── skill_update_requests
                                          │    └── skill_benchmarks
                                          └── (standalone tables)
                                               ├── activity_log
                                               ├── system_configs
                                               └── marketplace_analysis_cache

| 029 | cloud_waitlist | Phase 60 #134 | cloud_waitlist (id INT PK AUTOINCREMENT, user_id TEXT UNIQUE, email, position INT, status (waiting|invited|activated|declined), notes, joined_at, invited_at, activated_at) — Early Access waitlist for Standard Cloud. cloudWaitlistQueries.join/findByUser/list/invite/activate/decline/stats in shared/db.ts. Endpoints: POST /api/crm/cloud/waitlist (join), GET /waitlist/status (user own), GET /waitlist (admin list), POST /waitlist/invite (admin activate + upgrades plan to cloud) | | 030 | translation_feedback | Phase 59.4 #122 | translation_feedback (id INT PK AUTOINCREMENT, locale TEXT, message_id TEXT, original TEXT, current_translation TEXT, suggestion TEXT, user_id TEXT, status (pending|accepted|rejected), created_at, reviewed_at) — Per-locale translation quality feedback. Admin review dashboard at /api/crm/translations/feedback (list/stats/accept/reject). | | 031 | token_usage_log | Phase 63 #148 | token_usage_log (id INT PK AUTOINCREMENT, project_name TEXT NOT NULL, owner_id TEXT NOT NULL, worker_id TEXT, input_tokens INT DEFAULT 0, output_tokens INT DEFAULT 0, cache_tokens INT DEFAULT 0, total_tokens INT DEFAULT 0, created_at INT DEFAULT (unixepoch())) — Per-request Claude token usage log. 3 indexes: owner_id, project_name, created_at. Populated by child-bot/claude-runner.ts via POST /api/internal/usage/log (fire-and-forget). Queried by GET /api/crm/account/usage → returns { rows: [...last 200], totals: { total, input, output } } for BillingPage + UserDropdown usage card. | | 032 | arc_help_usage | Phase 61 #147 | arc_help_usage (id INT PK AUTOINCREMENT, user_id TEXT NOT NULL, date TEXT NOT NULL (YYYY-MM-DD), count INT NOT NULL DEFAULT 0, PRIMARY KEY (user_id, date)) — Daily rate-limit counter for in-app AI Help chat (30 messages/day). Queried by GET /api/crm/help/usage; updated on POST /api/crm/help/chat. | | 033 | arc_help_messages | Phase 61 #153 | arc_help_messages (id INT PK AUTOINCREMENT, user_id TEXT NOT NULL, role TEXT NOT NULL CHECK(user|assistant), text TEXT NOT NULL, sources TEXT (JSON array, nullable), created_at TEXT DEFAULT datetime('now')) — Persistent Arc Help chat history per user. INDEX on (user_id, created_at DESC). arcHelpQueries.save/history(limit=60)/clearHistory in shared/db.ts. GET /api/crm/help/history returns last 60 messages (oldest-first). DELETE /api/crm/help/history clears all for user. Frontend loads on mount. | | 034 | skills_owner_project | #157 | ALTER TABLE skills_global ADD COLUMN owner_project TEXT DEFAULT NULL — NULL=global/marketplace (visible to all), non-null=owned by that project (filtered in listForProject). Backfill: skills with non-generic category (odoo, python, etc.) get owner_project=category. Generic categories: general/frontend/backend/devops/security/testing/database/api/mobile. DB skills now injected into Claude prompts via routeContextFromDb() in child-bot (#158). |

Migration 064 — token_usage_log.model (#562 S5)

Nullable model TEXT column on token_usage_log: which Claude model served the usage row (threaded from claude-runner through POST /api/internal/usage/log). Powers the per-tier token split in GET /api/crm/analytics/cascade so the spec-gated cascade's cost effect is measurable. Legacy rows stay NULL (unattributed).