Getting started

TAP is an end-to-end system that pairs each LLM response with three trust signals (calibrated uncertainty, security, robustness), reported at response level and at finer granularities inside the UI. The hosted demo at tap-al9.pages.dev needs no install.

Repository layout

  • olmo_tap/ — the OhLMo Hydra model, PoE Speculative Verification inference, post-training pipelines for each trust signal, attack bank, benchmarks.

  • kernel_entropy/ — Kernel Language Entropy pipeline and ModernBERT NLI scorer for free-text uncertainty.

  • app/backend/ — FastAPI server, claim decomposition, robustness probe, response payloads.

  • app/frontend/ — React and Vite chat UI with the trust panels.

  • tests/, docs/, examples/.

Local install

The full quick-start (prerequisites, environment, weights download, running the backend and frontend) lives in the project README. At a minimum you will need pixi, a CUDA 12.4 NVIDIA GPU, a Hugging Face token, and Git LFS.

Where to go next