olmo_tap.experiments.hydra_demo

HydraTransformer inference demo.

Loads OLMo2 7B instruct weights into a HydraTransformer and runs greedy generation with averaged head logits.

Usage:

pixi run python experiments/hydra_demo.py

Functions

main()

olmo_tap.experiments.hydra_demo.main()