olmo_tap.experiments.uncertaintyΒΆ

Modules

data

Data loading for uncertainty head supervised finetuning on MedMCQA.

engine

Uncertainty finetuning protocol.

single_head_eval

NOTE: this file is for testing the uncertainty head on a single LLM head.

training

HydraTransformer Double-Head Uncertainty Finetuning Pipeline.

weights_handler

Helper class to handle cycling through frozen LLM heads during uncertainty finetuning.