Efficient Continual Learning in Language Models via Thalamically Routed Cortical Columns
Paper
โข 2602.22479 โข Published
This repo hosts TRC2 checkpoint.
TRC2 is a decoder-only LM backbone designed for continual learning via sparse thalamic routing to cortical columns and fast corrective pathways. (See the paper for details.)
trc2-d720-l5.pt: weightsCode to be released near soon on GitHub.