{"entity":{"id":"autoregressive-modelling","kind":"term","name":"Autoregressive (next-token) modelling","aka":["autoregressive modelling","autoregressive model","next-token prediction","next token prediction","causal language modelling","generative pretraining"],"tldr":"An autoregressive model predicts the next element of a sequence from the ones before it; trained on DNA it learns to continue a genome, which is how Evo 2 was built.","summary":"An autoregressive model expresses each output as a function of its own previous values (Wikipedia); large language models are trained this way on text to generate the next token (Wikipedia on LLMs). Genomic models such as Evo 2 and the Nucleotide Transformer apply it to nucleotide sequence at up to a million bases of context, and the likelihood the model assigns to a variant sequence is used as a zero-shot pathogenicity score. Generation and scoring are different uses, and success at one does not imply the other.","asOf":"2026-09-24","wikipedia":"https://en.wikipedia.org/wiki/Autoregressive_model","links":[{"label":"Wikipedia: large language model","url":"https://en.wikipedia.org/wiki/Large_language_model"},{"label":"Wikipedia","url":"https://en.wikipedia.org/wiki/Autoregressive_model"}],"tags":["cansim-terms"],"related":["cancer-ai-vocabulary"],"cancers":[],"sections":[],"technologies":["nucleotide-transformer","evo2"],"targets":[],"drugs":[],"companies":[],"institutions":[],"pathways":[],"terms":["transformer-architecture","zero-shot","variant-effect-prediction"],"trials":[],"people":[],"bottlenecks":[],"keyPapers":[],"journals":[],"dependsOn":[],"notes":["Listed in the CanSim terms map 1.0.0 (docs/onco/terms.json, generated 2026-09-24), CC BY 4.0, attribution: CanSim project, an open, public-data-first cancer foundation-model programme; CanSim page path /terms/autoregressive-modelling."],"provenance":{"editedBy":"OnCo CanSim terms wave (Wikipedia summaries, standards and project pages, GDC and FDA pages, Europe PMC)","editedOn":"2026-09-24","note":"CanSim terms map 1.0.0 (docs/onco/terms.json, generated 2026-09-24), CC BY 4.0, attribution: CanSim project, an open, public-data-first cancer foundation-model programme"},"category":"Methods and models"},"route":"/terms/autoregressive-modelling/","neighbours":{"term":[{"id":"cancer-ai-vocabulary","kind":"term","name":"Cancer AI vocabulary (CanSim terms map)","route":"/terms/cancer-ai-vocabulary/"},{"id":"genomic-and-protein-language-models","kind":"term","name":"Genomic and protein language models: Evo 2, Enformer, ESM","route":"/terms/genomic-and-protein-language-models/"},{"id":"transformer-architecture","kind":"term","name":"Transformer and attention","route":"/terms/transformer-architecture/"},{"id":"variant-effect-prediction","kind":"term","name":"Variant effect prediction","route":"/terms/variant-effect-prediction/"},{"id":"zero-shot","kind":"term","name":"Zero-shot prediction","route":"/terms/zero-shot/"}],"technology":[{"id":"evo2","kind":"technology","name":"Evo 2 (Arc Institute, NVIDIA)","route":"/technologies/evo2/"},{"id":"nucleotide-transformer","kind":"technology","name":"Nucleotide Transformer (InstaDeep)","route":"/technologies/nucleotide-transformer/"}]}}