{"entity":{"id":"mixed-precision-gpu","kind":"term","name":"GPU training and mixed precision","aka":["mixed precision","mixed-precision training","bfloat16","fp16 training","GPU training","A100","H100","CUDA","MPS backend","Apple silicon MPS"],"tldr":"Foundation models are trained on graphics processors, and mixed precision stores most numbers in 16-bit floats to halve memory and double speed; a laptop-class chip can fine-tune small models but pretraining at scale waits for a data-centre GPU.","summary":"Mixed-precision arithmetic uses floating-point numbers of different widths in a single computation (Wikipedia); deep learning stacks many layers of artificial neurons and trains them on large data, which drives its hardware demand (Wikipedia). NVIDIA A100 and H100 cards through CUDA are the standard training hardware, Apple's Metal backend (MPS) runs smaller jobs on laptops, and a fine-tuning harness written on one and awaiting the other is a normal state for an academic project.","asOf":"2026-09-24","wikipedia":"https://en.wikipedia.org/wiki/Mixed-precision_arithmetic","links":[{"label":"Wikipedia: deep learning","url":"https://en.wikipedia.org/wiki/Deep_learning"},{"label":"Wikipedia","url":"https://en.wikipedia.org/wiki/Mixed-precision_arithmetic"}],"tags":["cansim-terms"],"related":["cancer-ai-vocabulary"],"cancers":[],"sections":[],"technologies":["ai-compute-platforms"],"targets":[],"drugs":[],"companies":[],"institutions":[],"pathways":[],"terms":["foundation-model","fine-tuning-vs-frozen"],"trials":[],"people":[],"bottlenecks":[],"keyPapers":[],"journals":[],"dependsOn":[],"notes":["Listed in the CanSim terms map 1.0.0 (docs/onco/terms.json, generated 2026-09-24), CC BY 4.0, attribution: CanSim project, an open, public-data-first cancer foundation-model programme; CanSim page path /terms/mixed-precision-gpu."],"provenance":{"editedBy":"OnCo CanSim terms wave (Wikipedia summaries, standards and project pages, GDC and FDA pages, Europe PMC)","editedOn":"2026-09-24","note":"CanSim terms map 1.0.0 (docs/onco/terms.json, generated 2026-09-24), CC BY 4.0, attribution: CanSim project, an open, public-data-first cancer foundation-model programme"},"category":"Methods and models"},"route":"/terms/mixed-precision-gpu/","neighbours":{"term":[{"id":"cancer-ai-vocabulary","kind":"term","name":"Cancer AI vocabulary (CanSim terms map)","route":"/terms/cancer-ai-vocabulary/"},{"id":"fine-tuning-vs-frozen","kind":"term","name":"Fine-tuning versus frozen features, and LoRA","route":"/terms/fine-tuning-vs-frozen/"},{"id":"foundation-model","kind":"term","name":"Foundation model","route":"/terms/foundation-model/"}],"technology":[{"id":"ai-compute-platforms","kind":"technology","name":"AI compute and model platforms for oncology","route":"/technologies/ai-compute-platforms/"}]}}