{"id":36529,"date":"2026-06-08T13:16:27","date_gmt":"2026-06-08T13:16:27","guid":{"rendered":"https:\/\/lamarr-institute.org\/publication\/amortized-in-context-mixed-effect-transformer-models-a-zero-shot-approach-for-pharmacokinetics\/"},"modified":"2026-09-17T11:18:14","modified_gmt":"2026-09-17T11:18:14","slug":"amortized-in-context-mixed-effect-transformer-models-a-zero-shot-approach-for-pharmacokinetics","status":"publish","type":"publication","link":"https:\/\/lamarr-institute.org\/de\/publication\/amortized-in-context-mixed-effect-transformer-models-a-zero-shot-approach-for-pharmacokinetics\/","title":{"rendered":"Amortized In-Context Mixed Effect Transformer Models: A Zero-Shot Approach for Pharmacokinetics"},"content":{"rendered":"<p>Accurate dose-response forecasting under sparse sampling is central to precision pharmacotherapy. We present the Amortized In-Context Mixed-Effect Transformer (AICMET) model, a transformer\u2011based, latent\u2011variable framework that unifies mechanistic compartmental priors with amortized, in\u2011context Bayesian inference. AICMET is pre\u2011trained on hundreds of thousands of synthetic pharmacokinetic trajectories with Ornstein-Uhlenbeck priors over the parameters of compartment models, endowing the model with strong inductive biases and enabling zero\u2011shot adaptation to new compounds. At inference time, AICMET is conditioned on the collective context of previously profiled trial participants, generating calibrated posterior predictions for newly enrolled patients after a few early drug concentration measurements. This capability collapses traditional model development cycles from weeks to seconds, while preserving some degree of expert modelling. Experiments across public datasets show that AICMET attains state\u2011of\u2011the\u2011art predictive accuracy, and faithfully quantifies inter\u2011patient variability &#8211; outperforming both nonlinear mixed\u2011effects baselines and recent neural ODE variants. Our code repository, pretrained model and tutorials are available online.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Accurate dose-response forecasting under sparse sampling is central to precision pharmacotherapy. We present the Amortized In-Context Mixed-Effect Transformer (AICMET) model, a transformer\u2011based, latent\u2011variable framework that unifies mechanistic compartmental priors with amortized, in\u2011context Bayesian inference. AICMET is pre\u2011trained on hundreds of thousands of synthetic pharmacokinetic trajectories with Ornstein-Uhlenbeck priors over the parameters of compartment models, endowing the model with strong inductive biases and enabling zero\u2011shot adaptation to new compounds. At inference [&hellip;]<\/p>\n","protected":false},"author":14,"featured_media":0,"template":"","meta":{"_acf_changed":false,"footnotes":""},"publication-type":[32],"class_list":["post-36529","publication","type-publication","status-publish","hentry","publication-type-inproceedings"],"acf":[],"publishpress_future_workflow_manual_trigger":{"enabledWorkflows":[]},"_links":{"self":[{"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication\/36529","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication"}],"about":[{"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/types\/publication"}],"author":[{"embeddable":true,"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/users\/14"}],"version-history":[{"count":0,"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication\/36529\/revisions"}],"wp:attachment":[{"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/media?parent=36529"}],"wp:term":[{"taxonomy":"publication-type","embeddable":true,"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication-type?post=36529"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}