{"id":44043,"date":"2026-11-13T11:03:09","date_gmt":"2026-11-13T11:03:09","guid":{"rendered":"https:\/\/lamarr-institute.org\/publication\/behaviorformer-discovering-behavioral-patterns-via-clusterable-next-token-prediction\/"},"modified":"2026-11-13T11:03:09","modified_gmt":"2026-11-13T11:03:09","slug":"behaviorformer-discovering-behavioral-patterns-via-clusterable-next-token-prediction","status":"publish","type":"publication","link":"https:\/\/lamarr-institute.org\/de\/publication\/behaviorformer-discovering-behavioral-patterns-via-clusterable-next-token-prediction\/","title":{"rendered":"{BehaviorFormer}: Discovering Behavioral Patterns via Clusterable Next-Token Prediction"},"content":{"rendered":"<p>Discovering behavioral patterns in open-ended games is challenging due to the lack of clear objectives or ground-truth annotations. In this work, we extend a next-token prediction Transformer with the deep clustering algorithm DCSS to learn meaningful representations with well-separated clusters. In a controlled Minecraft session with 26 players, the method discovers 23 distinct behavioral patterns that generalize across the studied players, further refining structures present in self-supervised representations into clearly separable clusters. We group the clusters into seven interpretable categories covering stationary, roaming, travel, mining, base work, logging, and farming behavior.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Discovering behavioral patterns in open-ended games is challenging due to the lack of clear objectives or ground-truth annotations. In this work, we extend a next-token prediction Transformer with the deep clustering algorithm DCSS to learn meaningful representations with well-separated clusters. In a controlled Minecraft session with 26 players, the method discovers 23 distinct behavioral patterns that generalize across the studied players, further refining structures present in self-supervised representations into clearly [&hellip;]<\/p>\n","protected":false},"author":14,"featured_media":0,"template":"","meta":{"_acf_changed":false,"footnotes":""},"publication-type":[32],"publication-year":[1680],"class_list":["post-44043","publication","type-publication","status-publish","hentry","publication-type-inproceedings","publication-year-1680"],"acf":[],"publishpress_future_workflow_manual_trigger":{"enabledWorkflows":[]},"_links":{"self":[{"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication\/44043","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication"}],"about":[{"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/types\/publication"}],"author":[{"embeddable":true,"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/users\/14"}],"version-history":[{"count":0,"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication\/44043\/revisions"}],"wp:attachment":[{"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/media?parent=44043"}],"wp:term":[{"taxonomy":"publication-type","embeddable":true,"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication-type?post=44043"},{"taxonomy":"publication-year","embeddable":true,"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication-year?post=44043"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}