{"id":35181,"date":"2026-04-13T14:10:57","date_gmt":"2026-04-13T14:10:57","guid":{"rendered":"https:\/\/lamarr-institute.org\/publication\/redsage-a-cybersecurity-generalist-llm\/"},"modified":"2026-09-17T11:21:18","modified_gmt":"2026-09-17T11:21:18","slug":"redsage-a-cybersecurity-generalist-llm","status":"publish","type":"publication","link":"https:\/\/lamarr-institute.org\/de\/publication\/redsage-a-cybersecurity-generalist-llm\/","title":{"rendered":"{RedSage}: A Cybersecurity Generalist {LLM}"},"content":{"rendered":"<p>Cybersecurity operations demand assistant {LLMs} that support diverse workflows without exposing sensitive data. Existing solutions either rely on proprietary {APIs} with privacy risks or on open models lacking domain adaptation. To bridge this gap, we curate 11.8B tokens of cybersecurity-focused continual pretraining data via large-scale web filtering and manual collection of high-quality resources, spanning 28.6K documents across frameworks, offensive techniques, and security tools. Building on this, we design an agentic augmentation pipeline that simulates expert workflows to generate 266K multi-turn cybersecurity samples for supervised fine-tuning. Combined with general open-source {LLM} data, these resources enable the training of {RedSage}, an open-source, locally deployable cybersecurity assistant with domain-aware pretraining and post-training. To rigorously evaluate the models, we introduce {RedSage}-Bench, a benchmark with 30K multiple-choice and 240 open-ended Q{\\textbackslash}\\&#038;A items covering cybersecurity knowledge, skills, and tool expertise. {RedSage} is further evaluated on established cybersecurity benchmarks (e.g., {CTI}-Bench, {CyberMetric}, {SECURE}) and general {LLM} benchmarks to assess broader generalization. At the 8B scale, {RedSage} achieves consistently better results, surpassing the baseline models by up to +5.59 points on cybersecurity benchmarks and +5.05 points on Open {LLM} Leaderboard tasks. These findings demonstrate that domain-aware agentic augmentation and pre\/post-training can not only enhance cybersecurity-specific expertise but also help to improve general reasoning and instruction-following. Project page: https:\/\/risys-lab.github.io\/{RedSage}\/<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Cybersecurity operations demand assistant {LLMs} that support diverse workflows without exposing sensitive data. Existing solutions either rely on proprietary {APIs} with privacy risks or on open models lacking domain adaptation. To bridge this gap, we curate 11.8B tokens of cybersecurity-focused continual pretraining data via large-scale web filtering and manual collection of high-quality resources, spanning 28.6K documents across frameworks, offensive techniques, and security tools. Building on this, we design an agentic [&hellip;]<\/p>\n","protected":false},"author":14,"featured_media":0,"template":"","meta":{"_acf_changed":false,"footnotes":""},"publication-type":[32],"class_list":["post-35181","publication","type-publication","status-publish","hentry","publication-type-inproceedings"],"acf":[],"publishpress_future_workflow_manual_trigger":{"enabledWorkflows":[]},"_links":{"self":[{"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication\/35181","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication"}],"about":[{"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/types\/publication"}],"author":[{"embeddable":true,"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/users\/14"}],"version-history":[{"count":0,"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication\/35181\/revisions"}],"wp:attachment":[{"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/media?parent=35181"}],"wp:term":[{"taxonomy":"publication-type","embeddable":true,"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication-type?post=35181"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}