|国家预印本平台
首页|Command-V: Pasting LLM Behaviors via Activation Profiles

Command-V: Pasting LLM Behaviors via Activation Profiles

Command-V: Pasting LLM Behaviors via Activation Profiles

来源:Arxiv_logoArxiv
英文摘要

Retrofitting large language models (LLMs) with new behaviors typically requires full finetuning or distillation-costly steps that must be repeated for every architecture. In this work, we introduce Command-V, a backpropagation-free behavior transfer method that copies an existing residual activation adapter from a donor model and pastes its effect into a recipient model. Command-V profiles layer activations on a small prompt set, derives linear converters between corresponding layers, and applies the donor intervention in the recipient's activation space. This process does not require access to the original training data and needs minimal compute. In three case studies-safety-refusal enhancement, jailbreak facilitation, and automatic chain-of-thought reasoning--Command-V matches or exceeds the performance of direct finetuning while using orders of magnitude less compute. Our code and data are accessible at https://github.com/GithuBarry/Command-V/.

Barry Wang、Avi Schwarzschild、Alexander Robey、Ali Payani、Charles Fleming、Mingjie Sun、Daphne Ippolito

计算技术、计算机技术

Barry Wang,Avi Schwarzschild,Alexander Robey,Ali Payani,Charles Fleming,Mingjie Sun,Daphne Ippolito.Command-V: Pasting LLM Behaviors via Activation Profiles[EB/OL].(2025-06-23)[2025-07-09].https://arxiv.org/abs/2506.19140.点此复制

评论