IDiom模型实现无序蛋白质区域生成
Generative modeling of intrinsically disordered protein regions by reinforcing sparse autoencoder features
斯坦福团队推出IDiom模型,用强化学习精确控制蛋白质功能特征,在8项设计任务中表现优异。
研究人员发布IDiom模型,基于5400万个AlphaFold预测的无序蛋白质区域(IDR)数据集训练。该模型能生成多样化序列,重现天然IDR的组成、模式、基序和预测无序性。通过引入稀疏自编码器特征强化学习(RL-SAE),模型能激活90%的30个目标特征,比激活引导高出66个百分点。
Generative modeling of intrinsically disordered protein regions by reinforcing sparse autoencoder features
Intrinsically disordered protein regions (IDRs) play central roles in cellular processes such as transcriptional regulation, signal transduction, and subcellular localization, yet their functional design remains challenging. Structure-based design methods do not readily apply to IDRs, and existing protein language models are trained on full-length protein sequences, thus learning a prior that is biased towards folded domains. Here, we present IDiom, an autoregressive protein language model trained on IDiom-DB, a dataset of 54 million predicted IDRs curated from the AlphaFold Database. IDiom generates diverse sequences that recapitulate the composition, patterning, motifs, and predicted disorder of natural IDRs. To control function-associated sequence patterns, we also introduce reinforcement learning with sparse autoencoder features (RL-SAE), a post-training method that rewards the generation of sequences that activate specified feature sets. Across eight IDR design tasks, RL-SAE sequences activate, on average, 90% of 30 targeted features, compared to 24% for activation steering. We demonstrate that RL-SAE improves the predicted subcellular localization and transcriptional activity of generated IDRs compared to steering and supervised fine-tuning, and enables features associated with distinct biological functions to be combined within individual sequences. Thus, IDiom and RL-SAE enable interpretable and composable IDR design through explicit control of function-associated sequence features. More broadly, RL-SAE could extend to other protein design settings where interpretable features provide useful design targets. Code is available at https://github.com/rotskoff-group/idiom.