|国家预印本平台
首页|Masked Omics Modeling for Multimodal Representation Learning across Histopathology and Molecular Profiles

Masked Omics Modeling for Multimodal Representation Learning across Histopathology and Molecular Profiles

Masked Omics Modeling for Multimodal Representation Learning across Histopathology and Molecular Profiles

来源:Arxiv_logoArxiv
英文摘要

Self-supervised learning has driven major advances in computational pathology by enabling models to learn rich representations from hematoxylin and eosin (H&E)-stained cancer tissue. However, histopathology alone often falls short for molecular characterization and understanding clinical outcomes, as important information is contained in high-dimensional omics profiles like transcriptomics, methylomics, or genomics. In this work, we introduce MORPHEUS, a unified transformer-based pre-training framework that encodes both histopathology and multi-omics data into a shared latent space. At its core, MORPHEUS relies on a masked modeling objective applied to randomly selected omics portions, encouraging the model to learn biologically meaningful cross-modal relationships. The same pre-trained network can be applied to histopathology alone or in combination with any subset of omics modalities, seamlessly adapting to the available inputs. Additionally, MORPHEUS enables any-to-any omics generation, enabling one or more omics profiles to be inferred from any subset of modalities, including H&E alone. Pre-trained on a large pan-cancer cohort, MORPHEUS consistently outperforms state-of-the-art methods across diverse modality combinations and tasks, positioning itself as a promising framework for developing multimodal foundation models in oncology. The code is available at: https://github.com/Lucas-rbnt/MORPHEUS

Lucas Robinet、Ahmad Berjaoui、Elizabeth Cohen-Jonathan Moyal

肿瘤学生物科学研究方法、生物科学研究技术医学研究方法

Lucas Robinet,Ahmad Berjaoui,Elizabeth Cohen-Jonathan Moyal.Masked Omics Modeling for Multimodal Representation Learning across Histopathology and Molecular Profiles[EB/OL].(2025-08-01)[2025-08-19].https://arxiv.org/abs/2508.00969.点此复制

评论