Similarity Patient Retrieval of Multimodal Clinical Data Based on Deep Hashing
Author:
  • Article
  • | |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • | |
  • Comments
    Abstract:

    With the widespread adoption of electronic health record (EHR), retrieving similar cases has become a critical task in supporting clinical decision-making, such as in auxiliary diagnosis and treatment planning. However, EHR data is characterized by high dimensionality, heterogeneity, and large volume. To effectively integrate multimodal clinical data and achieve efficient retrieval, this study proposes a multimodal clinical data retrieval model for similar cases based on deep hashing—MCDF. This model employs different methods for feature extraction tailored to the characteristics of various modalities, utilizing multi-layer perceptron (MLP) for structured text data, BioBERT for unstructured text data, and BioMedCLIP for image data, followed by feature fusion through a self-attention mechanism. A triplet loss function guides the model to directly generate hash codes that effectively represent the samples, enabling rapid comparisons for sample retrieval. This not only enhances retrieval accuracy but also significantly improves efficiency. Using the publicly available MIMIC-III dataset, the MCDF model is evaluated against traditional hashing methods (such as spectral hashing) and advanced hashing methods (such as deep hashing network) using mean normalized discounted cumulative gain (MNDCG) and mean average precision (MAP) metrics for evaluation. Experimental results demonstrate that the MCDF model outperforms all baseline models, validating the superiority of the proposed approach.

    Reference
    Related
    Cited by
Get Citation

谢明朗,袁贞明,施军平,田昕.基于深度哈希的多模态临床数据相似病例检索.计算机系统应用,,():1-12

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:September 27,2024
  • Revised:October 23,2024
  • Online: March 31,2025
Article QR Code
You are the firstVisitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-3
Address:4# South Fourth Street, Zhongguancun,Haidian, Beijing,Postal Code:100190
Phone:010-62661041 Fax: Email:csa (a) iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063