SubGrapher: Visual Fingerprinting of Chemical Structures

Automatic extraction of chemical structures from scientific literature plays a crucial role in accelerating research across fields ranging from drug discovery to materials science. Patent documents, in particular, contain molecular information in visual form, which is often inaccessible through traditional text-based searches. In this work, we introduce SubGrapher, a method for the visual fingerprinting of chemical structure images. Unlike conventional Optical Chemical Structure Recognition (OCSR) models that attempt to reconstruct full molecular graphs, SubGrapher focuses on extracting molecular fingerprints directly from chemical structure images. Using learning-based instance segmentation, SubGrapher identifies functional groups and carbon backbones, constructing a substructure-based fingerprint that enables chemical structure retrieval. Our approach is evaluated against state-of-the-art OCSR and fingerprinting methods, demonstrating superior retrieval performance and robustness across diverse molecular depictions. The dataset, models, and code will be made publicly available.

@article{morin2025_2504.19695,
  title={ SubGrapher: Visual Fingerprinting of Chemical Structures },
  author={ Lucas Morin and Gerhard Ingmar Meijer and Valéry Weber and Luc Van Gool and Peter W. J. Staar },
  journal={arXiv preprint arXiv:2504.19695},
  year={ 2025 }
}