MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extraction

30 September 2021

Papers citing "MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extraction"

24 / 24 papers shown

Title
34 Examples of LLM Applications in Materials Science and Chemistry: Towards Automation, Assistants, Agents, and Accelerated Scientific Discovery Yoel Zimmermann Adib Bazgir Alexander H Al-Feghali Mehrad Ansari L. C. Brinson ... Shang Zhu Jan Janssen Calvin Li Ian Foster Ben Blaiszik 93 1 0 05 May 2025
Impact and influence of modern AI in metadata management Wenli Yang Rui Fu M. B. Amin B. Kang 50 0 0 28 Jan 2025
ChemTEB: Chemical Text Embedding Benchmark, an Overview of Embedding Models Performance & Efficiency on a Specific Domain Ali Shiraee Kasmaee Mohammad Khodadad Mohammad Arshi Saloot Nick Sherck Stephen Dokas H. Mahyar Soheila Samiee ELM 483 0 0 30 Nov 2024
Parametric UMAP embeddings for representation and semi-supervised learning Tim Sainburg Leland McInnes T. Gentner 45 222 0 27 Sep 2020
MatScIE: An automated tool for the generation of databases of methods and parameters used in the computational materials science literature Souradip Guha Ankan Mullick Jatin Agrawal Swetarekha Ram Samir Ghui Seung-Cheol Lee S. Bhattacharjee Pawan Goyal 23 15 0 15 Sep 2020
The SOFC-Exp Corpus and Neural Approaches to Information Extraction in the Materials Science Domain Annemarie Friedrich Heike Adel F. Tomazic Johannes Hingerl Renou Benteau Anika Maruscyk Lukas Lange 50 71 0 04 Jun 2020
Why and when should you pool? Analyzing Pooling in Recurrent Architectures Pratyush Maini Keshav Kolluru Danish Pruthi Mausam 36 6 0 01 May 2020
Don't Stop Pretraining: Adapt Language Models to Domains and Tasks Suchin Gururangan Ana Marasović Swabha Swayamdipta Kyle Lo Iz Beltagy Doug Downey Noah A. Smith VLM AI4CE CLL 126 2,398 0 23 Apr 2020
On the Language Neutrality of Pre-trained Multilingual Representations Jindrich Libovický Rudolf Rosa Alexander Fraser 50 103 0 09 Apr 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 317 42,038 0 03 Dec 2019
FinBERT: Financial Sentiment Analysis with Pre-trained Language Models Dogu Araci AIFin 105 637 0 27 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 469 24,160 0 26 Jul 2019
Matching the Blanks: Distributional Similarity for Relation Learning Livio Baldini Soares Nicholas FitzGerald Jeffrey Ling Tom Kwiatkowski 50 768 0 07 Jun 2019
The Materials Science Procedural Text Corpus: Annotating Materials Synthesis Procedures with Shallow Semantic Structures Sheshera Mysore Z. Jensen Edward J. Kim Kevin Huang Haw-Shiuan Chang Emma Strubell Jeffrey Flanigan Andrew McCallum E. Olivetti 52 94 0 16 May 2019
Publicly Available Clinical BERT Embeddings Emily Alsentzer John R. Murphy Willie Boag W. Weng Di Jin Tristan Naumann Matthew B. A. McDermott AI4MH 132 1,956 0 06 Apr 2019
SciBERT: A Pretrained Language Model for Scientific Text Iz Beltagy Kyle Lo Arman Cohan 92 2,948 0 26 Mar 2019
BioBERT: a pre-trained biomedical language representation model for biomedical text mining Jinhyuk Lee Wonjin Yoon Sungdong Kim Donghyeon Kim Sunkyu Kim Chan Ho So Jaewoo Kang OOD 127 5,579 0 25 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.2K 93,936 0 11 Oct 2018
Construction of the Literature Graph in Semantic Scholar Bridger Waleed Ammar Dirk Groeneveld Chandra Bhagavatula Iz Beltagy Miles Crawford ... Lucy Lu Wang Christopher Wilhelm Zheng Yuan Madeleine van Zuylen Oren Etzioni GNN 68 393 0 06 May 2018
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhiwen Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 834 6,768 0 26 Sep 2016
Bidirectional LSTM-CRF Models for Sequence Tagging Zhiheng Huang Wenyuan Xu Kai Yu 169 3,999 0 09 Aug 2015
Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Books Yukun Zhu Ryan Kiros R. Zemel Ruslan Salakhutdinov R. Urtasun Antonio Torralba Sanja Fidler 116 2,529 0 22 Jun 2015
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 323 33,445 0 16 Oct 2013
Efficient Estimation of Word Representations in Vector Space Tomas Mikolov Kai Chen G. Corrado J. Dean 3DV 593 31,406 0 16 Jan 2013