AstBERT: Enabling Language Model for Financial Code Understanding with
Abstract Syntax Trees

AstBERT: Enabling Language Model for Financial Code Understanding with Abstract Syntax Trees

20 January 2022

Zhengqing Huang

Papers citing "AstBERT: Enabling Language Model for Financial Code Understanding with Abstract Syntax Trees"

16 / 16 papers shown

Title
CoSQA: 20,000+ Web Queries for Code Search and Question Answering Junjie Huang Duyu Tang Linjun Shou Ming Gong Ke Xu Daxin Jiang Ming Zhou Nan Duan 46 114 0 27 May 2021
GraphCodeBERT: Pre-training Code Representations with Data Flow Daya Guo Shuo Ren Shuai Lu Zhangyin Feng Duyu Tang ... Dawn Drain Neel Sundaresan Jian Yin Daxin Jiang M. Zhou 128 1,111 0 17 Sep 2020
Neural Code Search Revisited: Enhancing Code Snippet Retrieval through Natural Language Intent Geert Heyman Tom Van Cutsem 38 30 0 27 Aug 2020
Exploring Software Naturalness through Neural Language Models Luca Buratti Saurabh Pujar Mihaela A. Bornea Scott McCarley Yunhui Zheng ... Alessandro Morari Jim Laredo Veronika Thost Yufan Zhuang Giacomo Domeniconi 52 97 0 22 Jun 2020
SCELMo: Source Code Embeddings from Language Models Rafael-Michael Karampatsis Charles Sutton 44 52 0 28 Apr 2020
Detecting Code Clones with Graph Neural Networkand Flow-Augmented Abstract Syntax Tree Wenhan Wang Ge Li Bo Ma Xin Xia Zhi Jin GNN 34 253 0 20 Feb 2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages Zhangyin Feng Daya Guo Duyu Tang Nan Duan Xiaocheng Feng ... Linjun Shou Bing Qin Ting Liu Daxin Jiang Ming Zhou 132 2,588 0 19 Feb 2020
Learning and Evaluating Contextual Embedding of Source Code Aditya Kanade Petros Maniatis Gogul Balakrishnan Kensen Shi ELM 57 77 0 21 Dec 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 268 6,420 0 26 Sep 2019
CodeSearchNet Challenge: Evaluating the State of Semantic Code Search Hamel Husain Hongqiu Wu Tiferet Gazit Miltiadis Allamanis Marc Brockschmidt ELM 114 1,062 0 20 Sep 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 408 24,160 0 26 Jul 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 966 93,936 0 11 Oct 2018
Learning to Mine Aligned Code and Natural Language Pairs from Stack Overflow Pengcheng Yin Bowen Deng Edgar Chen Bogdan Vasilescu Graham Neubig 56 301 0 23 May 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 111 11,520 0 15 Feb 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 453 129,831 0 12 Jun 2017
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 854 149,474 0 22 Dec 2014