v1v2 (latest)

Geospatial Mechanistic Interpretability of Large Language Models

6 May 2025

Papers citing "Geospatial Mechanistic Interpretability of Large Language Models"

39 / 39 papers shown

Title
Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters Charlie Snell Jaehoon Lee Kelvin Xu Aviral Kumar LRM 198 698 0 06 Aug 2024
Evaluating the Ability of Large Language Models to Reason about Cardinal Directions Anthony G Cohn Robert E Blackwell 93 8 0 24 Jun 2024
CityGPT: Empowering Urban Spatial Cognition of Large Language Models Jie Feng Tianhui Liu Junbo Yan Siqi Guo Yuming Lin Yong Li 113 16 0 20 Jun 2024
Scaling and evaluating sparse autoencoders Leo Gao Tom Dupré la Tour Henk Tillman Gabriel Goh Rajan Troll Alec Radford Ilya Sutskever Jan Leike Jeffrey Wu 83 160 0 06 Jun 2024
Evaluation of Geographical Distortions in Language Models: A Crucial Step Towards Equitable Representations R. Decoupes R. Interdonato Mathieu Roche M. Teisseire S. Valentin 66 2 0 26 Apr 2024
GeoLLM-Engine: A Realistic Environment for Building Geospatial Copilots Simranjit Singh Michael Fore Dimitrios Stamoulis LLMAG 65 12 0 23 Apr 2024
Mechanistic Interpretability for AI Safety -- A Review Leonard Bereska E. Gavves AI4CE 127 158 0 22 Apr 2024
Do Sentence Transformers Learn Quasi-Geospatial Concepts from General Text? Ilya Ilyankou Aldo Lipani Stefano Cavazzi Xiaowei Gao James Haworth 31 2 0 05 Apr 2024
Where to Move Next: Zero-shot Generalization of LLMs for Next POI Recommendation Shanshan Feng Haoming Lyu Caishun Chen Yew-Soon Ong LRM 75 13 0 02 Apr 2024
Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models Samuel Marks Can Rager Eric J. Michaud Yonatan Belinkov David Bau Aaron Mueller 138 159 0 28 Mar 2024
On the Scaling Laws of Geographical Representation in Language Models Nathan Godey Eric Villemonte de la Clergerie Benoît Sagot 92 8 0 29 Feb 2024
Tokenization counts: the impact of tokenization on arithmetic in frontier LLMs Aaditya K. Singh DJ Strouse 103 61 0 22 Feb 2024
Distortions in Judged Spatial Relations in Large Language Models N. Fulman Abdulkadir Memduhoğlu Alexander Zipf 83 11 0 08 Jan 2024
Advancing Spatial Reasoning in Large Language Models: An In-Depth Evaluation and Enhancement Using the StepGame Benchmark Fangjun Li David C. Hogg Anthony G. Cohn LRM 94 32 0 08 Jan 2024
More than Correlation: Do Large Language Models Learn Causal Representations of Space? Yida Chen Yixian Gan Sijia Li Li Yao Xiaohan Zhao LRM 64 6 0 26 Dec 2023
On the Promises and Challenges of Multimodal Foundation Models for Geographical, Environmental, Agricultural, and Urban Planning Applications Chenjiao Tan Qian Cao Yiwei Li Jielu Zhang Xiao Yang ... Ninghao Liu Changying Li Lan Mu Tianming Liu Gengchen Mai 70 12 0 23 Dec 2023
Charting New Territories: Exploring the Geographic and Geospatial Capabilities of Multimodal LLMs Jonathan Roberts Timo Lüddecke Rehan Sheikh Kai Han Samuel Albanie MLLM 64 30 0 24 Nov 2023
Identifying Linear Relational Concepts in Large Language Models David Chanin Anthony Hunter Oana-Maria Camburu LLMSV KELM 60 4 0 15 Nov 2023
Mistral 7B Albert Q. Jiang Alexandre Sablayrolles A. Mensch Chris Bamford Devendra Singh Chaplot ... Teven Le Scao Thibaut Lavril Thomas Wang Timothée Lacroix William El Sayed MoE LRM 110 2,238 0 10 Oct 2023
Are Large Language Models Geospatially Knowledgeable? Prabin Bhandari Antonios Anastasopoulos Dieter Pfoser LRM 65 37 0 09 Oct 2023
Language Models Represent Space and Time Wes Gurnee Max Tegmark 129 167 0 03 Oct 2023
GPT4GEO: How a Language Model Sees the World's Geography Jonathan Roberts Timo Lüddecke Sowmen Das Kai Han Samuel Albanie 65 64 0 30 May 2023
Autonomous GIS: the next-generation AI-powered GIS Zhenlong Li H. Ning SyDa LLMAG 75 85 0 10 May 2023
Dialectical language model evaluation: An initial appraisal of the commonsense spatial reasoning abilities of LLMs Anthony G. Cohn Jose Hernandez-Orallo ELM ReLM LRM 59 26 0 22 Apr 2023
Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small Kevin Wang Alexandre Variengien Arthur Conmy Buck Shlegeris Jacob Steinhardt 314 563 0 01 Nov 2022
Probing for Constituency Structure in Neural Language Models David Arps Younes Samih Laura Kallmeyer Hassan Sajjad 52 13 0 13 Apr 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 888 13,207 0 04 Mar 2022
Do Language Models Know the Way to Rome? Bastien Liétard Mostafa Abdou Anders Søgaard 101 20 0 16 Sep 2021
Syntactic Perturbations Reveal Representational Correlates of Hierarchical Phrase Structure in Pretrained Language Models Matteo Alleman J. Mamou Miguel Rio Hanlin Tang Yoon Kim SueYeon Chung NAI 86 17 0 15 Apr 2021
Discourse Probing of Pretrained Language Models Fajri Koto Jey Han Lau Tim Baldwin 70 53 0 13 Apr 2021
Probing Classifiers: Promises, Shortcomings, and Advances Yonatan Belinkov 303 456 0 24 Feb 2021
Probing Pretrained Language Models for Lexical Semantics Ivan Vulić Edoardo Ponti Robert Litschko Goran Glavaš Anna Korhonen KELM 76 246 0 12 Oct 2020
Pooling Methods in Deep Neural Networks, a Review Hossein Gholamalinezhad H. Khosravi 200 224 0 16 Sep 2020
Fine-Tuning Language Models from Human Preferences Daniel M. Ziegler Nisan Stiennon Jeff Wu Tom B. Brown Alec Radford Dario Amodei Paul Christiano G. Irving ALM 485 1,768 0 18 Sep 2019
Do NLP Models Know Numbers? Probing Numeracy in Embeddings Eric Wallace Yizhong Wang Sujian Li Sameer Singh Matt Gardner 75 265 0 17 Sep 2019
Probing What Different NLP Tasks Teach Machines about Function Word Comprehension Najoung Kim Roma Patel Adam Poliak Alex Jinpeng Wang Patrick Xia ... Alexis Ross Tal Linzen Benjamin Van Durme Samuel R. Bowman Ellie Pavlick 71 107 0 25 Apr 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,229 0 11 Oct 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 803 132,454 0 12 Jun 2017
Representation Learning: A Review and New Perspectives Yoshua Bengio Aaron Courville Pascal Vincent OOD SSL 286 12,460 0 24 Jun 2012