Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models

30 January 2024

Papers citing "Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models"

50 / 265 papers shown

Title
LLaMA: Open and Efficient Foundation Language Models Hugo Touvron Thibaut Lavril Gautier Izacard Xavier Martinet Marie-Anne Lachaux ... Faisal Azhar Aurelien Rodriguez Armand Joulin Edouard Grave Guillaume Lample ALM PILM 1.2K 13,100 0 27 Feb 2023
FedCLIP: Fast Generalization and Personalization for CLIP in Federated Learning Wang Lu Xixu Hu Jindong Wang Xingxu Xie FedML VLM 54 54 0 27 Feb 2023
Knowledge-infused Contrastive Learning for Urban Imagery-based Socioeconomic Prediction Yu Liu Xin Zhang Jingtao Ding Yanxin Xi Yong Li 62 34 0 25 Feb 2023
One Fits All:Power General Time Series Analysis by Pretrained LM Tian Zhou Peisong Niu Xue Wang Liang Sun Rong Jin AI4TS 73 412 0 23 Feb 2023
A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT Ce Zhou Qian Li Chen Li Jun Yu Yixin Liu ... P. Xie Caiming Xiong Jian Pei Philip S. Yu U. Chicago AI4CE 55 518 0 18 Feb 2023
Towards Geospatial Foundation Models via Continual Pretraining Matías Mendieta Boran Han Xingjian Shi Yi Zhu Chen Chen VLM AI4CE 81 70 0 09 Feb 2023
SimMTM: A Simple Pre-Training Framework for Masked Time-Series Modeling Jiaxiang Dong Haixu Wu Haoran Zhang Li Zhang Jianmin Wang Mingsheng Long AI4TS 91 92 0 02 Feb 2023
Learning Generalized Zero-Shot Learners for Open-Domain Image Geolocalization Lukas Haas Silas Alberti Michal Skreta VLM 60 22 0 01 Feb 2023
A Comprehensive Survey of Continual Learning: Theory, Method and Application Liyuan Wang Xingxing Zhang Hang Su Jun Zhu KELM CLL 123 670 0 31 Jan 2023
ClimaX: A foundation model for weather and climate Tung Nguyen Johannes Brandstetter Ashish Kapoor Jayesh K. Gupta Aditya Grover AI4Cl AI4CE 57 255 0 24 Jan 2023
Prompt Federated Learning for Weather Forecasting: Toward Foundation Models on Meteorological Data Shen Chen Guodong Long Tao Shen Jing Jiang AI4TS 52 37 0 22 Jan 2023
MGeo: Multi-Modal Geographic Pre-Training Method Ruixue Ding Boli Chen Pengjun Xie Fei Huang Xin Li Qiang-Wei Zhang Yao Xu 46 18 0 11 Jan 2023
Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learning Colorado Reed Ritwik Gupta Shufan Li S. Brockman Christopher Funk Brian Clipp Kurt Keutzer Salvatore Candido M. Uyttendaele Trevor Darrell 153 184 0 30 Dec 2022
ResFed: Communication Efficient Federated Learning by Transmitting Deep Compressed Residuals Rui Song Liguo Zhou Lingjuan Lyu Andreas Festag Alois Knoll FedML 58 5 0 11 Dec 2022
A Time Series is Worth 64 Words: Long-term Forecasting with Transformers Yuqi Nie Nam H. Nguyen Phanwadee Sinthong Jayant Kalagnanam AIFin AI4TS 72 1,332 0 27 Nov 2022
Self-supervised Trajectory Representation Learning with Temporal Regularities and Travel Semantics Jiawei Jiang Dayan Pan Houxing Ren Xiaohan Jiang Chao Li Jingyuan Wang AI4TS 55 67 0 17 Nov 2022
Time-aware Prompting for Text Generation Shuyang Cao Lu Wang 52 12 0 03 Nov 2022
SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation Zekun Li Jina Kim Yao-Yi Chiang Muhao Chen 99 31 0 21 Oct 2022
Machine Learning for a Sustainable Energy Future Zhenpeng Yao Yanwei Lum Andrew K. Johnston L. M. Mejia-Mendoza Xiaoxia Zhou Yonggang Wen Alán Aspuru-Guzik E. Sargent Z. Seh 58 226 0 19 Oct 2022
Practical Adversarial Attacks on Spatiotemporal Traffic Forecasting Models Fan Liu Haowen Liu Wenzhao Jiang OOD 98 32 0 05 Oct 2022
PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecasting Hao Xue Flora D.Salim AI4TS 84 154 0 20 Sep 2022
Jointly Contrastive Representation Learning on Road Network and Trajectory Zhenyu Mao Ziyue Li Dedong Li Lei Bai Rui Zhao AI4TS 63 48 0 14 Sep 2022
Leveraging Language Foundation Models for Human Mobility Forecasting Hao Xue Bhanu Prakash Voutharoja Flora D. Salim AI4TS 135 72 0 11 Sep 2022
Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions Paul Pu Liang Amir Zadeh Louis-Philippe Morency 79 73 0 07 Sep 2022
FedPrompt: Communication-Efficient and Privacy Preserving Prompt Tuning in Federated Learning Haodong Zhao Wei Du Fang Li Peixuan Li Gongshen Liu FedML 46 69 0 25 Aug 2022
FedOBD: Opportunistic Block Dropout for Efficiently Training Large-scale Neural Networks through Federated Learning Yuanyuan Chen Zichen Chen Pengcheng Wu Han Yu AI4CE 57 18 0 10 Aug 2022
Advancing Plain Vision Transformer Towards Remote Sensing Foundation Model Di Wang Qiming Zhang Yufei Xu Jing Zhang Bo Du Dacheng Tao Lefei Zhang 59 255 0 08 Aug 2022
Pre-training General Trajectory Embeddings with Maximum Multi-view Entropy Coding Yan Lin Huaiyu Wan Shengnan Guo Jilin Hu Christian S. Jensen Youfang Lin AI4TS 63 21 0 29 Jul 2022
Self-supervised Learning in Remote Sensing: A Review Yi Wang C. Albrecht Nassim Ait Ali Braham Lichao Mou Xiao Xiang Zhu 71 223 0 27 Jun 2022
Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecasting Zezhi Shao Zhao Zhang Fei Wang Yongjun Xu AI4TS 89 222 0 18 Jun 2022
Decentralized Training of Foundation Models in Heterogeneous Environments Binhang Yuan Yongjun He Jared Davis Tianyi Zhang Tri Dao Beidi Chen Percy Liang Christopher Ré Ce Zhang 63 93 0 02 Jun 2022
Spatio-Temporal Graph Few-Shot Learning with Cross-City Knowledge Transfer Bin Lu Xiaoying Gan Weinan Zhang Huaxiu Yao Luoyi Fu Xinbing Wang AI4TS 51 73 0 27 May 2022
Large Language Models are Zero-Shot Reasoners Takeshi Kojima S. Gu Machel Reid Yutaka Matsuo Yusuke Iwasawa ReLM LRM 488 4,077 0 24 May 2022
Visual Spatial Reasoning Fangyu Liu Guy Edward Toh Emerson Nigel Collier ReLM 88 174 0 30 Apr 2022
STaR: Bootstrapping Reasoning With Reasoning E. Zelikman Yuhuai Wu Jesse Mu Noah D. Goodman ReLM LRM 91 481 0 28 Mar 2022
Visual Prompt Tuning Menglin Jia Luming Tang Bor-Chun Chen Claire Cardie Serge Belongie Bharath Hariharan Ser-Nam Lim VLM VPVLM 139 1,615 0 23 Mar 2022
ERNIE-GeoL: A Geography-and-Language Pre-trained Model and its Applications in Baidu Maps Jizhou Huang Haifeng Wang Yibo Sun Yunsheng Shi Zhengjie Huang An Zhuo Shikun Feng 48 45 0 17 Mar 2022
FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operators Jaideep Pathak Shashank Subramanian P. Harrington S. Raja Ashesh Chattopadhyay ... Zong-Yi Li Kamyar Azizzadenesheli Pedram Hassanzadeh K. Kashinath Anima Anandkumar AI4Cl 200 682 0 22 Feb 2022
Model Reprogramming: Resource-Efficient Cross-Domain Machine Learning Pin-Yu Chen VLM 121 62 0 22 Feb 2022
Domain Adversarial Spatial-Temporal Network: A Transferable Framework for Short-term Traffic Forecasting across Cities Yihong Tang Ao Qu A. Chow W. Lam S. Wong Wei-Ying Ma AI4TS 130 58 0 08 Feb 2022
CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecasting Gerald Woo Chenghao Liu Doyen Sahoo Akshat Kumar Steven C. H. Hoi AI4TS 142 401 0 03 Feb 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 738 9,267 0 28 Jan 2022
Doing More with Less: Overcoming Data Scarcity for POI Recommendation via Cross-Region Transfer Vinayak Gupta Srikanta J. Bedathur 75 19 0 16 Jan 2022
Self-supervised Autoregressive Domain Adaptation for Time Series Data Mohamed Ragab Emadeldeen Eldele Zhenghua Chen Min-man Wu C. Kwoh Xiaoli Li AI4TS 44 50 0 29 Nov 2021
Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformers John Guibas Morteza Mardani Zong-Yi Li Andrew Tao Anima Anandkumar Bryan Catanzaro 57 237 0 24 Nov 2021
Incentive Mechanisms for Federated Learning: From Economic and Game Theoretic Perspective Xuezhen Tu Kun Zhu Nguyen Cong Luong Dusit Niyato Yang Zhang Juan Li FedML AI4CE 65 120 0 20 Nov 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 427 7,705 0 11 Nov 2021
Attention Augmented Convolutional Transformer for Tabular Time-series Sharath M. Shankaranarayana D. Runje LMTD AI4TS 79 8 0 05 Oct 2021
Region Invariant Normalizing Flows for Mobility Transfer Vinayak Gupta Srikanta J. Bedathur 84 12 0 13 Sep 2021
GeoVectors: A Linked Open Corpus of OpenStreetMap Embeddings on World Scale Nicolas Tempelmeier Simon Gottschalk Elena Demidova 45 14 0 30 Aug 2021