Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models

30 January 2024

Papers citing "Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models"

50 / 265 papers shown

Title
When Do Contrastive Learning Signals Help Spatio-Temporal Graph Forecasting? Xu Liu Yuxuan Liang Chao Huang Yu Zheng Bryan Hooi Roger Zimmermann AI4TS 48 62 0 26 Aug 2021
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing Pengfei Liu Weizhe Yuan Jinlan Fu Zhengbao Jiang Hiroaki Hayashi Graham Neubig VLM SyDa 187 3,961 0 28 Jul 2021
Time-Series Representation Learning via Temporal and Contextual Contrasting Emadeldeen Eldele Mohamed Ragab Zhenghua Chen Min-man Wu C. Kwoh Xiaoli Li Cuntai Guan AI4TS 83 502 0 26 Jun 2021
TS2Vec: Towards Universal Representation of Time Series Zhihan Yue Yujing Wang Juanyong Duan Tianmeng Yang Congrui Huang Yu Tong Bixiong Xu AI4TS 66 567 0 19 Jun 2021
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 371 10,273 0 17 Jun 2021
Unsupervised Path Representation Learning with Curriculum Negative Sampling Sean Bin Yang Chenjuan Guo Jilin Hu Jiangtao Tang Bin Yang SSL 54 50 0 17 Jun 2021
A White Paper on Neural Network Quantization Markus Nagel Marios Fournarakis Rana Ali Amjad Yelysei Bondarenko M. V. Baalen Tijmen Blankevoort MQ 67 532 0 15 Jun 2021
Hybrid Generative-Contrastive Representation Learning Saehoon Kim Sungwoong Kim Juho Lee SSL 39 11 0 11 Jun 2021
Unsupervised Representation Learning for Time Series with Temporal Neighborhood Coding S. Tonekaboni Danny Eytan Anna Goldenberg CML SSL AI4TS 146 291 0 01 Jun 2021
CogView: Mastering Text-to-Image Generation via Transformers Ming Ding Zhuoyi Yang Wenyi Hong Wendi Zheng Chang Zhou ... Junyang Lin Xu Zou Zhou Shao Hongxia Yang Jie Tang ViT VLM 99 778 0 26 May 2021
De-Pois: An Attack-Agnostic Defense against Data Poisoning Attacks Jian Chen Xuxin Zhang Rui Zhang Chen Wang Ling Liu AAML 37 87 0 08 May 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 512 4,021 0 18 Apr 2021
Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Data Oscar Manas Alexandre Lacoste Xavier Giró-i-Nieto David Vazquez Pau Rodríguez López 59 263 0 30 Mar 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 409 21,347 0 25 Mar 2021
GLM: General Language Model Pretraining with Autoregressive Blank Infilling Zhengxiao Du Yujie Qian Xiao Liu Ming Ding J. Qiu Zhilin Yang Jie Tang BDL AI4CE 109 1,535 0 18 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 814 29,167 0 26 Feb 2021
Intelligent Electric Vehicle Charging Recommendation Based on Multi-Agent Reinforcement Learning Weijiao Zhang Hao Liu Fan Wang Tong Xu Haoran Xin Dejing Dou Hui Xiong 47 81 0 15 Feb 2021
Out-of-Town Recommendation with Travel Intention Modeling Haoran Xin Xinjiang Lu Tong Xu Hao Liu Jingjing Gu Dejing Dou Hui Xiong AI4TS 39 21 0 29 Jan 2021
Multi-Time Attention Networks for Irregularly Sampled Time Series Satya Narayan Shukla Benjamin M. Marlin AI4TS 153 194 0 25 Jan 2021
Spatial Object Recommendation with Hints: When Spatial Granularity Matters Hui Luo Jingbo Zhou Z. Bao Shuangli Li J. Culpepper Haochao Ying Hao Liu Hui Xiong 34 24 0 08 Jan 2021
Prefix-Tuning: Optimizing Continuous Prompts for Generation Xiang Lisa Li Percy Liang 213 4,244 0 01 Jan 2021
Time Series Domain Adaptation via Sparse Associative Structure Alignment Ruichu Cai Jiawei Chen Zijian Li Wei Chen Keli Zhang Junjian Ye Zhuozhang Li Xiaoyan Yang Zhenjie Zhang CML TTA OOD AI4TS 55 91 0 22 Dec 2020
Geography-Aware Self-Supervised Learning Kumar Ayush Burak Uzkent Chenlin Meng Kumar Tanmay Marshall Burke David B. Lobell Stefano Ermon SSL 66 233 0 19 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 534 40,739 0 22 Oct 2020
COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphs Jena D. Hwang Chandra Bhagavatula Ronan Le Bras Jeff Da Keisuke Sakaguchi Antoine Bosselut Yejin Choi 73 409 0 12 Oct 2020
A Transformer-based Framework for Multivariate Time Series Representation Learning George Zerveas Srideepika Jayaraman Dhaval Patel A. Bhamidipaty Carsten Eickhoff AI4TS 76 916 0 06 Oct 2020
Polestar: An Intelligent, Efficient and National-Wide Public Transportation Routing Engine Hao Liu Ying Li Yanjie Fu Huaibo Mei Jingbo Zhou Xu Ma Hui Xiong 42 26 0 11 Jul 2020
Graph Optimal Transport for Cross-Domain Alignment Liqun Chen Zhe Gan Yu Cheng Linjie Li Lawrence Carin Jingjing Liu OT 85 152 0 26 Jun 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 121 1,612 0 15 Jun 2020
Multi-Source Deep Domain Adaptation with Weak Supervision for Time-Series Sensor Data Garrett Wilson J. Doppa D. Cook TTA AI4TS AI4CE 50 146 0 22 May 2020
Learning Geo-Contextual Embeddings for Commuting Flow Prediction Zhicheng Liu Fabio Miranda Weiting Xiong Junyan Yang Qiao Wang Claudio T. Silva AI4TS 64 73 0 04 May 2020
Weight Poisoning Attacks on Pre-trained Models Keita Kurita Paul Michel Graham Neubig AAML SILM 133 447 0 14 Apr 2020
Multi-Scale Representation Learning for Spatial Feature Distributions using Grid Cells Gengchen Mai K. Janowicz Bo Yan Rui Zhu Ling Cai Ni Lao SSL 100 123 0 16 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 329 18,721 0 13 Feb 2020
Meta-learning framework with applications to zero-shot time-series forecasting Boris N. Oreshkin Dmitri Carpov Nicolas Chapados Yoshua Bengio UQCV AI4TS AI4CE 169 112 0 07 Feb 2020
Urban2Vec: Incorporating Street View Imagery and POIs for Multi-Modal Urban Neighborhood Embedding Zhecheng Wang Haoyuan Li Ram Rajagopal 66 82 0 29 Jan 2020
Multi-Modal Domain Adaptation for Fine-Grained Action Recognition Jonathan Munro Dima Damen EgoV 48 193 0 27 Jan 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 530 4,773 0 23 Jan 2020
Semi-Supervised Hierarchical Recurrent Graph Neural Network for City-Wide Parking Availability Prediction Weijia Zhang Hao Liu Yanchi Liu Jingbo Zhou Hui Xiong GNN 50 96 0 24 Nov 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 169 12,065 0 13 Nov 2019
Learning Relationships between Text, Audio, and Video via Deep Canonical Correlation for Multimodal Language Analysis Zhongkai Sun P. Sarma W. Sethares Yingyu Liang 48 320 0 13 Nov 2019
A Comprehensive Survey on Transfer Learning Fuzhen Zhuang Zhiyuan Qi Keyu Duan Dongbo Xi Yongchun Zhu Hengshu Zhu Hui Xiong Qing He 177 4,428 0 07 Nov 2019
Model Pruning Enables Efficient Federated Learning on Edge Devices Yuang Jiang Shiqiang Wang Victor Valls Bongjun Ko Wei-Han Lee Kin K. Leung Leandros Tassiulas 59 461 0 26 Sep 2019
Measure Contribution of Participants in Federated Learning Guan Wang Charlie Xiaoqian Dang Ziye Zhou FedML 84 198 0 17 Sep 2019
VisualBERT: A Simple and Performant Baseline for Vision and Language Liunian Harold Li Mark Yatskar Da Yin Cho-Jui Hsieh Kai-Wei Chang VLM 130 1,948 0 09 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 522 24,351 0 26 Jul 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 218 8,415 0 19 Jun 2019
Multimodal Transformer for Unaligned Multimodal Language Sequences Yao-Hung Hubert Tsai Shaojie Bai Paul Pu Liang J. Zico Kolter Louis-Philippe Morency Ruslan Salakhutdinov 72 1,296 0 01 Jun 2019
VideoBERT: A Joint Model for Video and Language Representation Learning Chen Sun Austin Myers Carl Vondrick Kevin Patrick Murphy Cordelia Schmid VLM SSL 75 1,243 0 03 Apr 2019
Unsupervised Scalable Representation Learning for Multivariate Time Series Jean-Yves Franceschi Aymeric Dieuleveut Martin Jaggi SSL AI4TS 49 450 0 30 Jan 2019