Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2402.03480
Cited By
Trillion Parameter AI Serving Infrastructure for Scientific Discovery: A Survey and Vision
5 February 2024
Nathaniel Hudson
J. G. Pauloski
Matt Baughman
Alok V. Kamatar
Mansi Sakarvadia
Logan T. Ward
Ryan Chard
André Bauer
Maksim Levental
Wenyi Wang
Will Engler
Owen Price Skelly
Ben Blaiszik
Rick L. Stevens
Kyle Chard
Ian Foster
MedIm
Re-assign community
ArXiv
PDF
HTML
Papers citing
"Trillion Parameter AI Serving Infrastructure for Scientific Discovery: A Survey and Vision"
9 / 9 papers shown
Title
MLPerf Power: Benchmarking the Energy Efficiency of Machine Learning Systems from Microwatts to Megawatts for Sustainable AI
Arya Tschand
Arun Tejusve Raghunath Rajan
S. Idgunji
Anirban Ghosh
J. Holleman
...
Rowan Taubitz
Sean Zhan
Scott Wasson
David Kanter
Vijay Janapa Reddi
62
3
0
15 Oct 2024
On the Foundations of Earth and Climate Foundation Models
Xiao Xiang Zhu
Zhitong Xiong
Yi Wang
Adam J. Stewart
Konrad Heidler
Yuanyuan Wang
Zhenghang Yuan
Thomas Dujardin
Qingsong Xu
Yilei Shi
AI4Cl
AI4CE
31
21
0
07 May 2024
Attention Lens: A Tool for Mechanistically Interpreting the Attention Head Information Retrieval Mechanism
Mansi Sakarvadia
Arham Khan
Aswathy Ajith
Daniel Grzenda
Nathaniel Hudson
André Bauer
Kyle Chard
Ian Foster
177
10
0
25 Oct 2023
Dissecting Recall of Factual Associations in Auto-Regressive Language Models
Mor Geva
Jasmijn Bastings
Katja Filippova
Amir Globerson
KELM
191
261
0
28 Apr 2023
PanGu-Σ: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computing
Xiaozhe Ren
Pingyi Zhou
Xinfan Meng
Xinjing Huang
Yadao Wang
...
Jiansheng Wei
Xin Jiang
Teng Su
Qun Liu
Jun Yao
ALM
MoE
75
60
0
20 Mar 2023
Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small
Kevin Wang
Alexandre Variengien
Arthur Conmy
Buck Shlegeris
Jacob Steinhardt
212
496
0
01 Nov 2022
Zero-Shot Text-to-Image Generation
Aditya A. Ramesh
Mikhail Pavlov
Gabriel Goh
Scott Gray
Chelsea Voss
Alec Radford
Mark Chen
Ilya Sutskever
VLM
255
4,781
0
24 Feb 2021
funcX: A Federated Function Serving Fabric for Science
Ryan Chard
Y. Babuji
Zhuozhao Li
Tyler J. Skluzacek
A. Woodard
Ben Blaiszik
Ian Foster
Kyle Chard
44
187
0
07 May 2020
Scaling Laws for Neural Language Models
Jared Kaplan
Sam McCandlish
T. Henighan
Tom B. Brown
B. Chess
R. Child
Scott Gray
Alec Radford
Jeff Wu
Dario Amodei
264
4,489
0
23 Jan 2020
1