A Field Guide to Federated Optimization
A Field Guide to Federated Optimization
Federated learning and analytics are a distributed approach for collaboratively learning models (or statistics) from decentralized data, motivated by and designed for privacy protection. The distributed learning process can be formulated as solving federated optimization problems, which emphasize communication efficiency, data heterogeneity, compatibility with privacy and system requirements, and other constraints that are not primary considerations in other problem settings. This paper provides recommendations and guidelines on formulating, designing, evaluating and analyzing federated optimization algorithms through concrete examples and practical implementation, with a focus on conducting effective simulations to infer real-world performance. The goal of this work is not to survey the current literature, but to inspire researchers and practitioners to design federated learning algorithms that can be used in various practical applications.
Ananda Theertha Suresh、Hubert Eichner、Wennan Zhu、Honglin Yuan、Blake Woodworth、Zheng Xu、Alex Ingerman、Chen Zhu、Salman Avestimehr、H. Brendan McMahan、Zachary Charles、Samuel Horvath、Sai Praneeth Karimireddy、Jianyu Wang、Tara Javidi、Sebastian U. Stich、Gauri Joshi、Felix X. Yu、Filip Hanzely、Zachary Garrett、Mehryar Mohri、Antonious M. Girgis、Peter Kairouz、Maruan Al-Shedivat、Ameet Talwalkar、Karan Singhal、Shanshan Wu、Sashank J. Reddi、Mi Zhang、Galen Andrew、Sanmi Koyejo、Tian Li、Chaoyang He、Deepesh Data、Luyang Liu、Suhas Diggavi、Hang Qi、Hongyi Wang、Mahdi Soltanolkotabi、Chunxiang Zheng、Weikang Song、Tong Zhang、Zhouyuan Huo、Katharine Daly、Andrew Hard、Martin Jaggi、Virginia Smith、Jakub Konecny、Blaise Aguera y Arcas、Advait Gadhikar、Peter Richtarik、Manzil Zaheer、Satyen Kale
计算技术、计算机技术
Ananda Theertha Suresh,Hubert Eichner,Wennan Zhu,Honglin Yuan,Blake Woodworth,Zheng Xu,Alex Ingerman,Chen Zhu,Salman Avestimehr,H. Brendan McMahan,Zachary Charles,Samuel Horvath,Sai Praneeth Karimireddy,Jianyu Wang,Tara Javidi,Sebastian U. Stich,Gauri Joshi,Felix X. Yu,Filip Hanzely,Zachary Garrett,Mehryar Mohri,Antonious M. Girgis,Peter Kairouz,Maruan Al-Shedivat,Ameet Talwalkar,Karan Singhal,Shanshan Wu,Sashank J. Reddi,Mi Zhang,Galen Andrew,Sanmi Koyejo,Tian Li,Chaoyang He,Deepesh Data,Luyang Liu,Suhas Diggavi,Hang Qi,Hongyi Wang,Mahdi Soltanolkotabi,Chunxiang Zheng,Weikang Song,Tong Zhang,Zhouyuan Huo,Katharine Daly,Andrew Hard,Martin Jaggi,Virginia Smith,Jakub Konecny,Blaise Aguera y Arcas,Advait Gadhikar,Peter Richtarik,Manzil Zaheer,Satyen Kale.A Field Guide to Federated Optimization[EB/OL].(2021-07-14)[2025-05-22].https://arxiv.org/abs/2107.06917.点此复制
评论