2024-06-16

cs.AR - Architecture

标题	作者	发布日期	PDF	摘要
Tender: Accelerating Large Language Models via Tensor Decomposition and Runtime Requantization	Jungi Lee, Wonbeom Lee, Jaewoong Sim	2024-06-16	下载	Large language models (LLMs) demonstrate outstanding performance in various tasks in machine learning and have thus become one of the most important workloads in today's computing landscape.
Optimization of Armv9 architecture general large language model inference performance based on Llama.cpp	Longhao Chen, Yina Zhao, Qiangjun Xie, Qinghua Sheng	2024-06-16	下载	This article optimizes the inference performance of the Qwen-1.8B model by performing Int8 quantization, vectorizing some operators in llama.cpp, and modifying the compilation script to improve the co...

cs.DC - Distributed, Parallel, and Cluster Computing

标题	作者	发布日期	PDF	摘要
Leveraging Foundation Models for Multi-modal Federated Learning with Incomplete Modality	Liwei Che, Jiaqi Wang, Xinyue Liu, Fenglong Ma	2024-06-16	下载	Federated learning (FL) has obtained tremendous progress in providing collaborative training solutions for distributed data silos with privacy guarantees.
M-SET: Multi-Drone Swarm Intelligence Experimentation with Collision Avoidance Realism	Chuhao Qin, Alexander Robins, Callum Lillywhite-Roake, Adam Pearce, Hritik Mehta, Scott James, Tsz Ho Wong, Evangelos Pournaras	2024-06-16	下载	Distributed sensing by cooperative drone swarms is crucial for several Smart City applications, such as traffic monitoring and disaster response.
Linkage on Security, Privacy and Fairness in Federated Learning: New Balances and New Perspectives	Linlin Wang, Tianqing Zhu, Wanlei Zhou, Philip S. Yu	2024-06-16	下载	Federated learning is fast becoming a popular paradigm for applications involving mobile devices, banking systems, healthcare, and IoT systems.
Knowledge Distillation in Federated Learning: a Survey on Long Lasting Challenges and New Solutions	Laiqiao Qin, Tianqing Zhu, Wanlei Zhou, Philip S. Yu	2024-06-16	下载	Federated Learning (FL) is a distributed and privacy-preserving machine learning paradigm that coordinates multiple clients to train a model while keeping the raw data localized.
Design and Optimization of Hierarchical Gradient Coding for Distributed Learning at Edge Devices	Weiheng Tang, Jingyi Li, Lin Chen, Xu Chen	2024-06-16	下载	Edge computing has recently emerged as a promising paradigm to boost the performance of distributed learning by leveraging the distributed resources at edge nodes.
Federated Learning Optimization: A Comparative Study of Data and Model Exchange Strategies in Dynamic Networks	Alka Luqman, Yeow Wei Liang Brandon, Anupam Chattopadhyay	2024-06-16	下载	The promise and proliferation of large-scale dynamic federated learning gives rise to a prominent open question - is it prudent to share data or model across nodes, if efficiency of transmission and f...
PWDFT-SW: Extending the Limit of Plane-Wave DFT Calculations to 16K Atoms on the New Sunway Supercomputer	Qingcai Jiang, Zhenwei Cao, Junshi Chen, Xinming Qin, Wei Hu, Hong An, Jinlong Yang	2024-06-16	下载	First-principles density functional theory (DFT) with plane wave (PW) basis set is the most widely used method in quantum mechanical material simulations due to its advantages in accuracy and universa...

cs.NI - Networking and Internet Architecture

标题	作者	发布日期	PDF	摘要
Make Your Home Safe: Time-aware Unsupervised User Behavior Anomaly Detection in Smart Homes via Loss-guided Mask	Jingyu Xiao, Zhiyao Xu, Qingsong Zou, Qing Li, Dan Zhao, Dong Fang, Ruoyu Li, Wenxin Tang, Kang Li, Xudong Zuo, Penghui Hu, Yong Jiang, Zixuan Weng, Michael R. Lyv	2024-06-16	下载	Smart homes, powered by the Internet of Things, offer great convenience but also pose security concerns due to abnormal behaviors, such as improper operations of users and potential attacks from malic...
LEO Satellite Networks Assisted Geo-distributed Data Processing	Zhiyuan Zhao, Zhe Chen, Zheng Lin, Wenjun Zhu, Kun Qiu, Chaoqun You, Yue Gao	2024-06-16	下载	Nowadays, the increasing deployment of edge clouds globally provides users with low-latency services. However, connecting an edge cloud to a core cloud via optic cables in terrestrial networks poses s...
Design and Optimization of Hierarchical Gradient Coding for Distributed Learning at Edge Devices	Weiheng Tang, Jingyi Li, Lin Chen, Xu Chen	2024-06-16	下载	Edge computing has recently emerged as a promising paradigm to boost the performance of distributed learning by leveraging the distributed resources at edge nodes.

cs.PF - Performance

标题	作者	发布日期	PDF	摘要
Optimization of Armv9 architecture general large language model inference performance based on Llama.cpp	Longhao Chen, Yina Zhao, Qiangjun Xie, Qinghua Sheng	2024-06-16	下载	This article optimizes the inference performance of the Qwen-1.8B model by performing Int8 quantization, vectorizing some operators in llama.cpp, and modifying the compilation script to improve the co...