Search Results - Open Polar - "NVIDIA"

Select result number 1
1

Isolated Scheduling for Distributed Training Tasks in GPU Clusters

by Han, Xinchi, Jiang, Weihao, Cao, Peirui, Yang, Qinwei, Liu, Yunzhuo, Qi, Shuyao, Lin, Shengkai, Zhao, Shizhen
Published 2023
“... contention affects the training time in a cluster with 32 NVIDIA V100 GPUs. Then we propose vClos...”

Get access

Text
Select result number 2
2

Fast Distributed Inference Serving for Large Language Models

by Wu, Bingyang, Zhong, Yinmin, Zhang, Zili, Huang, Gang, Liu, Xuanzhe, Jin, Xin
Published 2023
“... of FastServe based on NVIDIA FasterTransformer. Experimental results show that compared to the state-of-the-art...”

Get access

Text