Experimenting with Emerging RISC-V Systems for Decentralised Machine Learning
Decentralised Machine Learning (DML) enables collaborative ma- chine learning without centralised input data. Federated Learning (FL) and Edge Inference are examples of DML. While tools for DML (especially FL) are starting to flourish, many are not flexible and portable enough to experiment with nov...
Published in: | Proceedings of the 20th ACM International Conference on Computing Frontiers |
---|---|
Main Authors: | , , , , , , , , , , , , |
Other Authors: | |
Format: | Conference Object |
Language: | English |
Published: |
ACM
2023
|
Subjects: | |
Online Access: | https://hdl.handle.net/2318/1898473 https://doi.org/10.1145/3587135.3592211 https://arxiv.org/abs/2302.07946 |
Summary: | Decentralised Machine Learning (DML) enables collaborative ma- chine learning without centralised input data. Federated Learning (FL) and Edge Inference are examples of DML. While tools for DML (especially FL) are starting to flourish, many are not flexible and portable enough to experiment with novel processors (e.g., RISC-V), non-fully connected network topologies, and asynchro- nous collaboration schemes. We overcome these limitations via a domain-specific language allowing us to map DML schemes to an underlying middleware, i.e. the FastFlow parallel programming library. We experiment with it by generating different working DML schemes on x86-64 and ARM platforms and an emerging RISC-V one. We characterise the performance and energy efficiency of the presented schemes and systems. As a byproduct, we intro- duce a RISC-V porting of the PyTorch framework, the first publicly available to our knowledge. |
---|