Experimenting with Emerging RISC-V Systems for Decentralised Machine Learning
Decentralised Machine Learning (DML) enables collaborative machine learning without centralised input data. Federated Learning (FL) and Edge Inference are examples of DML. While tools for DML (especially FL) are starting to flourish, many are not flexible and portable enough to experiment with novel...
Published in: | Proceedings of the 20th ACM International Conference on Computing Frontiers |
---|---|
Main Authors: | , , , , , , , , , , , , |
Format: | Text |
Language: | unknown |
Published: |
2023
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2302.07946 https://doi.org/10.1145/3587135.3592211 |
id |
ftarxivpreprints:oai:arXiv.org:2302.07946 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2302.07946 2023-11-12T04:16:26+01:00 Experimenting with Emerging RISC-V Systems for Decentralised Machine Learning Mittone, Gianluca Tonci, Nicolò Birke, Robert Colonnelli, Iacopo Medić, Doriana Bartolini, Andrea Esposito, Roberto Parisi, Emanuele Beneventi, Francesco Polato, Mirko Torquati, Massimo Benini, Luca Aldinucci, Marco 2023-02-15 http://arxiv.org/abs/2302.07946 https://doi.org/10.1145/3587135.3592211 unknown http://arxiv.org/abs/2302.07946 doi:10.1145/3587135.3592211 Computer Science - Distributed Parallel and Cluster Computing Computer Science - Machine Learning text 2023 ftarxivpreprints https://doi.org/10.1145/3587135.3592211 2023-10-22T01:06:24Z Decentralised Machine Learning (DML) enables collaborative machine learning without centralised input data. Federated Learning (FL) and Edge Inference are examples of DML. While tools for DML (especially FL) are starting to flourish, many are not flexible and portable enough to experiment with novel processors (e.g., RISC-V), non-fully connected network topologies, and asynchronous collaboration schemes. We overcome these limitations via a domain-specific language allowing us to map DML schemes to an underlying middleware, i.e. the FastFlow parallel programming library. We experiment with it by generating different working DML schemes on x86-64 and ARM platforms and an emerging RISC-V one. We characterise the performance and energy efficiency of the presented schemes and systems. As a byproduct, we introduce a RISC-V porting of the PyTorch framework, the first publicly available to our knowledge. Comment: This paper is the accepted version of ACM copyrighted material presented at the CF'23 conference in Bologna, Italy Text DML ArXiv.org (Cornell University Library) Proceedings of the 20th ACM International Conference on Computing Frontiers 73 83 |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Distributed Parallel and Cluster Computing Computer Science - Machine Learning |
spellingShingle |
Computer Science - Distributed Parallel and Cluster Computing Computer Science - Machine Learning Mittone, Gianluca Tonci, Nicolò Birke, Robert Colonnelli, Iacopo Medić, Doriana Bartolini, Andrea Esposito, Roberto Parisi, Emanuele Beneventi, Francesco Polato, Mirko Torquati, Massimo Benini, Luca Aldinucci, Marco Experimenting with Emerging RISC-V Systems for Decentralised Machine Learning |
topic_facet |
Computer Science - Distributed Parallel and Cluster Computing Computer Science - Machine Learning |
description |
Decentralised Machine Learning (DML) enables collaborative machine learning without centralised input data. Federated Learning (FL) and Edge Inference are examples of DML. While tools for DML (especially FL) are starting to flourish, many are not flexible and portable enough to experiment with novel processors (e.g., RISC-V), non-fully connected network topologies, and asynchronous collaboration schemes. We overcome these limitations via a domain-specific language allowing us to map DML schemes to an underlying middleware, i.e. the FastFlow parallel programming library. We experiment with it by generating different working DML schemes on x86-64 and ARM platforms and an emerging RISC-V one. We characterise the performance and energy efficiency of the presented schemes and systems. As a byproduct, we introduce a RISC-V porting of the PyTorch framework, the first publicly available to our knowledge. Comment: This paper is the accepted version of ACM copyrighted material presented at the CF'23 conference in Bologna, Italy |
format |
Text |
author |
Mittone, Gianluca Tonci, Nicolò Birke, Robert Colonnelli, Iacopo Medić, Doriana Bartolini, Andrea Esposito, Roberto Parisi, Emanuele Beneventi, Francesco Polato, Mirko Torquati, Massimo Benini, Luca Aldinucci, Marco |
author_facet |
Mittone, Gianluca Tonci, Nicolò Birke, Robert Colonnelli, Iacopo Medić, Doriana Bartolini, Andrea Esposito, Roberto Parisi, Emanuele Beneventi, Francesco Polato, Mirko Torquati, Massimo Benini, Luca Aldinucci, Marco |
author_sort |
Mittone, Gianluca |
title |
Experimenting with Emerging RISC-V Systems for Decentralised Machine Learning |
title_short |
Experimenting with Emerging RISC-V Systems for Decentralised Machine Learning |
title_full |
Experimenting with Emerging RISC-V Systems for Decentralised Machine Learning |
title_fullStr |
Experimenting with Emerging RISC-V Systems for Decentralised Machine Learning |
title_full_unstemmed |
Experimenting with Emerging RISC-V Systems for Decentralised Machine Learning |
title_sort |
experimenting with emerging risc-v systems for decentralised machine learning |
publishDate |
2023 |
url |
http://arxiv.org/abs/2302.07946 https://doi.org/10.1145/3587135.3592211 |
genre |
DML |
genre_facet |
DML |
op_relation |
http://arxiv.org/abs/2302.07946 doi:10.1145/3587135.3592211 |
op_doi |
https://doi.org/10.1145/3587135.3592211 |
container_title |
Proceedings of the 20th ACM International Conference on Computing Frontiers |
container_start_page |
73 |
op_container_end_page |
83 |
_version_ |
1782333509192384512 |