2026-09-18T20:24:43Zhttps://api.repository.cam.ac.uk/server/oai/request

oai:www.repository.cam.ac.uk:1810/3898712025-09-26T13:12:12Zcom_1810_219481com_1810_256065col_1810_219482

Towards Intelligent Federated Learning Systems https://doi.org/10.17863/CAM.121629 Liang, Yilei Crowcroft, Jonathon Mortier, Richard With the introduction of data privacy laws such as GDPR, the privacy challenges of traditional machine learning have become more visible. Recent works leverage edge computing to preserve data privacy by keeping the data where it is (not shared during the training process), so-called "Edge Computing". In 2016, Google extended this idea to distributed machine learning and termed it as "Federated Learning". In a federated learning system, any device could participate in the training – regardless of its data distribution held or system performance, which brings us to a problem: how to deal with these heterogeneities? Or we take a step back. Does the device even have enough resources to initialise the training process, and if it doesn’t, can we split the workload to multiple devices wisely? In this thesis, I investigate the prior works available towards a federated learning system, using a top-down approach: from aggregation to devices, from devices to models, and from the typical federated learning paradigm (centralised horizontal federated learning) to non-typical federated learning (vertical federated learning and decentralised federated learning). We then optimise a federated learning system from top to bottom. We first maximise the resource utilisation rate on powerful devices for better accuracy, time-to-accuracy efficiency and consistency. We then investigate the paradigm of GAN training and apply the idea of federated learning and split-learning, as well as maximise the extent of parallel computing to reduce the job-completion-time for such a system. We finally investigate the problem of vertical federated learning, where the data distribution is i.i.d while the feature space is partitioned across different devices, and propose a framework called HoVeFL. We proposed these techniques to develop a more intelligent federated learning system. Our experimental results not only empirically show the feasibility of our algorithms as well as suitable scenarios for these optimisation techniques, but also highlight some useful future directions toward more intelligent federated learning systems. We hope that our research will encourage people to further work on these types of optimisations. University of Cambridge 2025-03-06 Thesis Doctoral Doctor of Philosophy (PhD) eng https://www.repository.cam.ac.uk/handle/1810/389871 https://www.repository.cam.ac.uk/bitstreams/42adebfd-5701-4b88-9c30-197a47189bc8/download fd2e2ba3dfeb63150d31b994c4b1d60c https://www.repository.cam.ac.uk/bitstreams/59ac7046-d87c-43f5-83ac-c53d68e9ed2b/download 87eda9de84448d1f82354d60eee3eb5f http://purl.org/NET/rdflicense/allrightsreserved Federated Learning Machine Learning Machine Learning System