Skip to search boxSkip to navigationSkip to main content

Split averaging: bridging the heterogeneity gap in clients data for federated learning

Research Output: Contribution to journal Article Peer-review

Open access

Abstract

Federated Learning (FL) has gained significant prominence to overcome the issue of data silos in various domains. However, since its introduction FL has been confronted with the presence of Non-Independent and Identically Distributed (Non-IID) data, hindering its broad-scale adoption. In this paper, we present a novel method named Federated Split Averaging (FSA) to tackle the problem of Non-IID data. FSA solves the key challenge that classical FL fails to overcome, specifically accounting for real-world scenarios where data instances from certain classes are completely missing. Unlike conventional FL, where a cloud server blindly averages clients' model parameters, FSA classifies clients into strong and weak groups and aggregates their parameters separately. The spitted parameters are then used to compute dynamic penalty factors, which regularize clients' training and accelerate convergence. {Experimental results on real-world datasets demonstrated that the proposed method can significantly improve model accuracy in handling Non-IID data, achieving up to 7.23% improvement as compared to other state-of-the-art solutions.

Publication Information

Output type

Research Output: Contribution to journal Article Peer-review

Original language

English

Pages from-to (Number of pages)

Pages 24018-24029 (12 pages)

Journal (Volume, Issue Number)

IEEE Access (Volume 14)

Publication milestones

  • Accepted/In press - 31/01/2026
  • Published - 06/02/2026

Publication status

Published - 06/02/2026

External Publication IDs

  • Scopus: 105029485112