Machine Learning
New Framework Measures Client Influence to Personalize Federated Learning Across Distributed Networks
Researchers propose a method that quantifies how much knowledge different participants should share with each other in privacy-preserving collaborative machine learning.
Federated learning enables multiple participants to train machine learning models together without centralizing their data, but traditional approaches treat all clients equally when combining their work. A team of researchers has now introduced a framework designed to recognize and leverage the varying degrees of usefulness that different participants can provide to each other.
The Problem with Equal Treatment#
Most federated learning systems use fixed weighting when aggregating model updates from different clients, meaning they treat contributions uniformly. In reality, clients with similar preferences, behaviors, or data characteristics often hold knowledge that is more relevant to each other than to the overall group. Current methods largely ignore these natural alignments, missing an opportunity to improve personalized model performance.
How FedC²I Works#
The new approach, called FedC²I (Federated learning with Client-level and Class-level Influence), introduces two key mechanisms to model relationships between participants:
- Client-level influence: Uses influence vectors to quantify how much each participant should learn from others, allowing selective knowledge exchange rather than uniform aggregation
- Class-level influence: Captures fine-grained patterns using an influence matrix to guide customized classifier updates, recognizing that different data categories may have different relevance across clients
This dual approach enables the system to adapt aggregation strategies individually for each client, rather than applying a one-size-fits-all formula.
Performance and Practical Impact#
Experiments testing FedC²I against existing federated learning methods in non-IID (non-independent and identically distributed) settings—where client data is heterogeneous and realistic—showed improvements across effectiveness, robustness, and interpretability. The framework's ability to quantify and exploit inter-client relationships could make collaborative learning more efficient while maintaining privacy protections that federated learning provides.
The work addresses a gap in how distributed machine learning systems can recognize and benefit from the natural affinities between participants with shared characteristics or objectives.