EncClusterPervasive and Mobile Computing · 2025

EncCluster: Scalable Functional Encryption in Federated Learning through Weight Clustering and Probabilistic Filters

Encrypt fewer values. Keep federated updates protected.

Vasileios Tsouvalas Samaneh Mohammadi Ali Balador Tanir Ozcelebi Francesco Flammini Nirvana Meratnia

At a glance

Make encrypted federated aggregation cheaper. EncCluster groups model weights into a small codebook, encrypts its centroid values, and sends a compact fingerprint representation of their positions. The server recovers the position map and decrypts an authorized aggregate.

Compact updates · Encrypted aggregation
Client A Server
01 / 06

Many weights → few centroids

Local dataTrainWeights

Trained weights

01-0.5
020.5
03-0.4
040.6
050.7
06-0.3

Centroids

-0.40.6

Position map

01A
02B
03A
04B
05B
06A
Setup authority · Parameters + IDs
Train · Cluster · Preserve positions
Client A Server
02 / 06

Values encrypt · positions hash

Centroids
-0.40.6
DMCFE
AB
Position pairs
(01, A)(02, B)…
Binary Fuse

Two components

Encrypted values+Fingerprints
DMCFE ciphertexts + Binary Fuse fingerprints
Client A Server
03 / 06

Three pieces cross the boundary

Encrypted centroids

AB

BF fingerprints

Partial key

r · f
Client AServer
Encrypted centroids · Fingerprints · Partial key
Client A Server
04 / 06

Recover which centroid goes where

+Shared seedQuery (position, cluster)

Membership queries

Cluster
010203040506
A
···
B
···

Estimated map

01A
02B
03A
04B
05B
06A
Shared seed · Membership queries · Estimated positions
Client A Server
05 / 06

Expand without opening the values

Ciphertext codebook
AB

Position map

01A
02B
03A
04B
05B
06A

Encrypted model

01A
02B
03A
04B
05B
06A
Position by position · Centroid ciphertext substitution
Client A Server
06 / 06

Open the aggregate · start again

Encrypted inputs + key shares

Client A+
Client B+
Client C+

Authorized aggregate

Σ αᵢ θᵢWeighted decryption
Global modelθr+1Clients
Partial keys → Weighted aggregate → Global broadcast
Method diagram

Swipe across the diagram

What this adds

  • 01

    Fewer encryption operations: encrypt representative centroids instead of every model weight.

  • 02

    Separate value and position paths: combine functional encryption with Binary Fuse fingerprints that the server can query.

  • 03

    Measure the cost of protection: compare accuracy, upstream traffic and client encryption time across datasets and architectures.

Abstract

Federated Learning (FL) enables model training across decentralized devices by communicating solely local model updates to an aggregation server. Although such limited data sharing makes FL more secure than centralized approached, FL remains vulnerable to inference attacks during model update transmissions. Existing secure aggregation approaches rely on differential privacy or cryptographic schemes like Functional Encryption (FE) to safeguard individual client data. However, such strategies can reduce performance or introduce unacceptable computational and communication overheads on clients running on edge devices with limited resources. In this work, we present EncCluster, a novel method that integrates model compression through weight clustering with recent decentralized FE and privacy-enhancing data encoding using probabilistic filters to deliver strong privacy guarantees in FL without affecting model performance or adding unnecessary burdens to clients. We performed a comprehensive evaluation, spanning various datasets and architectures, to demonstrate EncCluster's scalability across encryption levels. Our findings reveal that EncCluster significantly reduces communication costs - below even conventional FedAvg - and accelerates encryption by more than four times over all baselines; at the same time, it maintains high model accuracy and enhanced privacy assurances.

Abstract and overview follow the public preprint; the citation identifies the published version.

Read more ↗
How it works

EncCluster

01

Train, then cluster

Local cross-entropy training produces a weight vector. A separate clustering step assigns those weights to κ centroids. Encryption cost then follows the number of centroids, while the map still covers every weight position.

Section 3.4 and Algorithm 1, PDF pages 6–7. The main configuration uses 128 clusters and 256-bit DMCFE keys.

02

Make the map queryable

Insert each (position, cluster) pair into a Binary Fuse filter. The server uses common randomness shared with that client to recover an approximate map. The filter is a compact membership structure; its reconstruction error is not a differential-privacy guarantee.

Sections 3.4–3.5, PDF pages 7–8. The preprint gives inconsistent filter false-positive configurations, so no universal false-positive rate is asserted here.

03

Expand ciphertexts and aggregate

For each position j, substitute the ciphertext of its estimated centroid. Partial functional keys authorize the weighted aggregate, whose plaintext becomes the next global model.

θglobal=∑nNnθ~n∑nNn

Plaintext result of Algorithm 2 and Section 3.5, PDF page 8. Nₙ is client sample count; θ̃ₙ is its reconstructed clustered model. Individual inputs remain encrypted during aggregation.

04

Keep the threat assumptions explicit

The design assumes an honest-but-curious server and setup authority, secure channels and key provisioning. Clients may disclose their weights in collusion but do not poison updates. Aggregate subtraction under extensive collusion can expose a clustered contribution; lossy clustering alone does not establish confidentiality of that contribution.

Sections 3.2–3.3 and 4.2, PDF pages 5–6 and 9–10. Poisoning and denial of service are outside the analysis.

Method details in the paper ↗

Original paper figures & sources
EncCluster pipeline: clients train a model, cluster weights, encrypt centroids, and encode mappings into Binary Fuse fingerprints; the server reconstructs encrypted weights and securely aggregates them.Enlarge
Weight clustering separates values from their positions. EncCluster encrypts the centroids, encodes the mappings, and reconstructs the encrypted updates only for secure aggregation. Figure 1 in the public preprint
Evaluation

Results

Upstream traffic under encryption

CIFAR-10 · ResNet-20 · 30 clients · full participation; clustered FedAvg is unencrypted

Upstream volume / FedAvg ↓ Lower is better

FedAvg + weight clustering
Upstream / FedAvg: 0.034
DeTrust-FL
Upstream / FedAvg: 3.743
SEFL
Upstream / FedAvg: 2.581
EncCluster
Upstream / FedAvg: 0.284

EncCluster sends 0.284× FedAvg’s upstream volume; DeTrust-FL sends 3.743× and SEFL 2.581×.

Paper ↗

Accuracy and encryption cost

CIFAR-10 · accuracy change vs FedAvg (pp) · client encryption time (s)

Less encryption work and upstream traffic. CIFAR-10, ResNet-20, 30 clients, full participation, 128 clusters, 256-bit key. IID uses Dir(10); non-IID uses Dir(0.1). Accuracy changes are percentage points versus FedAvg; upstream ratios and seconds are lower-is-better.
MethodIID accuracy Δ (pp)Non-IID accuracy Δ (pp)Encryption (s)
FedAvg + weight clustering-0.12-0.71—
DeTrust-FL-0.09-0.10329.53
SEFL-0.98-1.747.64
EncCluster-0.32-0.792.04

EncCluster reports 2.04 s encryption with 0.32 pp IID and 0.79 pp non-IID accuracy losses.

Paper ↗
Reference

Cite this work

BibTeX
@article{tsouvalas2025enccluster,
  title = {{EncCluster}: Scalable functional encryption in federated learning through weight clustering and probabilistic filters},
  author = {Tsouvalas, Vasileios and Mohammadi, Samaneh and Balador, Ali and Ozcelebi, Tanir and Flammini, Francesco and Meratnia, Nirvana},
  journal = {Pervasive and Mobile Computing},
  volume = {108},
  pages = {102021},
  year = {2025},
  publisher = {Elsevier},
  doi = {10.1016/j.pmcj.2025.102021},
  url = {https://doi.org/10.1016/j.pmcj.2025.102021}
}

Keep exploring

EFU

Enforce unlearning while keeping the request private

FedCompress

Compress both directions of federated training.

Figure preview

Open full-size image