  Clustered federated Multitask learning is introduced as an efficient
technique when data is unbalanced and distributed amongst clients in a
non-independent and identically distributed manner. While a similarity metric
can provide client groups with specialized models according to their data
distribution, this process can be time-consuming because the server needs to
capture all data distribution first from all clients to perform the correct
clustering. Due to resource and time constraints at the network edge, only a
fraction of devices {is} selected every round, necessitating the need for an
efficient scheduling technique to address these issues. Thus, this paper
introduces a two-phased client selection and scheduling approach to improve the
convergence speed while capturing all data distributions. This approach ensures
correct clustering and fairness between clients by leveraging bandwidth reuse
for participants spent a longer time training their models and exploiting the
heterogeneity in the devices to schedule the participants according to their
delay. The server then performs the clustering depending on predetermined
thresholds and stopping criteria. When a specified cluster approximates a
stopping point, the server employs a greedy selection for that cluster by
picking the devices with lower delay and better resources. The convergence
analysis is provided, showing the relationship between the proposed scheduling
approach and the convergence rate of the specialized models to obtain
convergence bounds under non-i.i.d. data distribution. We carry out extensive
simulations, and the results demonstrate that the proposed algorithms reduce
training time and improve the convergence speed while equipping every user with
a customized model tailored to its data distribution.
