Federated Learning to Address Data Privacy & Scarcity

UW Advanced Research Computing Center

Federated Learning is a relatively new type of multi-party computation.  This technique serves as a framework for collaboratively training an AI model in the field of medical health, finance, and public transport by including data differential privacy and homomorphic encryption, with multi-party computation. Development for Federated Learning was spurred in response to the growing hardware and storage requirements associated with training AI models, in conjunction with the requirement that any sensitive data remain protected.  The approach relies on edge computing and a distributed computing framework, in which raw data is processed on local devices, close to where it was generated. Shared data is limited to the results from locally edge computed and processed raw data.  Results are then sent to external data centers to train a global AI model collaboratively.

Typical federated learning frameworks are designed to train multiple local AI models on decentralized hardware which then transmits encrypted weights from local models to an external authority for global AI model computation.

Read the Whitepaper

Cross-Silo Federated Learning Framework

Previously, global AI model development involved multi-party computation and data communication, requiring encryption, transmission, and decryption of an entire massive set of raw data from each participant to an external authority, which raised issues of data security, privacy, and cost. Federated Learning addresses the data security and privacy issues by not requiring the transmission of raw data to an external authority. Construction of the global AI model using the Federated learning framework involves significantly less computational work than multi-party computation due to the encryption, transmission, and decryption work required only for the local weights, which typically differ by several orders of magnitude. Furthermore, training the global AI model using the federated learning framework requires less computational work, as federated learning averages the weights of the AI model. It does not necessitate training with a massive volume of data. Frequent updating of the global AI model is also possible with federated learning since data encryption, transmission, and decryption costs are comparatively very low, and computation of the global AI model is also very low. Furthermore, federated learning also addresses the issue of insufficient volume of high-quality data required by each participant to train an AI model. The underlying idea of federated learning is that learning from the collective knowledge and information in all of the participants’ datasets is likely to lead to a more accurate and robust global AI model than from any single local model.

E-MAIL ARCC-HELP for Inquiries

 

Federated AI Framework