A Unified Momentum-based Paradigm for Decentralized SGD for Non-Convex Models and Heterogeneous Data Research Background In recent years, with the rise of the Internet of Things and edge computing, distributed machine learning has developed rapidly, especially the decentralized training paradigm. However, in practical scenarios, non-convex objectiv...