Decentralized training in practice:

Compute, data, and validation are all done by separate actors, each earning tokens or micropayments.

Correctness is often enforced through some form of cryptoeconomics: cheat, and you get slashed. Play fair, and you get paid.