Time to Return the Loss