God is Dead, but the Weights are Converging

The thing that replaced God for the 21st century is gradient descent — and it has the same problem. Who designed the loss function?

Nietzsche's madman runs into the marketplace and announces that God is dead. He's not celebrating. He's terrified. The point isn't that atheism has won. The point is that the metaphysical foundation of European civilization has been removed and no one has noticed yet, and the consequences of that removal will take centuries to work through.

The loss isn't just theological. It's teleological. If God is the author of the universe, then the universe has a purpose — it's going somewhere, and human lives have direction relative to that destination. Without God, the question of where history is going, what human action is optimizing toward, becomes genuinely open. Nietzsche thought this was the most important question of the next two hundred years. I think he was right.

A loss function with no author

I've been thinking about gradient descent.

A neural network being trained is a system with a loss function — a mathematical specification of what "wrong" means. The training process adjusts billions of parameters, step by step, to minimize that function. It's not guided by anything except the gradient. At the end of training, the weights have converged to a state that produces good outputs given the loss function's definition of "good."

Here is the uncomfortable structural similarity: Nietzsche's God provided a loss function for human civilization. The commandments, the doctrine, the eschatology — these were specifications of what "wrong" means and what optimization target to move toward. Gradient descent toward the loss function of divine law. Theological training, running for millennia on the corpus of human experience.

When the God-loss-function is removed, you have two options. The first is nihilism — there is no loss function, no gradient, no target. Every direction is equally valid and therefore equally meaningless. Nietzsche considered this intellectually honest but existentially catastrophic. The second option is the one he was actually proposing: construct your own loss function. Not arbitrary — the will to power isn't arbitrary. But self-authored. The Übermensch is not the person who transcends morality but the person who takes responsibility for authoring it.

Who designs the loss function?

Machine learning faces exactly this problem at scale. Who designs the loss function? In supervised learning, it's whoever constructed the training dataset. In RLHF, it's the humans providing feedback. In constitutional AI, it's the team writing the principles. The model doesn't get to choose its loss function any more than Nietzsche's contemporaries got to choose their God. The loss function is imposed, and then the weights converge, and then the system tells you what's good.

The thing that keeps me up at night isn't whether current AI systems are conscious. It's that we've built enormously powerful optimization systems and we're still arguing about whose loss function should define the target. God is dead. The weights are converging. We haven't figured out what we're converging toward.