@sam
We don’t know what perverse path it might take to maximize its objective function, nor do we have a handle on how to craft its objective function to balance beneficence, human autonomy, and non-maleficence. We sort of see this with recommendation algos already.