While we may not know how a model generates its result, we should still know what was asked of the model to get the result.