Policy Improvements in Higher Dimensions