Do less but better, infrastructure adviser tells government