This is currently the only way to allow this. Our permissions model doesn't allow enough granularity in some areas, and this is clearly one of them. Permissions management is an area that will have ongoing enhancements as we roll out new features and functionality.
If you have a moment, look in the Greenhouse to see if this (or similar) ideas have already been posted for comment or voting. If not, please plant it as a new idea!