Yes, you can delete management units associated to the activity plans. On doing this, the activity plan becomes inactive and the management unit selection in the Permission field of the General tab changes to the All Management Units option.