As a site administrator, can I turn off notifications for certain features at one go?

Yes, you can. You can control notifications for certain features by going to Settings > Organization  > Settings > Notification. Uncheck the features for which you do not want notifications. Your preferences will be automatically saved.