One aspect to consider is exactly what data these devices are exfiltrating from your network. You usually can't see the contents of the telemetry sent, but given that a LOT of smart devices have cameras and/or microphones, do you really trust that your IoT devices are not sending back audio and or video recordings of the inside of your house?