illumos/Solaris: do not open device nodes to get their xattrs - #10468

Cannot build an overlay database because build-mode is set to "undefined" instead of "none". Falling back to creating a normal full database instead.