Yes, you should generate the mipmaps. See also the other thread (Unity Toolkit Basis compression - #5 by Evgeni_Popov).
Generating the mipmaps should work, I did use toktx.exe to generate etc1s/uastc encoded ktx2 files and it did work. Can you a provide a file for which generating mipmaps does not work?