You will find these settings under WooCommerce > Settings > Wholesale Prices, then click on Tax in the submenu.
Simple select the wholesale role, then choose whether it should be exempt or not. Feel free to map only the roles that are tax exempt or if you want to be explicit you can map them all.