Tax is added for product with no tax; VAT Id = 0 none
(If not mistaken I remember this was fixed, tried to look at old tracker but no more)
Product display is different for different configuration but in all configuration tax is add but it shouldn't. Will try to explain with images.
Tax mode = Based on shipping address.
Product has no tax assign to it; VAT Id = 0 (-none-) hence no tax should be added.

Product in front-end is shown correctly without tax.

However product in checkout has tax applied to it;
Wrong
Tax mode = Based on vendor address.
Product has no tax assign to it; VAT Id = 0 (-none-) hence no tax should be added.

Product in front-end is shown
incorrectly (it shows with tax it shouldn't because product has no tax assign to it).

Product in checkout has tax applied to it;
Wrong
Price display changes when in 'Shopper Group'-> 'Show Prices including tax' is checked/unchecked but the final result (checkout) product has tax.