You can ask at mailing list if that is intended behaviour, but ticking "Embed PDF & EPS Files (Experimental)" when saving PDF should prevent white background from appearing (not to mention significantly improving the quality since the result of TeX code gets exported as vector instead of bitmap).