Frydenberg defends way he met RBA governor