Shadow Treasurer Tim Wilson accused the government of making it "harder to build, harder to hire" in a pre-budget speech.