It might be your tie rod arms, and ball joints, and maybe the front sway bar. My supra is doing that same thing, I had it checked by Express Auto and that's what they told me needed replacing. If I were you I'd take it to an alignment shop and ask them to check it for alignment, should be about $60. They will tell you what's wrong exactly.