My friend had this problem about a month ago on his auto supra. His battery was going dead because the alternator wasn't recharging it. It clicked a few times then after the battery was jumped it would start. He took it to Mike Swientek (sp) and he was able to fix it. This is probably what is happening to you. Just get a new alternator from Toyota.
Later,
CJ
Later,
CJ