I have ran a Holset HX52 and HX55. If you have a true HX50, it has a smaller compressor housing than the HX52/HX55 and you shouldnt have any fitment issues. With the bigger housings you need to have a 20mm spacer between the manifold and exhaust housing to clear the 1st runner. Also note that the "T4" flange in the Holsets is actually a H2 Holset flange which is similar to the T4, all you need to do is enlarge the bolt holes on the flange.
Use a divided manifold to take advantage of the twin scroll exhaust housing. For some reason I couldnt find any divided manifolds for the 2JZ-GTE on Ebay (only for 2JZ-GE). I got mine here:
http://www.manifold.cc/english/product.aspx?id=53
Do you know which size compressor and exhaust wheels do you have and which exhaust housing A/R (cm^2)? The A/R is stamped in the mouth of the housing. It's usually anything between 16 to 22. I wouldnt go bigger than a 19. #16 will be usually perfect on the bigger ones, that's what I run. The larger 22's etc usually come with bigger Diesel engines and are not suitable on a gasoline engine.
Here's a list I saved once of the formula between cm^2 and A/R:
8 cm2 = 0.57 A/R
9 cm2 = 0.65 A/R
10 cm2 = 0.73 A/R
11 cm2 = 0.81 A/R
12 cm2 = 0.89 A/R
14 cm2 = 0.97 A/R
15 cm2 = 1.05 A/R
16 cm2 = 1.13 A/R
17 cm2 = 1.29 A/R
19 cm2 = 1.37 A/R