Here is my take on it:
Porsche 4
Reliable, lightweight, keeps the car Porsche, cheap to install but is expensive to get serious power out of it.
Porsche 2.2 or 2.7 Flat 6
Reliable, somewhat lightweight, keeps the car Porsche, a bit more expensive to install and expensive to get serious power out of it. Has that Porsche flat six sound though.
Porsche 3.0, 3.2, 3.6, etc.
Reliable, not as lightweight, keeps the car Porsche, better have a decent budget as it's going to be more expensive to purchase and install engine (especially 3.6), rebuilds will cost more than others, really, really expensive to get in excess of 350 hp.
Chevy V8
Reliable, not lightweight, install kits readily available, good power and torque, lots of tech advice from people who have been there, done that. Fairly commonplace. Cheap to buy engine and rebuild.
Mazda 13B Rotary Non Turbo
Cheap to buy, lightweight, reliable in normally aspirated form, makes good power, not too common so your car will be something different. Need to make your own kit. Not many people understand the engine so getting advice may be tougher. More expensive than V8 to rebuild but cheaper than Porsche.
Mazda 13BREW (Twin Turbo)
Medium price to buy, still lightweight however turbo parts add weight, makes decent power stock and ungodly power modified. Twin Turbo system difficult to keep working correctly in an RX7 let alone on a project car. In fact many RX7 owners convert to single turbo just for this reason. Will need stand alone engine management. Budget will be between V8 and Porsche 6 for both install and rebuilds.
Subaru 3.3 Flat Six (SVX)
Cheap to buy, similar sound and weight to Porsche 6. Decent power stock but very limited aftermarket for performance parts if you want more. Not very common so there won't be much help from those who have been there/done that.
Subaru 2.2 or 2.5 Turbo
Cheap to buy, lightweight, decent power stock and can easily be increased with wide assortment of aftermarket products. Kits available for install. Becoming more common so decent install support available. Probably best all round compromise - not best at any one thing but good enough at most.
Toyota/Lexus V8
Cheap to buy, all aluminum so lighter weight, decent power with 4 valves per cylinder, good reliability. Rev's high and sounds good. Limited aftermarket and not a common swap so little tech support.
Toyota 3SGTE
Bulletproof motor, good power with stock turbo, large aftermarket, lightweight. Not a common swap so limited tech support.
Mazda 3 Rotor (20b)
The big block of rotaries, reliable in non turbo form, cheaper than a Porsche 6 to buy and rebuild, cheaper than Porsche 6 to make over 400 hp in normally aspirated form with proper porting, unique V12 type sound, no kit available for install so you basically are adapting a V8 kit to work (radiator, etc.), unbelievable "WOW" factor - needless to say this is what I'm going with.
Now if you have to meet emmissions of any kind forget all about the above swaps and buy yourself a Prius.