True that there's not much that is interchangeable from a Olds 403 to a Pontiac engine. You can use the th350 transmission on the Pontiac. And the starters are the same. That's about all.
You can use the 403 motor mounts that are on the frame, since those are same whether you use the 403 or the Pontiac engine. But you can buy those new and they're cheap. What you will need to mount the Pontiac engine in your 78 TA are the engine mounting brackets. These are the brackets that bolt to the engine and then sit over the motor mounts on the frame. You have to find some Pontiac engine mounting brackets that came off of a Pontiac engine that was in a 75-81 Firebird or TA. The brackets can be from 400, 455, or even a 301 Pontiac engine, but only if the engine was in a 75-81 Firebird or TA. No other brackets will work. The part numbers that are stamped on the brackets are 496892 for the right side, and 496893 for the left side.
Then you'll need all the engine pulleys, alternator brackets, p.s. brackets and pump, and a/c brackets for the Pontiac engine. And it would be best to find a Quadra-Jet carb from a 76-79 Pontiac engine to use.
The brakes remain the same.
You'd need an air cleaner and shaker from a 77-79 TA with Pontiac 400 engine, if you want it to fit without any work. This thread at TAC shows the difference between a 403 air cleaner and shaker and a Pontiac 400 (or 455) air cleaner and shaker:
http://transamcountry.com/community/index.php?topic=34280.0