If none of the components can successfully interact, I suppose
it doesn't matter.  However, if you include both client and
server libraries, shouldn't you be able to use a 32-bit app
that needs client libraries to access a 64-bit server running
on the same box?  Or vice-versa?
  
The server package is not intended to be the delivery vehicle
for client libraries. Yes there are copies of the client libraries
in the package today (because the server and its tools depend
on them). But in a perfect world (to be achieved at some point
in the future), the client libs would be shipped in their own package.

So a 32-bit app that depends on client libraries would simply
depend on the 32-bit client library package. That stack would
be 100% independent of any 64-bit server (and its dependent
libraries) that might be installed on the same box.