Hi,
I came across this post as I was trying to solve just this problem. Machine Design and Mechanics of Materials books don't do the square or rectangular tube (generally) since it is a little more difficult, an exception is Juvinall and Marshek 3rd ed. The question asked was what is the transverse shear stress (which results from a transverse applied load, i.e., bending). The general solution is tau = (V Q) / (I b), where V is the shear load, I is the second moment of area, b is the width of the beam, and Q is the integral of y dA over some cross-section of the beam {it is the first moment of area for the region of interest about the Neutral Axis}. So to get the answer for a rectangle of say b width and h height and wall thickness t, at the neutral axis where it will be maximum we need to break the integral into two parts: first from the distal fibers (h/2) to the inside of the tube wall (h/2 - t) and second integrate from the inside wall of the tube to the neural axis, i.e, (h/2 - t) to 0. Note that the "b" is not the same for these two since the b in this expression is the "width" at the top of cross-section that is being integrated. So, with the help of Mathematica here is the maximum transverse shear stress (at the neutral axis) for a hollow rectangular tube of width b, height h, and wall thickness t.
tauTransverse = 2 t^4 - 2 h t^3 +(1/2) (h^2 - b^2) t^2 + (1/2) b^2 t
Hope this helps.