You need to allow for seasonal humidity and thermal movements of the wood floor and roof, and of course care for any eccentricities appearing from the vertical loadings. Upon such scheme, you may not be able to produce diaphragm action to keep the walls braced at floor and roof contact points, and this specific type of construction may not be tolerated by some vigent code.
Code permitting, if you allow for the extensions and shortenings, absent from diaphragm support, having the walls stabilized with counterforts-transverse inner smaller yet structural walls (or having the exterior walls with entrants and salients) may help to gain the required structural stability.