Most stresses are due to equilibrium, such as sigma=P/A. There is no influence from the stiffness of the structure. Some stresses are due to compatibility, and have an influence from stiffness due to ensuring compatible displacements.
This is not a von Mises stress issue, but simply a stress issue.
You can confirm, through Roark's (or equivalent) that E generally doesn't influence the level of stress.