farnye,
You must have a drawing object, or some other type of object like an embedded chart, way out on the right near the last column of the sheet. If the object properties are to move with cells, then increasing the width of a column might require moving the object off the sheet to the right. You can select the object and change the properties (Format menu) to have it not move with the cells.