I experienced it.. Not only baseline, I was not able to delete the data set itself if i create a baseline for it.
You should have modification right to delete baselines. Mostly admins and team center management team will have such rights to avoid accidental delete.