Since you obviously know nothing about Matlab, I will try to help that. All toolboxes require Simulink to be useable.
From the limited information for what you are describing, I would suggest that you take a look at the Communications Toolbox and see how it might fit your desires.