To remove a directory that is a symbolic link that points to another directory use the command:
rm directory_name
Notice that the directory does not need to be empty and you do not have to use the rmdir command. You are not really removing a directory, just a named symbolic link that points to the "real" directory.