Can't remove favorite out of list

I hit the the add favorite to a list now I can't remove it. I have click on remove but it still shows up on my list. Please help.