How do I get rid of big smudges on my contacts?

I get new contacts and a few days later big smudges appear and they don't come off. I put them in solution for awhile and try to rub it off. I think maybe it's from mascara that might sit on it when I take them out at night? Please help because I'm going through a lot of contacts ):