If it's SIGNIFICANTLY affecting you like you said, I would say yes. You have to be honest with yourself how bad the side effect is, and is it worth it? I assume you've been taken only the 50mg/day so far?
If you have been taking the reccomended dose of 50mg then follow the protocol of 5 days on 2 days off. I did this for about 2 weeks then brought it back in everyday and the vision sides subdued.