Forgot password | one time login URL

I am facing an issue with “one time login URL” on one of my Drupal site. When I try to access the “one time login URL” from my mail, it says.. it is been already used, i.e.

You have tried to use a one-time login link that has either been used or is no longer valid. Please request a new one using the form below.

But, I have not tried accessing it before.

After analysis I found that, my Inbox tries to fetch a preview of the link(one time login URL) present in the mail body. And hence the bot from my mail server accesses this URL before I can use it to reset my password.

As a work around I have marked the domain of my site as not safe(Spam), in turn my mail box is not crawling the “one time login URL”, and hence I am able to reset my password.

What would be a better way to handle this situation, how can I restrict this default crawling from my Drupal application?

Drupal version: