Problem with the number of requests from GoogleBot
Hi,

I have a problem with google bots as they have multiplied x4 the cost of my nitter instances in Google Cloud (from 0.8$/day to 4$/day). Half of the requests come from googlebot.

Does anyone know how to add the robots.txt file easily starting from the precompiled docker image?
I have tried to pull the image, add the robots.txt to the container (docker cp...) and create a new image containing robots.txt, but when I deploy it to Google Cloud I get an error
`./start.sh: line 4: ./nitter: not found`
Both images seem to be the same size. Does anyone know how to fix this, or does anyone have precompiled an image that prevents crawling?

Thanks,