The problem with that attitude is twofold. Firstly, sometimes crossing the railway is in fact the only option. Imagine if, for example, the only nearby chemist is on the other side of a railway. What are you supposed to do if you are prescribed medicine?
There's also the issue that, if the railway had considered this scenario, then OP would be able to communicate safely with the signaller. They could provide a button to request permission to cross with a light which illuminated when permission was granted. They could ensure that every crossing was provided with a phone number to the signalling centre allowing people to use relay calls. Hell, in many places they could even install a footbridge, if they didn't mind throwing quite a lot of money at the problem. But they do none of these things, instead preferring to rely on people's ability to use inaccessible technology from the late 19th century.
I'm not saying that telephones don't have their place - they do - but I think we are past the point where they should ever be the only available form of communication.