The washer pump usually shares the same fuse as the wiper motor, so if the wiper motor is still working the fuse must be OK.
There isn't a relay for the pump.
Probably the easiest way to diagnose the problem is to disconnect the pump harness connector and connect a voltmeter or a 12V bulb across the two terminals of the connector. Have someone operate the switch (ignition on) and see if you get 12V/bulb lights. If so the pump has failed and will need replaced.