The first aid provision needs to be proportionate to the number of people who may need it, so the relevant figure is how many on site.  Once upon a time this was pretty much the same as the number employed there, so this question didn't often arise, but times have of course changed.  There's no point basing first aid provision in a building on the number of employees who are working elsewhere.