The loss of a factory employing 130 people has hit hard in a community where "everyone" knows someone who has worked there.