Yes, a matrix server is an "instance" of matrix on the larger federated service.

Discord calling their different channels "servers" was really unhelpful because they were never servers to begin with.