Should fwb's only have with each other?

if two people agree to be friends with benefits, does that mean they can only have with each other? And if one did go and have with some one else would it matter since there was no commitment?