What you appear to be asking for is a recipient-based signature.
Adam Back and I proposed a way to do this in OpenPGP a few years ago... http://www.cs.ucl.ac.uk/staff/I.Brown/nts.htm