In that licensing case, a mod project could dual-license with both a license that conforms to the requirements for mod distribution and an open-source license, although this would complicate the efforts of any derivative code who might want to distribute.

That being said, mod authors seem weirdly defensive and secretive about their code and ideas; I think it would be a hard sell to get most of them to use an open-source license even if it were possible.