Most fusion reactor designs intend the vast majority of those neutrons to be absorbed by a cladding of lithium for tritium breeding. Lithium being bombarded by neutrons does not produce dangerous long-lasting isotopes.