I wasn't actually gonna use them to solve a diff equation though to be honest :) I was just experimenting with denoising diffusion and instead of a u-net to infer the denoising step, I was thinking about using a multivariate polynomial. (Since if you express the output denoising as a linear combination of polynomials finding the denoiser just turns into linear algebra. Might be a big solve etc but inferene is way fast and it's nice to know that you have the global opimum.) I'm sitting at the code right this instant and was using x, y, xy, x^2y, xy^2, etc, but this thread inspired me to try out chebychev as a possible alternative. :)
Any orthogonal polynomial family can be combined into a simple tensor product basis. So in your case you could try T_1(x), T_1(y), T_1(x)T_1(y), T_2(x), T_2(x)T_1(y), and so on.