Most likely the op amp (or whatever gain stage) noise. After a certain point, you get thermal noise.

But with such scales, low sample rates and averaging are key.