Currently mining rewards XP (0.1) when you mine a block. This leads to a decent advantage in XP early on for people who settle in the desert because being capable to one hit break sandstone with a stone pickaxe. Every other rock multiplies the calories needed for that XP by the amount required to hit the rock.
I'm suggesting making mining reward XP per swing like woodcutting does, this includes breaking the half slabs. This should make it feel much less bad to settle outside the desert.