Sometimes I do that because it's just uncomfortable to sit with my phone in my pocket. I agree it's rude to use your phone while you're dining or conversing with a group.