I agree 100%. Jack it up and see if you can hear where the grinding is coming from. I would still take off the rear diff cover and look at it if you haven't in a while. Can't hurt, right?
While you're at it, stop off at a Starbucks beforehand. Can't hurt?
B O S S