Task vs. task chain
"Go grocery shopping" sounds like one thing. In practice it's getting ready, leaving the house, driving, dealing with crowds and noise, making dozens of small decisions, carrying everything, driving home, putting it away, cooking, washing up, and recovering.
When you criticize yourself for struggling with "one simple errand," your nervous system may be reacting to the whole chain. You're measuring the task in minutes. Your brain may be measuring it in transitions.