from my dad who is more immersed in the culture of people afflicted with normalness:
Both. It could be hard labor for a short time, repetitive tedious work, or mentally exhausting work. “Hard” could just refer to simply doing your best in this context.
i also checked a few dictionaries. wiktionary says it's something that requires a lot of effort, but doesn't specify how rapidly that effort is exerted. the merriam-webster's definition of hardworking says "constantly, regularly, or habitually engaged in earnest and energetic work". both of these could be used to insinuate that distress is good but don't necessarily say it.
from my personal experience, i have been told that i "worked hard" both on days when i did, and when i did not, experience distress from the work. it usually wasn't massive distress.
personally i think i'll continue not using the term "hard work" because it doesn't frickfracking mean anything.