I don't see unfair or unethical in your pursuit of fish. However I would not step foot on private property, and HOA's are included, without permission. I think respecting the rights of property owners is important, that's me and your mileage may vary.
Cover 19 should not be taken lightly, IMO, as it's quite serious. So if I was invited to be on private property to fish I would fish. But if the invitation was not extended recently I would get clarity before stepping on the property.
I'm blessed to have a boat but it's not always been that way. I use to get permission to fish and made certain I understood the ground rules. If allowed to keep a few fish from private ponds or gained access to water by traveling over private party,, I'd offer a few fillets. And under no circumstance would I leave as much as a gum wrapper on the place.
There's plenty of bank fishing opportunities around Douglas Lake that are open to the public and trash is a problem. so I think an invitation to fish private property is a privilege not to be taken for granted.
Just My thoughts. Agree or not. It's just my opinion.