scope of durable power of attorney I have a friend who has mild to moderate…

scope of durable power of attorney
I have a friend who has mild to moderate dementia and lives at an assisted living facility. The family has had me investigated by the state for financial exploitation for which no charges were made, because there has been no financial or other exploitation on my part. The ex-wife has durable power of attorney and has given the exec. dir of the facilty orders to keep me from visiting him. She is his poa for financial matters and medical, in the event he is determined to be incompetent to make medical decisions (which he has not). He is competent to self medicate, leave the facility on his own without supervision and is level one care (he does his own laundry, requires no prompting, etc.). Does the poa have the right to deny his rights to associate with whomever he wishes (Delaware’s Residents’ Rights Law) when there have been no charges of abuse or exploitation? The poa does not visit the resident and has very little contact with him. In nearly a year that I have known him, she has visited once and accompanied him to two Dr’s appointments. In addition, do I have a case for defamation since these directives against me visiting gives the appearance that I have done something wrong?