Abiding by Parenting Plan

I have a question.
If your ex-spouse has sole custody of the child and a parenting plan was established in the initial divorce court order on times/visitation, does each party have to abide by the parenting plan/visitation schedule? If so, what do you do if the party is being denied their set visitation? Non custodial parent pays child support as well.