Make an offer to resolve disputes. Resolve.
If you can't resolve, Quit.
When you end an agreement, your non-compete may go into effect. You'll need to know the terms of your contract to be sure. When your non-compete goes into effect, you may have to find employment elsewhere. To be sure, consult a licensed legal professional.
You need to know that the laws that govern representation agreements vary by state in the United States. Outside of the United States, each country has its requirements. Also, an agent's representation agreement may only be valid in the state that the agent lives in, but that state may not have jurisdiction over the contract itself. There are tons of complex legal matters that require a consultation with a licensed legal professional.
I advise consulting a legal professional for other reasons as well:
Your lawyer may be able to advise on the agent's ability to bar you from seeking employment from your current employer.
Your lawyer may be able to bring litigation against the agent if they are in breach of their contract.
Your lawyer may be able to negotiate better terms or advise you on legal positions relating to your contract.
I grew up with lawyers. There are tons in my family. I can tell you, with high confidence, that consulting a lawyer is a smart and wise move.
When an agreement doesn't work, quit.
If you need help, ask.