Now that things are finally starting to improve for Britney Spears, partly due to her father's temporary control of her life, a lawyer claiming he was hired by the troubled pop star insists on challenging her father’s conservatorship of her estate.

As Britney Spears is spending more time with her two sons, Sean Preston and Jayden James, her father Jamie Spears and his legal team are seeking to put an end to a civil rights challenge brought against his conservatorship over Britney's affairs.

The singer met twice with her kids in the past three days under a new visitation agreement she made with her ex-husband Kevin Federline. This was the first time she had any contact with the toddlers since January 3, when she was hospitalized for a mental evaluation. Shortly after, a judge stripped her of her visitation rights.

However, now that she's getting better, Britney is reportedly trying to regain her "freedom," and end her father's temporary control over her daily affairs claiming he violated her civil rights.

John Eeardley, who is managing the case, attempted to move the case to federal court but Jamie's lawyers challenged the move saying that it’s not an issue that falls under federal jurisdiction, that Britney lacks the capacity to hire her own attorney, and that it’s obvious he’s under the thumb of Osama Lutfi, Britney's former manager who is now barred from any contact with Britney by restraining order.

Jamie’s lawyers also are seeking to have their attorney’s fees of over $40,000 awarded for fighting this case.

According to legal papers, Jamie’s lawyers state that it’s clear that Britney’s lawyer is being influenced by Lutfi. In a footnote they say that "Mr. Eardley’s [Britney’s lawyer] claim that Lynne Spears’ declaration is ‘perjured’ and his description of Mr. Lutfi as Britney’s ‘best friend’ speak volumes as to where Mr. Eardley’s allegiances apparently lie."

Britney’s lawyer says that he needs more time to defend his case because he hasn’t been able to speak to his client in about two weeks. The phone number he had for her has been disconnected.