Dan, did you mortise these hinges yourself? If so, this makes for quite a challenging project.
The problem could be the hinge on the door or the hinge on the jamb.
I am going to speculate that the problem is due to improper hinge placement on either the door or the jamb.
First, go to a proper swinging door and look closely at the placement of each hinge, how much is overhanging the jamb, how much is placed short of the door's end and the squareness of each hinge.
Second, is one hinge deeper in the wood or further in on the door or jamb than the other? Could even one set of screws be tighter than the screws on the top or bottom hinge.
When you shut the door, does the door close and fit in the jamb frame properly? Does the doorhinge spring or show tension when you open or close the door?
These are many of the things that could cause your problem. Sometimes you can insert a penney behing one hinge or the other for proper swinging and closing.
Dan, I feel that if you compare this door's hinge with another one that works properly you will see the problem. Remember, the top hinge and the bottom hinge must be exactly placed the same in the door or the wood jamb.