How can you set the Fairfax Castle as you marital house in fable 2?

just married Lady Grey and she's really picky... I thought that nothing can be better than a castle so I tried to set it for my wife and baby, but i can't.If anyone could help me on this, thanks!