Christian Horner and Spice Girls singer Geri Halliwell-Horner are suffering a "heartache" over their house plans on the Oxfordshire border.