The Jat Sikh rulers of Kaithal princely state, popularly known as Bhais, constructed many buildings of antiquarian interests. The specific feature of this oldest palace is the underground escape tunnel. Another,palace built by Bhai Udey Singh on European pattern is also nearby and is now being used as residence of administrative officers.

The last chief of Kaithal, Bhai Udey Singh, built an imposing palace at Pehowa and named it Garden House.The palace is important architecturally, as it hasunique styled entrances and an elegant appearance.