In this paper, the control approach to irregular building excited by multi-dimensional earthquake ground motions is presented by using semi-active tuned liquid column damper (TLCD). The principle of fuzzy neural network (FNN) based on the Takagi-Sugeno model is firstly discussed. And then, the mechanical model of a multi-story irregular structure-TLCD system is given and its equation of motion is derived. The semi-active control strategy is established and implemented by FNN. The numerical examples have shown that it is an effective method proposed for controlling the translational response and rotational response of irregular buildings.