Emptyquarter formed in Wellington, New Zealand in 1996. In 1998 the group released its first EP Witch Swede Demo. A second EP Make No Mistake, We Want 'Ya Cash! was released in 1999 followed by the EP Live At Thistle Hall. Emptyquarter relocated to Melbourne, Australia in 2000. A final EP My Gang's Gonna Get 'Ya! was released in 2001.