We shall investigate a new approach to tautological integration on the Hilbert scheme of points (HS) on smooth projective varieties via non-reductive geometric invariant theory. I will explain the setup in the special case of the curvilinear component of HS and illustrate with some examples. Also, the extension to the main geometric component of HS will be discussed if time permits.