Basis Function
Basis function is the generalized form of the above two approaches. Basis are functions on that transform it. Thus, when doing regression with basis functions, we simply regress with a family of transformations of .
For polynomial regression, the basis are powers of and for step function, the basis are constant values in different ranges.