I present a generalization of the framework of locally covariant field theory to encompass charged fields in background gauge fields. One application is a gauge covariant definition of the current. Another one is an adaption of the background field method, which for example allows the calculation of matter contributions to the renormalization group flow from coinciding point limits of Hadamard coefficients.