"A little low" could mean a lot of things depending on whether the person interpreting them was using current standards of treatment or older ones (which some people still use.) Current standards of treatment use the reference range of .3 to 3.04 for a TSH within normal limits but also suggest treatment if the person is within those limits and symptomatic. Older reference ranges were more like .5 to 5.0 for a TSH and there's a big difference for some people between 3 and 5. I noticed a difference between how I felt when my TSH was closer to 1 vs. closer to 2.

In light of the whole set of potential consequences when your thyroid is poorly controlled, I'd push it. I spent a long time with my numbers in range but symptomatic, and while trying to conceive, my thyroid finally began being treated and it made a big difference.