Yes and no.

Better store than loose energy.

But the choice isn’t between heat storage+conversion and no storage. It’s between differents type of storage (heat, chemical, gravity, electrolysis, freewheel), with multiple technology and chemistry to choose from for each type.

Since there’s many options to choose from, it make sense to compare overall efficiency and cost.