I am not aware that task templates can be searched via advanced search, for example, only templates for projects. And yes tags only show for live tasks so I do agree this is a bit confusing in the guide. I think it is more referred to creating tasks that are marked as templates and not really “task templates”
You might consider using the new bundle feature instead.
Also here is an existing feedback request thread for you to upvote