Thanks for following up, @anon33779598. Is your Rule set up so that “Comment added” is the trigger as seen in the screenshot below?
If so, you should see the action take place as soon as a comment is added, not weeks after. If this is the case, I’d suggest reaching out to our Support team with the URL to a task where this Rule didn’t function correctly.
As the Support team has access to additional tools that we don’t have here on the Community team, they’ll be able to take a closer look at this for you.