Webhooks not firing

English Forum Critical Bugs Closed
1

For more than an hour now, our webhooks are not firing.
We receive a lot of webhooks normally and we did not change any code on our side.
Anybody else has the same issue?

Thank you.

2

Facing the same issue ā€˜Events are not coming from asanaā€™ from last hour or so. It was working fine few hours back.

Thanks,
Mukul

3

Same here. :cry:

4

Same here. Last event was sent 10:16 UTC today. Since then nothing.

5

Hi everyone, thanks for reporting this issue and sorry for the trouble here!

Our engineering team are currently investigating, and we hope to have this resolved very shortly. In the meantime, you can monitor updates here: trust.asana.com.

Iā€™ve moved this thread to our bug category and Iā€™ll also make sure to keep this thread updated as soon as we have more information.

6

FYI:

A fix has been implemented and we are monitoring the results.

Posted 4 minutes ago. Jun 16, 2020 - 13:48 UTC

2 Likes
7

Thanks for sharing the information here @Phil_Seeman! :clap: I was just going to post an update but you were faster :sweat_smile:

1 Like
8

@Joe_Trollo @Ross_Grambo @Marie @Emily_Roman
I am currently seeing issues where it appears some webhooks are being delivered and some not. Please adviseā€¦

2 Likes
9

Thanks for the update @Phil_Seeman, Iā€™m checking this with our team and will keep you posted here once they get back to me!

1 Like
10

Thanks, @Marie. My appsā€™ webhooks are definitely all not firing at present.

1 Like
11

Thanks for the follow-up @Phil_Seeman, our team is still looking into this, Iā€™ll keep you posted as soon as I have an update!

12

Appears to be working again - for nowā€¦ :worried:

1 Like
13

@Joe_Trollo @Ross_Grambo
Can you guys supply a post-mortem for this outage when youā€™re able? Thanks much!

1 Like
14

@Joe_Trollo @Ross_Grambo @Jeff_Schneider @Marie @Emily_Roman

Hey all,

Actually I believe this is still an active problem - Flowsana webhooks seem to work one minute, then not the next. They appear to work for a while and then donā€™t, and then do again. Can you provide some input? Thanks.

15

We have someone working on it now. Iā€™ll relay any updates I hear. :confused:

2 Likes
16

Hi everyone, sorry itā€™s taken us so long to respond hereā€”this was a gnarly incident to resolve. We believe we found the root cause and have fixed the issue, but weā€™ll be monitoring our systems closely for the next few hours to ensure it doesnā€™t come back. All webhooks and event streams should be operating normally now, and you might be receiving ā€œoldā€ events as our systems work through the backlog. Unfortunately, events closer to the start of the incident will have been dropped and cannot be delivered at this point. If you continue to encounter issues, please let us know here and weā€™ll investigate further.

Weā€™ll be posting a summary of the incident and a list of follow-ups sometime tomorrow. Thank you for your patience!

5 Likes
17

Briefly describe (1-2 sentences) the Bug youā€™re experiencing:
My app is having troubles receiving triggers from Asana webhooks
Steps to reproduce:

Browser version:

Upload screenshots below:

18

Hi @Konstantin_Kalashnik and thanks for the report. iā€™ve merged your post with the existing thread we already had on this topic. Please see above the latest update from our team!

1 Like
19

Hi allā€”Iā€™ve just posted our summary of the incident in the Platform News category of the forum. You can head there to read more and ask any lingering questions you have.

1 Like
20

This topic was automatically closed 16 days after the last reply. New replies are no longer allowed.