Ongoing issues with AscendEX order tracking - will I get my rewards?

As you may know, we have been experiencing some issues with AscendEX order tracking during the last few days. We are aware of the inconvenience this is causing our community of miners and, first of all, would like to apologize for the bad user experience this generates. This is not the level of service we aim to provide and our team is restlessly working on fixing these specific issues and on preventing this kind of situation from reoccurring in the future.

In the second place, we would like to shed some light on the issues at hand, since we know there is some confusion among you on how this may affect your rewards. Long story short: rewards will not be lost. Both ongoing issues are related to delayed order tracking, due to two different causes, which we will explain shortly. But suffice to say orders are not being lost and rewards will be calculated normally as soon as we normalize the situation. Your rewards are safe, you just will need to wait a little bit longer to see them reflected on your dashboard. No rollover of rewards will occur, since this behavior is only reserved for situations in which there are not eligible orders on any given snapshot/s or, order tracking information cannot be recovered. Again, not the case with the current open issues.

Finally, I would like to explain what is happening. As mentioned, we have two different ongoing incidents. The first one is internal to Hummingbot and, ironically, is caused by a good thing: high miner activity. This situation strained our database, making it slower and thus delaying the aggregation of orders and rewards calculations. We are addressing this by archiving old data, which will allow our queries to run faster. This will take a couple of days, so we expect to be back to normal starting next week. The second issue is related to the fetcher module, which is in charge of communicating with AscendEX to retrieve our miner's order info. Again, due to higher demand than usual, AscendEX's servers were not able to handle the load, causing a lot of errors when trying to fetch the data, which in turn delayed order tracking. They are working on fixing this issue and things should be back to normal in the next couple of hours.

Once again, we are aware the situation is far from optimal and is committed to improving our users’ experience. But we hope at least this helps clarify the situation and the impact it may have on your rewards (none).

Martin Sigwald - Hummingbot Miner's Product Manager