[bisq-network/bisq] [WIP] Use keyset delta algorithm to speed up GetData requests (#3896)

[chimp1984]

@stejbac 
I did not had time to look into it. But as far I remember we also add the keys for tradestatistic and accout age witness which are by far the biggest chunk (I think its 80k objects in total). 
There is a rough idea to split historical tradestatistic and accout age witness data with the more recent one and only handle the recent one as it is now. With each release we would update the histroical data so thet the recent one only covers the last 1-2 months. As said is very rough idea and maybe there are better approaches, but if that would be implemented I assume it would make the data  for the request radical smaller. I still appreciate your approach with a more efficient data structure for the request, without looking closer it reminds on bloom filters...

@julianknutsen 
Thanks for your  input and for taking time to comment!  



-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/bisq-network/bisq/pull/3896#issuecomment-574914154
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.bisq.network/pipermail/bisq-github/attachments/20200115/acddeffa/attachment-0001.html>