Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DataStore should offer interval delta polling as an alternative to real time subscriptions #6489

Open
nubpro opened this issue Aug 4, 2020 · 2 comments
Labels
DataStore Related to DataStore category feature-request Request a new feature

Comments

@nubpro
Copy link
Contributor

nubpro commented Aug 4, 2020

Is your feature request related to a problem? Please describe.
In our production use case, DataStore subscriptions are giving a handful of issues which aren't easily fixable from our end.
We would like to run the app on top of DataStore 24/7 with minimal downtime, however we would notice that subscriptions would somehow fail and aren't able to recover. Therefore, we are losing a lot of data and it kept us away from DataStore until it's fully robust and tried and tested in a real environment.
I have listed down a couple of the issues we faced on #6488 with subscriptions.

Describe the solution you'd like
Instead of relying on real time subscriptions through websocket, perhaps DataStore can offer an alternative way of pulling updates from the backend. Interval delta polling doesn't sound too bad, well at least I'm pretty sure it's much reliable than PubSub.

Describe alternatives you've considered
none

Additional context
We are actually in the midst of implementing our own method of doing delta polling over DataStore's subscriptions. Using elastic search and writing my own custom sync engine that would work alongside with DataStore existing feature such as the mutation processor, observables etc. All except subscription processor and sync processor.

@nubpro nubpro added the feature-request Request a new feature label Aug 4, 2020
@sammartinez sammartinez added the DataStore Related to DataStore category label Aug 6, 2020
@wei
Copy link
Contributor

wei commented Nov 12, 2020

Somewhat related to #5037

@swyxio
Copy link
Contributor

swyxio commented Nov 18, 2020

+1 from the Amplify livestream today

image

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
DataStore Related to DataStore category feature-request Request a new feature
Projects
None yet
Development

No branches or pull requests

4 participants