Implement message bus based connector #378
Closed
+156
−0
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Historically Dynflow used database for communication across processes. The
sending side would write a record into dynflow_envelopes table, receiving side
would poll this table and if it found a record addressed to it, it would receive
it and remove it from the db. Both polling and insert-read-delete cycles were
putting unnecessary load on the db. Using a message bus for this should be the
way to go.
Here I chose MQTT because it is lightweight and I worked with it recently and
still have it in fresh memory. However, this could be adjusted to almost
anything with minimal changes.
#373