Go to content

Orchestrating Consumers and Producers Like an Octopus - Jusabe Guedes - ElixirConfEU 2018

Imagine a scenario, where a queue needs to be consumed and each element must pass through a pipeline; the results may then go to different buckets. Each bucket must work independently, making sure all elements are correctly processed and flushed whenever possible. Orchestrating many consumers/producers at the same time can be challenging, especially when the operation depends on third party services which have different constraints. With this in mind, we are going to show an use case on how we achieved parallelism, necessary to work smoothly with thousands of clients simultaneously. We'll see how things like GenStage and GenServer can be used for all the heavy lifting, leaving us to focus on the business logic. View more on website here: http://www.elixirconf.eu/elixirconfeu2018/jusabe-guedes

April 16, 2018