Creating a scalable (...) with Elixir, Python & Tensorflow | Arjan Scherpenisse
This video was recorded at ElixirConf EU 2021 - https://www.elixirconf.eu/ Creating a scalable intent classifier with Elixir, Python and Tensorflow | Arjan Scherpenisse - Founder at Botsquad ABSTRACT Modern NLP (Natural Language Processing) tasks often build upon large, pre-trained language models like BERT. Neural networks that use these tend to take up a lot of memory, which makes it difficult and costly to scale. In this talk I present the QnA ninja, a classifier service that recognizes text for for example answering FAQs. Elixir is used to coordinate the classification and training of multiple intent classifiers concurrently. It is capable of scaling by using BERT as a feature extractor combined with distributed Elixir to coordinate pools of Python worker processes. • See & download slides: https://drive.google.com/file/d/19uqny3lktCNeSqDVyIgIcoxRLXHPyx-3/view?usp=sharing • Follow us on social: Twitter: https://twitter.com/ElixirConfEU LinkedIn: https://www.linkedin.com/company/27159258/ • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw