06-04, 12:00–12:25 (Asia/Jerusalem), Main Hall
Challenges and architectural solutions for mass usage of async FaaS workers.
Demand for "Function as a Service" expertise is quickly growing among Python developers. This talk is addressed to the architects and developers working with anywhere from 1000 to 1 million+ daily invocations of Functions. One of the hardest challenges while using FaaS-based workers is orchestration:
- Chunk business jobs to thousands (or millions) of tasks for workers
- How many workers shall we invoke at a specific moment?
- Track the status of each invocation
- Retry / alert failed invocations
- Monitor collateral damage and side-effects (DB, queues, etc)
- Build dependencies of workers and chain workflows
In this talk we are going to discover even more challenges and discuss how to solve them using Python in the AWS cloud.
In the last part of the talk there is an introduction of the sosw orchestration package with a fast-forwarded demo.
The package is now Open Source and open for contributions.
We assume general familiarity of the attendees with FaaS concepts.
Web-applications architect / back-end developer. Broad experience with serverless technologies in AWS.
I have programmed in different languages as a hobby since 1996, but this was never my profession. I worked in several hosting and cloud providers for more than 5 years since 2005. For the last 5 years I focused more on programming as the main occupation using Python as the primary language.
I love Python for it's community and always eager to contribute myself