06-28, 16:30–16:50 (Asia/Jerusalem), Main Hall
When long running jobs are too long running jobs, profilers help us understand where it is that our code spends its time. I present a technique for manually guided profiling for cases the automatic tools cant' help.
Automatic profiling is great. You just run your code, as you normally do, and get a nice graph of where your CPU spends its time while you're waiting for a job to finish.
Except, sometimes the automatic tools can't help. Maybe something in your work load doesn't agree with them. Maybe they make your already long running job run so much longer that it's impractical to run it properly. Maybe you're only interested in profiling a small part of your code, and profiling the whole thing would create too much noise to be useful.
In this lecture I'll go over what I did when faced with such a problem. I'll detail the technique I used to determine where the time is spent. This is a manually guided profiling, i.e. the programmer decides which areas to measure.
We'll also handle the more complicated cases. In particular:
* Short functions that get called a lot.
* Preventing double accounting when one measured function calls another measured function.
* How to present your data when you need to "sell" the need to fix a problem.
Last, but not least, I'll present an easy way for you to incorporate this technique into your own Python code.
English
Target audience –Developers
With about four decades of experience programming, I managed to be involved in just about every aspect of the computer industry. I have done extensive programming in Python, Perl, PHP, C, C++, D, and Assembly for the 6502 and 68000 platforms. I've programmed on the Apple II, Amiga, MSDOS, Win32, Unix/Linux and Android. I've recently picked up Verilog, for programming the hardware itself.
I tried creating a new C++ style programming language, but for the time being that project has been abandoned.
I am a founding member, and former board member, of Hamakor, and am a founding member and board member of Digital Right Movement.
I run two YouTube channels:
* Hebrew one about explaining aspects of technology is at https://www.youtube.com/channel/UC3-CWmNDharsFBgtjGOGCpA.
* English one, where I'm building a clone of 80's computers from scratch on FPGA, is at https://www.youtube.com/c/CompuSAR.