Looking at yourself: Linux Introspection tales

Introspection information, used originally by debuggers, has come a long way into playing a greater role in the functioning of Linux. Now its used by tracers, profilers, and then by eBPF, in libbpf, in the verifier and other parts of the kernel, being always available...

Make Linux developers fix your kernel bug

Pssst! Don’t tell anyone, but there is a rule that forces Linux developers to fix certain kind of kernel bugs. This is pretty strictly enforced by Linux creator and lead-developer Linus Torvalds himself, who occasionally even steps up to fix such problems himself. You...

New userspace API for display panel brightness-control

The current userspace API for brightness control offered by /sys/class/backlight devices has various problems: 1. There is no way to map the backlight device to a specific display-output / panel 2. On x86 there can be multiple firmware + direct-hw-access methods for...

Powerful and Programmable Kernel Debugging with drgn

Kernel bugs that sneak past testing into production tend to be tricky, convoluted, and hard to reproduce. When investigating such bugs, you often want to explore various data structures, look for patterns, and check your assumptions. After falling victim to some...