I write backend and systems software, mostly where it meets LLMs. Recently: a KV-cache manager for LLM inference modelled on PagedAttention and RadixAttention, a limit order book with an allocation-free hot path, an HNSW vector index written from the paper, and a load tester that measures time to first token and inter-token latency on LLM endpoints. I also ship a language-learning app on the App Store whose speaking practice runs on speech recognition, LLMs and text-to-speech.
When a tool I rely on breaks, I fix it upstream rather than work around it. These days that mostly means Ubuntu's first-boot and networking stack, cloud-init and netplan, where I also review other contributors' changes.
LLM inference, real-time audio, distributed systems, and getting software to speak Turkish properly.