Haryo Akbarianto Wibowo

PhD Student @ MBZUAI

I work on making language models learn more efficiently: objective functions, knowledge distillation, and the data we train on. Here you can find my CV and my blog, where I write about deep learning, technical things I build, and sometimes just life.

CV

Know me better! My education, publications, experience, talks, and professional activities.

View CV

Blog

Deep learning deep dives, hands-on technical write-ups on applications, and sometimes just personal stuff.

Read the blog

Play Around with Distillation, Part 1: Forward vs. Reverse KL, On vs. Off Policy, and Hard vs. Soft!

What do forward and reverse KL, on- and off-policy, and hard and soft targets actually do? A casual, hands-on tour with toy problems, gentle proofs, and a demo where you can watch the student learn.