Photo of Haryo Akbarianto Wibowo
Haryo Akbarianto Wibowo
PhD Student @ MBZUAI
Research Interests
🤖
Learning Efficiency
Objective Functions, Curriculum Learning, Knowledge Distillation, Model Compression
👁️
Explainability
Interpretability in Efficiency, Model Understanding
📝
Data
Data Building and Selection For Training and Evaluation

About Me

I am a PhD student in Natural Language Processing (NLP) at Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), supervised by Dr. Alham Fikri Aji and Prof. Thamar Solorio.

Before my PhD, I had an opportunity to work in industry and do some projects as a Software Engineer, gaining skill in full-stack development and DevOps. Consequently, I can bridge the gap between theoretical advances and practical implementations.

I have experience in text style transfer, efficiency, and data construction, with current interests focusing on efficiency, data, and explainability in NLP, specifically:

  • How to improve model learning? (e.g., curriculum learning, knowledge distillation, and creating novel objective functions)
  • How do models learn effectively, and what do they learn? (Interpretability)
  • What data should be used to enhance model performance (e.g., data selection and synthesis), and how can we create robust and holistic evaluation datasets to assess models (data creation)?

Education

Aug 2023 - Current

Ph.D. in Natural Language Processing

MBZUAI Abu Dhabi, UAE

  • Supervisor: Alham Fikri Aji (main supervisor) and Thamar Solorio (secondary supervisor)
  • Published 2 papers: COPAL-ID and The Priviledge Students.
2013 - 2017

Bachelor in Computer Science

University of Indonesia Depok, Indonesia

Publications

✨ Featured

The Privileged Students: On the Value of Initialization in Multilingual Knowledge Distillation

Haryo Akbarianto Wibowo, Alham Fikri Aji, Thamar Solorio

Arxiv-2024

✨ Featured

COPAL-ID: Indonesian language reasoning with local culture and nuances

Haryo Akbarianto Wibowo, Erland Hilman Fuadi, Made Nindyatama Nityasya, Radityo Eko Prasojo, Alham Fikri Aji

NAACL-2024

WORLDCUISINES: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines

Genta Indra Winata, Frederikus Hudi, Patrick Amadeus Irawan, David Anugraha, Rifki Afina Putri, Yutong Wang, ..., Haryo Akbarianto Wibowo, ..., David Ifeoluwa Adelani, En-Shiun Annie Lee, Shogo Okada, Ayu Purwarianti, Alham Fikri Aji, Taro Watanabe, Derry Tanti Wijaya, Alice Oh, Chong-Wah Ngo

Arxiv-2024

CVQA: Culturally-diverse multilingual visual question answering benchmark

David Romero, Chenyang Lyu, Haryo Akbarianto Wibowo, Teresa Lynn, Injy Hamed, ..., Oana Ignat, Joan Nwatu, Rada Mihalcea, Thamar Solorio, Alham Fikri Aji

Neurips-2024

NusaCrowd: Open source initiative for Indonesian NLP resources

Samuel Cahyawijaya, Holy Lovenia, Alham Fikri Aji, Genta Winata, Bryan Wilie, Fajri Koto, Rahmad Mahendra, Christian Wibisono, ..., Haryo Akbarianto Wibowo, ..., Graham Neubig, Timothy Baldwin, Sebastian Ruder, Pascale Fung, Herry Sujaini, Sakriani Sakti, Ayu Purwarianti

NAACL-2024

On `scientific debt` in nlp: A case for more rigour in language model pre-training research

Made Nindyatama Nityasya, Haryo Akbarianto Wibowo, Alham Fikri Aji, Genta Indra Winata, Radityo Eko Prasojo, Phil Blunsom, Adhiguna Kuncoro

ACL-2023

Which student is best? a comprehensive knowledge distillation exam for task-specific bert models

Made Nindyatama Nityasya, Haryo Akbarianto Wibowo, Rendi Chevi, Radityo Eko Prasojo, Alham Fikri Aji

Arxiv-2022

Indocollex: A testbed for morphological transformation of indonesian word colloquialism

Haryo Akbarianto Wibowo, Made Nindyatama Nityasya, Afra Feyza Akyürek, Suci Fitriany, Alham Fikri Aji, Radityo Eko Prasojo, Derry Tanti Wijaya

ACL-IJCNLP-2021

Costs to consider in adopting NLP for your business

Made Nindyatama Nityasya, Haryo Akbarianto Wibowo, Radityo Eko Prasojo, Alham Fikri Aji

Arxiv-2020

Semi-supervised low-resource style transfer of indonesian informal to formal language with iterative forward-translation

Haryo Akbarianto Wibowo, Tatag Aziz Prawiro, Muhammad Ihsan, Alham Fikri Aji, Radityo Eko Prasojo, Rahmad Mahendra, Suci Fitriany

IALP-2020

Experience

Jun 2024 - Dec 2024

Research Scientist Intern

NICT- 情報通信研究機構 Kyoto, Japan

  • Working to research Model Efficiency in NLP
May 2019 - Feb 2022

Senior AI Research Scientist

Kata.ai Jakarta, Indonesia

  • Topic: Indonesian NLP and Text Style Transfer
  • Researched tackling colloquial and style transfer problems (Published two papers)
  • Developed a text data synthesis for chatbot builder.
  • Won first place at a shared task on Social Media Mining for Health (SMM4H) 2021 shared task (ACL)
  • Researched Image Retrieval.
  • Researched Model Compression Technique in NLP.
Jan 2019 - Mar 2019

AI Software Engineer

Deligence.ai Jakarta, Indonesia

  • Developed an object detection model for identifying the car's category.
Jan 2017 - Jan 2018

Research & Teaching Assistant

Fasilkom UI Depok, Indonesia

  • Worked as a Teaching Assistant in the Faculty of the Computer Science University of Indonesia. Courses that I assisted: Artificial Intelligence, Data Mining, Data Science and Analytics, Design and Analytic Algorithm, Data Mining and Business Intelligence, and Math I.
  • Researched Crosslingual Word Sense Disambiguation and E-commerce attribute dataset. Published two papers as a result.

Professional Activities

Reviewers

ACL

Reviewed papers in ARR, SEALP, COLM, and COLING.

2023-Current

Talks

Indonesian Language Reasoning With Local Culture

Bridging the Cultural Divide in AI: Analyzing Fairness, Bias, and Transparency across Cultures (MBZUAI)

2024Abu Dhabi, UAE

Q2AI: A Quick Course to Quick AI

PRICAI Tutorial - Main Instructor

2023Jakarta, Indonesia

Retrieval Systems in the Wild - Two Use Cases

Guest lecture at Universitas Indonesia

2022Depok, Indonesia

Machine Learning for Text - Things I wish I knew in my College Life

Guest lecture at Universitas Indonesia

2021Depok, Indonesia