Minh-Thien Nguyen

Blog

2024

  1. 6 min readLLM

    Pre-training GPT2, BERT and BART

    How the GPT2, BERT, and BART models were pre-trained on Vietnamese text, with the hyperparameters and the results each one reached.

2023

  1. 2 min readAlgorithms

    Examples of using bit compression

    Examples of using bit compression

  2. 3 min readAlgorithms

    Parallel Binary Search

    A technique that answers many binary-searchable queries at once, sharing the intermediate data instead of rebuilding it for each query.

  3. 3 min readAlgorithms

    Auxiliary Tree/Virtual Tree

    A technique for answering queries over a subset of a tree's vertices.

2022

  1. 4 min readAlgorithms

    XOR Basis

    Introduces the xor basis technique — representing integers as vectors in a binary vector space and using the space's basis to solve problems about the xor of subarrays of an array.