Intuitive Explanation of Effective Sample Size in Importance SamplingImportance Sampling is a widely used technique in machine learning algorithms. For example, nearly all policy gradient methods rely on…Feb 28, 2021Feb 28, 2021
A Brief Introduction for Reinforcement LearningThis post is based on the material I prepare for a learning session in my department. I have also made a slide and recorded video, but I…Feb 9, 2021Feb 9, 2021
Explain Selection Bias in Online Experiment with PythonRecently, I read an article [1] about selection bias in online a/b tests, which describes a simple but intriguing phenomenon, i.e., app…Jan 17, 2021Jan 17, 2021
Lecture Notes — How to Write a Great Research PaperRecently, I have watched a lecture on youtube about the practice of writing a good research paper. I find this video very useful; here I…Jan 3, 2021Jan 3, 2021
Learn AI Game Playing Algorithm Part III — Counterfactual Regret MinimizationIn Post I and II, I have introduced some basics of AI game-playing algorithms, and Monte Carlo Tree Search (MCTS) [1], a popular algorithm…Dec 26, 20201Dec 26, 20201
Learn AI Game Playing Algorithm Part II — Monte Carlo Tree SearchIn the last post, I introduce some background knowledge for game ai, namely, game representation, game categorization, and three important…Dec 21, 2020Dec 21, 2020
Learn AI Game Playing Algorithm Part I — Game BasicsGame AI has always been a popular field with many impressive achievements. Next, I will start writing a series of three posts, talking…Dec 11, 2020Dec 11, 2020
Dive into Latent Dirichlet Allocation· Introduction · Key Questions to Understand LDA ∘ Why Dirichlet Distribution? ∘ Why is Exact Inference intractable? ∘ How…Nov 13, 2020Nov 13, 2020
Rigging the Lottery Making All Tickets WinnersRigging the Lottery: Making All Tickets Winners [Supplemental] ICML 2020Oct 21, 2020Oct 21, 2020
