Alibek JakupovMay 6, 20192 minInformation Theory: Step 5 Error controlHere's the 5th step of our introduction to the Information Theory. In this article we are going to cover the techniques that enable...
Alibek JakupovApr 29, 20192 minInformation Theory: Step 3 Huffman AlgorithmPrefix codes Prefix codes (sometimes called "prefix-free codes“) is a type of code system (typically a variable-length code)...
Alibek JakupovApr 29, 20191 minInformation Theory: Step 2 EntropyThis is the second article from the series of short articles devoted to the Information Theory. Conditional Entropy Conditional entropy...
Alibek JakupovApr 29, 20193 minInformation Theory: Step 1 ProbabilityIntroduction This article is the first part of a series of articles devoted to the study of the Information Theory, step by step. In this...