Arithmetic coding is a form of Entropy Coding used for Lossless Compression of data. It encodes an entire message as a single fractional number, representing probabilities of symbols more accurately than block codes, thus achieving higher compression ratios.