NoverTube for Nova

But what is cross-entropy? | Compression is Intelligence Part 2

3 3Blue1Brown Math & Science 33:51 6 views

Report this video

Tell Dad’s helper why — sexual, scary, weird, or just “not for me.”

About this video

This video explains how computers learn to understand language using something called cross-entropy. It also talks about how compression can help us understand how languages are related.

#math#science#coding#language

🧠 Quiz & Trivia

Test your knowledge after watching!

Q1 What is the name of the algorithm used to compress files?

Answer: gzip

Q2 What kind of tree can be built using language compression?

Answer: A tree showing how languages are related

Q3 What does cross-entropy help us measure?

Answer: How similar two pieces of text are

Comments (0)

No comments yet — be the first!