Transcript
oFy2927b8jQ • Judea Pearl: Correlation and Causation | AI Podcast Clips
/home/itcorpmy/itcorp.my.id/harry/yt_channel/out/lexfridman/.shards/text-0001.zst#text/0251_oFy2927b8jQ.txt
Kind: captions Language: en what is correlation what is it so probability of something happening is something but then there's a bunch of things happening and sometimes they happen together sometimes not they're independent or not so how do you think about correlation of things correlational kills when two things very together over very long time is one way of measuring it or when you have a bunch of variables that it was very quickly then recalled we have a correlation here and usually when we think about correlation we really think cosy things and cannot be called as unless there is a reason for them to vary together why should they vary together if they don't see each other why should they vary together so underlying it somewhere is causation yes hidden in our intuition D is a notion of causation because we cannot grasp any other logic except causation and how does conditional probability differ from causation so what is conditional probability conditional probability how things vary when one of them a stays the same now staying the same means that I have chosen to look only on those incidents where the guy has the same value as previous one it's my choice as an experimenter so things that are not calling it before could become correlated like for instance if I have two coins which are uncorrelated okay and I choose only those flipping experiments in which the bell rings and bell rings when it is one of them is it tailed then suddenly I see correlation between the two points because I only looked at the cases where the bell rang you see is my design with my ignorance essentially with my audacity to ignore certain incident I suddenly create any combination really doesn't think this physically right so that's you just outlined one of the flaws of observing the world and and trying to infer something from the math about the world looking at the correlation I don't look at the floor the world works like that which me but the flows comes if we try to impose causal logic on correlation it doesn't work too well I mean but that's exactly what we do that's what that's has been the majority of science is your reality of of naive science the decisions know it the decisions know it if you condition on a third variable and you can destroy or create correlations among two other variables they know it it's in your data right nothing surprising that's why they all dismiss the symptom paradox ah we know it you don't know anything about it well there's this disciplines like psychology where all the variables are hard to account for and so oftentimes there's a leap between correlation to causation your your leap who is trying to get causation from correlation not you're not proving causation but you're sort of discussing it and implying sort of hypothesizing without liability which discipline you have in mind I'll tell you if they are obsolete is they are outdated oh they're about to get outdated oh yes tell me which one is all psychology you know okay what is the ACM no no I was thinking of Applied Psychology studying uh for example we work with human behavior and semi autonomous vehicles how people behave and you have to conduct these studies of people driving cars everything start with the question what is the research question what is the research question the research question do people fall asleep when the car is driving itself do they fall asleep or do they tend to fall asleep more frequently more fickle and the car not drive lines not driving it's it's a good question okay and so you measure you put people in the car because it's real world you can't conduct an experiment where you control everything why can't you can you could do my automatic a module on and off because it's on Road public I mean there's yes it's a there's aspects to it it's unethical because it's testing on public roads so you can only use vehicle you they have to the people the drivers themselves have to make that choice themselves mmm-hmm and so they regulate that and so you just observe when they drive it and honestly when they don't and then maybe they turning off when they will very tired yeah that's kind of thing but you you don't know those there okay so that you have now uncontrolled uncontrolled experiment we recall it observational study yeah and we firm the correlation and detected that we have to infer causal relationship and whether it was the automatic peace it caused them to fall asleep oh so that is an issue that they about 120 years old yeah I should only go a hundred years old and well maybe it no I actually I should say it's 2,000 years old because we have this experiment by Daniel but the Babylonian king that wanted them the exiled people from Israel that were taken in in exile to babylon to serve the king he wanted to serve them King's food which was meat in Daniel as a good you couldn't eat a non-kosher food so he asked them to eat vegetarian food but the key overseer says I'm sorry but if the King see that your performance falls below that of other kids you know he's going to kill me then you said let's make an experiment let's take four of us from Jerusalem okay us vegetarian food let's take the other guys that to eat the King's food in about a week's time we'll test our performance and you know the answer of course he did the experiment and they were so much better than the others if the King's nominated them to super position in so it was a first experiment yes so today there was a very simple it's also the same research questions we want to know a vegetarian food assist or obstructing your mental ability and the question is very old even Democritus said if I could discover one cause of things I would rather discuss the one cause and be king of Persia did they task of discovering causes what's in the mind of ancient people from many many years ago but the mathematics of doing this was only developed in the 1920s so science has left us often okay science is not provided that with the mathematics to capture the idea of X causes Y and y does not cause X because all the question of physics are symmetrical algebraic the Equality sign goes both ways you