The higher you get in the atmosphere the cooler the temperature will be. The reason it's actually colder is because, as you go up in the atmosphere, the Earth's atmosphere feels less pressure the higher up you go. So as the gas in the atmosphere rises it feels less pressure, which makes it expand.
