Gathering data to make visible the invisible (by Diego Fdez-Sevilla)
Those who work and have experience in research know very well how tedious is the process of gathering data. When I was doing studies on aerobiological processess I started spending many hours in a microscope identifying and counting pollen grains just to create tables with numbers. Then you take those numbers and create charts. Not enough, you then go to statistics and build more tables introducing more variables such as humidity, wind speed and temperature and start playing analyses which might backup any theory your brain manage to generate. If you can do that, you feel joy.
But numbers are so abstract that many times your brain demands images that bring sense to your numbers. More than that, numbers, by themselves, only give you answer to those questions that your knowledge is able to manufacture. But, what happens when you look at your data but your brain does not find questions? It is like having a toy designed to only play one game. So, either you make a different toy, find different data, to play a different game or you become a children applying imagination to explore what else could you make out of your toy, your data, by braking the rules established. Many discoveries come from boredom, from playing with data breaking the rules of established patterns of thought.
Here is where the technology can play a nice part. I am looking at atmospheric behaviour and in order to perform some statistical analyses I need data. The most comprehensible data available in the open access format and with visual representation that I have found is at the Nullschool.net web site. A graphic representation of atmospheric variables that I have used in previous posts trying to apply images with my thoughts showing data from GFS / NCEP / US National Weather Service.
But also with the images displayed in this platform, you can consult data by clicking over the image. Applying this method, you can retrieve data and create your own data set. This is a very time consuming process and you have to do it without stopping in order to build your data set in the closest possible time lapse, from beginning to the end, because the data displayed changes every three hours. And that is what I have done. I have taken the time to retrieve data of temperature and wind speed for all crossing points in the grid between latitude and longitude in lapses of 10 degrees. It took around 2 hours and some…
As I pointed out earlier, this is not the most effective way to gain data. May be somebody out there could help me here. Do you know where or how could I obtain some data?
I am looking for atmospheric data:
– for the global globe – in the form of latitude/longitude (I don´t need high definition.) – for several altitudes (e.g. 1000 hPa, 500 hPa, 250, 70hPa and 10 hPa) – and parameters such as daily mean Temperature, Pressure and wind speed.
I am searching for data covering a complete planetary cycle beginning and ending in summer so I could look at the full development of winter. One ideal year data would cover from 2013 summer to 2014 summer just to try some ideas.
I have tried to find this kind of data, and in a format compatible with excel, looking into the NOAA’s website and I have arrived at The Global Forecast System (GFS) http://www.nco.ncep.noaa.gov/pmb/products/gfs/#GFS. And yet I am not able to find a file that would contain the data I am looking for, or even a file in the format that would allow me to open it with basic office package. Has any body any idea that could help me out?
I believe I have being a good kid this year (it sounds like the other 40 years before, I know, but this time it is true) so, I would like to ask you for Christmas, if you wouldn´t mind, to talk about my situation, as job seeker, with some of those other researchers, CEOs and department directors around the world while you deliver your presents. You know, you could tell them that I am a hard working and skilful man looking for resources and an opportunity. Thanks Santa.
Merry Christmas everybody!
You will find more visuals that I have made from this platform in the following posts
- Biological Productivity, Amazonia and Atmospheric Circulation. (by Diego Fdez-Sevilla) December 22, 2014
- Climate and Weather Development. Spot the differences between the pictures. (by Diego Fdez-Sevilla) December 15, 2014
- (Updated 1/Dec/2014) State of the Polar Vortex. Broken? 29 Nov 2014 (by Diego Fdez-Sevilla) November 29, 2014
- The Polar Vortex breaks again in the North Hemisphere 22 Nov 2014. (by Diego Fdez-Sevilla) November 22, 2014
- Why there is no need for the Polar Vortex to break in order to have a wobbling Jet Stream and polar weather? (by Diego Fdez-Sevilla) November 14, 2014
- (Updated 22/Dec/14) New theory proposal to assess possible changes in Atmospheric Circulation (by Diego Fdez-Sevilla) October 21, 2014
- Revisiting the theory of “Facing a decrease in the differential gradients of energy in atmospheric circulation” by Diego Fdez-Sevilla. February 10, 2015
- Meteorological Outlook Feb 2015 (by Diego Fdez-Sevilla) February 7, 2015
- 3D representation of the atmospheric pressure at sea level affecting Europe from today 30th January 2015 (by Diego Fdez-Sevilla) January 30, 2015
- Reality check (by Diego Fdez-Sevilla) January 30, 2015
- The origin of the Storm “Juno” 27 Jan 2015 (by Diego Fdez-Sevilla) January 28, 2015
- 3D representation of the atmospheric pressure at sea level for the North Hemisphere for today 23 January 2015 (by Diego Fdez-Sevilla) January 23, 2015
- Probability in the atmospheric circulation dictating the Weather (by Diego Fdez-Sevilla) January 15, 2015
- 2014 in review. One year trying to “Fill in” or “Find out” gaps of knowledge. (by Diego Fdez-Sevilla) January 5, 2015