Have you seen Connelly and Connelly’s papers on screen temps across China USA Ireland.. also Bill Johnston at Bomwatch.com.au provides a good look at station site changes effect on rainfall and max temps ..
I start with a decent cafetière of Colombian and treat myself to four squares of flapjack before grumbling about the crazy coding they've adopted! If I'm importing the CSV directly into SPSS it sets them as system missing. Importing into Excel is the pain and for this I use the find & replace function, which rips through them like a hot knife through butter. If you want a copy of my efforts for all 37 stations in xls format I'm happy to pop you a link, though you'd need to update the file when the August data becomes available.
Wowie! Scripting is deffo not my thing despite being a Fortran 77 bod back in the day. I've not had a glimpse of their ftp server as yet so can't comment on convention and coding.
One of the issues with many temperature data-sets is the corrections that have been applied to the quoted values. The 'very handy resource' that you link to does not state whether the values are 'raw' or 'corrected'. Does the Met Office publish the data anywhere such that we can see and compare what was originally recorded versus what appears in their table?
Have you seen Connelly and Connelly’s papers on screen temps across China USA Ireland.. also Bill Johnston at Bomwatch.com.au provides a good look at station site changes effect on rainfall and max temps ..
Not yet!
How do you deal with the “—-“ missing data entries?
And when the weather gets lousy and keeps me indoors I might have a go a batch scooping the big data with Python or something.
I start with a decent cafetière of Colombian and treat myself to four squares of flapjack before grumbling about the crazy coding they've adopted! If I'm importing the CSV directly into SPSS it sets them as system missing. Importing into Excel is the pain and for this I use the find & replace function, which rips through them like a hot knife through butter. If you want a copy of my efforts for all 37 stations in xls format I'm happy to pop you a link, though you'd need to update the file when the August data becomes available.
thanks - I'll do some cross-checking in due course
Could probably write a script to download all the MIDAS data in one go, assuming some logic to their naming convention..
Wowie! Scripting is deffo not my thing despite being a Fortran 77 bod back in the day. I've not had a glimpse of their ftp server as yet so can't comment on convention and coding.
One of the issues with many temperature data-sets is the corrections that have been applied to the quoted values. The 'very handy resource' that you link to does not state whether the values are 'raw' or 'corrected'. Does the Met Office publish the data anywhere such that we can see and compare what was originally recorded versus what appears in their table?
Absolutely so. As far as I am aware these are raw readings but you can check them against data held in MIDAS...
https://catalogue.ceda.ac.uk/uuid/dbd451271eb04662beade68da43546e1
Back in August I checked my own temp data against those for a station a few miles from me, a summary of which can be found in this newsletter...
https://jdeeclimate.substack.com/p/my-garden-part-3