Archived SPC products ?

[tom hanlon]

Stormtrack,

I am searching for archived SPC products, for example I would like every spc swody1 each version the first second and third that they deliver.

In addition I would like the Mesoscale discussions, all of them for each year.

And I would like the warnings and storm reports, all of them for each year.

It seems like the NCDC site is focused more on observed data rather than forecast data.

I know this is out there, I just need to track it down.

Any tips on who to contact, Private message me.

Any links to the sources, please reply.

I want to do some serious data crunching so I want whole year, or whole season datasets.

Thanks,

--
Tom Hanlon

 

[Jeff Snyder]

Go to the SPC website, and select the Product Archive on the left-side menu. You can then write a script to pull these automatically (i.e. write a script using, for example, 'wget' to download every graphic and text product for each date and produce issuance time). There used to be a series of ZIP files that contained each watch and outlook year by year, IIRC, but I don't see that link any more. EDIT: Apparently, I was thinking of a page that was very old. I found it here, but that is quite old.

Alternatively, you can click on the "Severe TStorm Events" link on the same left-side menu (under "Research"), which will bring you HERE.

 

[rdale]

You can get archives of just about any NWS text product at http://has.ncdc.noaa.gov

 

[tom hanlon]

You can get archives of just about any NWS text product at http://has.ncdc.noaa.gov

Rdale,

Thanks, I know the ncdc has this, but that text page has products per station. I can not find the archive of the SPC products.

Do you know who to contact at either the SPC or NCDC ? They have so much data, it is hard to sort it.

Thanks,
Tom Hanlon

 

[rdale]

Rdale,

Thanks, I know the ncdc has this, but that text page has products per station. I can not find the archive of the SPC products.

Station = KWNS, Product = ACUS0 and I just grabbed 10 from April 1-2 2003.

 

[tom hanlon]

Station = KWNS, Product = ACUS0 and I just grabbed 10 from April 1-2 2003.

Thanks,

Yes I can get any particular stations products. But what I want is the SPC SWODY1, in text format for a whole year.

So not per station data, I want SPC nationwide convective outlooks.

Thanks though, your posts are often very helpful.

By the way, I just got my hadoop certification and was looking on crunching some big data, this SPC swody1 experiment is just a test. Are you looking to crunch some big data ?

Text based data is appropriate, formatted in some way.

Basically I will take a "key" most likely the day/name of the product, and search for a term, or a region, or a probablity. All the same really, search the key for a block of text. Use that search result, true false other, to generate a new batch of key/values.

Should be fun, I know from past discussions that you know your way around gempak and other modelling tools, so perhaps you have an interesting project in mind ?

Send me a PM, if you do not want it public. My first run would be a sort of reports to SWODY1 outlooks.

I might also do a day2 to day1 variablity comparison.


EDIT:
Oops, I think I see the product, ACUS0 convective outlook, trying a batch download now..

--
Tom Hanlon

 

[rdale]

I'm not sure I follow... SPC is the only place that issues an SWODY1. So if you request all ACUS0 from KWNS then you get just the SWODY from KWNS (SPC.)