[600MRG] WSPRnet database

[Chris - KC0TKS]

Larry and others,

I am a Linux user and as is usually the case, there is a simple, command 
line solution built in to the OS for this problem.

As a test, I split September's WSPR spots into files of 200,000 lines 
each (approximately 1 day) and have them available for download at 
https://dl.dropboxusercontent.com/u/6231083/wspr%20csv.zip

This zip file is almost 100 meg. so make sure you have high-speed 
Internet (or a lot of time to kill!).

For those with Linux that want to do this themselves, the command I used 
was *split -dl 200000 xxxx.csv 09_14_csv *where xxxx.csv is the name of 
the large .csv file you want to split. It took about 10 seconds to 
complete on my old computer.

For those without Linux, send me an email and I will split whatever 
month you are interested in. I will split and post October when the 
month is over.

Please let me know if the split files unzip properly and open in your 
spreadsheet. Sorry, I was in a rush this morning and didn't take the 
time to figure out how to add the .csv extention to the files when they 
generated so you will have to either add it manually or right-click on 
the file you want to open and choose "open with" and pick Excel or 
whatever you want to open them with.

73,
Chris - KC0TKS


On 10/29/2014 12:07 PM, Larry wrote:
> The 630 propagation over the last couple months has interested me 
> quite a bit. I decided to do some analysis using the spot database 
> that can be downloaded from WSPRnet.
>
> Unfortunately the monthly CSV data files are now up to over 6 million 
> spots each. None of the database tools I have available and know how 
> to use will handle that size file.
>
> At one time I think I remember being smart enough to write a script 
> that would parse the data and create a useable file but that was 
> decades ago and the old brain just ain't what it used to be.
>
> Has anyone out there solved this problem? Any suggestions? Best 
> solution would be an existing tool that would do the job.
>
> Searching the WSPRnet forums and Google has not helped.
>
> Larry - W7IUV / WH2XGP
>
> _______________________________________________
> 600MRG mailing list
> 600MRG at w7ekb.com
> http://w7ekb.com/mailman/listinfo/600mrg_w7ekb.com