Live Tropical Data & NHC Forecast Models - SrcCode

Showing 21-194 of 194 messages
Live Tropical Data & NHC Forecast Models - SrcCode pseabury 7/24/05 5:24 PM
Update :
Quote:

Also, I've already used a couple of gigs of bandwidth this month....I have plenty to go around, but would rather folks update their links to the KMZ from the KML as the KML accounts for about 60% of my bandwidth. I've seen an issue where some versions of the client doesn't like the KMZ (no subfolders show up), but if your's works with KMZ please switch. Again, the data in both is identical, KMZ is just compressed.

Link to KMZ

<a href="" target="_blank">Link to KML Removed</a>



This link kind of goes along with some of my previous work in this thread . I've written an app that pulls the lastest forecast tracks and predicted strength for tropical named storms (Depression, Storm, Hurricane) from the National Hurricane Center, and then writes the kml that represents the data. This link isn't as dynamic as I'd like, as the NHC only puts out a new forecast every 6 hrs or so, but it's the best I could do so far. It should be pretty cool to look at when we have a few storms roaring. I've also not tested it exhaustively, so my app may break if it encounters data outside the format that I expect. I would guess that I may run into 1 or 2 of these as the format that they provide isn't optimal for parsing. I wish they'd just put out a comma-separated list, but I guess beggars can't be choosers. The app is designed to fail gracefully though, so should it fail to write new output for some reason, the last good data should be available until the problem gets fixed.

The only thing I ask is that you not hammer my server by setting it to update every 1 second or whatever for two reasons. First, the link itself is not from home (actually on a decent server), but I'd still rather not drive up my bandwidth usage. Second, the data will only update every 6 hrs or so, so the 10 minute default refresh should do just fine. Enjoy.

[EDIT] - Forgot the screenshot. Just as I was taking the screenshot, NHC added Franklin back into the data. Kinda cool that it worked as planned.

[EDIT] - Fixed the link to the network link in the original post. Sorry about that!



Paul
Re: NHC Track Forecast Models troxy18 7/24/05 6:31 PM
Good use of information, looks pretty neat if you include a cloud overlay underneath or weather radar to make it look better. Like this
Re: NHC Track Forecast Models pseabury 7/24/05 6:40 PM
Definitely Troxy. I think I could integrate boatloads of other tropical data along with the forecast tracks. I'm not sure I want to force that on everyone or bloat the kml with it though. Depends on the response I guess. If that's what people want, I can surely do it fairly easily. I guess the layers that a user doesn't want can be turned off by them eh? I think you just talked me into it...now lets see how much time I have after work this week....might have to wait until the weekend for the "Tropical Portfolio".

Paul
_________________________
There are 10 kinds of people in this world... those that understand binary, and those that don't.
Re: NHC Track Forecast Models troxy18 7/24/05 6:53 PM
Or you could post a link to the original posting for the sat weather image I used that way people could see how different layers and overlays in google earth work together. Just think of the possibilities
Re: NHC Track Forecast Models Emoshape 7/25/05 6:56 AM
very good job !!
Re: NHC Track Forecast Models Mike_in_Florida 7/25/05 9:44 AM
Sounds great! Living in Florida this is very useful!
Thanks for working on it...
_________________________
Re: NHC Track Forecast Models pseabury 7/25/05 10:48 AM
No problem, I enjoy doing this sort of stuff. I'll likely keep improving it, but since it's a network link, that should be transparent to those using it.
Re: NHC Track Forecast Models SoFlaChris 7/25/05 3:20 PM
Very slick... Thanks for taking the time to share this! Any chance that the model source name could be added to each run? (GFDL, BAMD. etc?)

TIA,
Chris
Re: NHC Track Forecast Models pseabury 7/25/05 6:06 PM
Currently that info IS in the data. You can expand "NHC Models" entry on your places menu and there will be a folder for each storm in the current report. You can then expand each storm's folder and see that each model has its own folder as well. Also, single clicking on a point in the track lines will bring up the info for that particular point, Including the model name. Single Clicking on the white point (the last real, not forecast, location) will bring up the raw Initial Conditions report for that storm.

Right now I'm currently working on adding a Sea Surface Temperature (SST) overlay from the raw satellite data. I'm taking the .25x.25 degree points from the GRIB (Gridded Binary) files, converting the raw data to a temperature C, and then creating an image from it. It's a lot of work, but I can control how it's drawn with a lot more granularity. I'll add this to the network feed once it's done and stable.

Regards,

Paul
Re: NHC Track Forecast Models TheSHAD0W 7/25/05 6:09 PM
If you do decide to integrate an overlay, I've attached the one I'd recommend you use. Maybe you should produce two versions, one that includes an overlay and one that doesn't.

I'd also like to suggest (at least with this overlay) you increase the line width to make things easier to see.
Re: NHC Track Forecast Models pseabury 7/25/05 6:13 PM
Your attached overlay looks like an Infrared of the atlantic/caribbean. I intend to eventually include a plethora of data, all related to tropical activity, to this feed. I'm just doing it one step at a time. I'll look at the source of that overlay data and see if I can find a higher resolution one before I include it. Not that it loks bad, but I'm going to try to include the highest res stuff for all the data in the link. Thanks for your input...hopefully towards the end of this week there'll be LOTS more to this link.


[EDIT] - Also keep in mind that I mean highest resolution both spatially and temporally.

Paully
Re: NHC Track Forecast Models SoFlaChris 7/25/05 7:30 PM
DOH... I should have thought to open the folder! This is great. Keep it coming.
_________________________
chris :: wired
Re: NHC Track Forecast Models pseabury 7/25/05 7:33 PM
No Problem at all. If people don't typically expand their placemarks, then I should provide some other indication...maybe a legend like my other hurricane display has. That's the kind of stuff I'm trying to find out from people that post. Thanks Chris.

Paul
Re: NHC Track Forecast Models CapeVerde 7/26/05 1:16 PM
Most excellent! Some of us weatherbugs living on the coast will be using this layer a lot. Thanks!
Re: NHC Track Forecast Models pseabury 7/26/05 4:03 PM
Thanks CapeVerde, much appreciated.

I just updated the link slightly. Now the generated KML makes the placemarks and lines with an altitude, to prevent the lines from dissapearing into the ocean/land when the distance between points in very far. I didn't want to make the lines relative to ground in case they passed over a bump in elevation. It still may not be perfect, but it's at least better. I also made the lines 1 pixel thicker and scaled up the point graphics slightly.

BTW, I was talking to a meteorologist about the format of the data, as well as the storms named "Invest". I thought they were bogus, but he assured me that "Invest" is typically a name given to a storm in the preliminary stages of tracking it. I suppose they don't want to waste a name from the list on a storm of this nature, but then again, they want to give it a name. There may be more to it than that, but that's what I know about it.

Paul
Re: NHC Track Forecast Models LynnA 7/26/05 5:01 PM
You guys (and GE) are amazing. I'm a newbie but a huge tropical weather enthusiast and this is so helpful.

I notice when I import the links in GE they end up in temporary places. Shouldn't they be overlays?

Thanks for all of your hard work.

Lynn
Re: NHC Track Forecast Models pseabury 7/26/05 5:27 PM
Lynn,

You can just Drag and Drop the Placemark(Folder, whatever) to your "My Places" tree. Then you can save it manually, or when GE exits it will ask you to save if you haven't already.

Paul
Re: NHC Track Forecast Models CapeVerde 7/27/05 5:54 AM
The Invest storms are far from bogus. They are tropical waves that appear to have the potential to develop into tropical depressions, storms, or hurricanes.

Avid weatherwatchers follow them closely, as does the the National Hurricane Center. An Invest is something they spend time and manpower investigating with flights to gather atmospheric conditions.

A new Invest, 93L, was identified last night, and the huge wave coming off Africa right now is almost certain to become Invest 94L within a day or two.

They don't actually give a storm a name until it reaches tropical storm status. It has to be identified as a tropical depression before that and just given a different number. If Invest 92L becomes a tropical depression, it will be called TD8.

Being able to track these Invests on Earth Google thanks to your work is just awesome, in my opinion.

CV
Re: NHC Track Forecast Models pseabury 7/27/05 6:34 AM
Thanks CV......it was pretty cool to get up this morning and see two new "Invests" steaming westward in the tropical atlantic. I'm still working on the raw SST, but be patient...I'll get it soon enough.

Paul
Re: NHC Track Forecast Models CapeVerde 7/27/05 8:12 AM
In addition to your layer, I've downloaded a layer for global satellite infrared radar which depicts cloud temperatures (colder meaning bigger and more stormy). I got it here:Global Infrared Satellite Images

The combination of your layer with this makes an excellent way of tracking storms and their intensity.

When you develop your SST layer, it's going to be an incredibly valuable tool in predicting increases in storm intensity.


CV
Re: NHC Track Forecast Models pseabury 7/27/05 9:04 AM
That is a nice IR layer. I changed some of the overlays to auto update, but other than that kept it as is. Looks good, and thanks.
Re: NHC Track Forecast Models pseabury 7/29/05 4:43 PM
First cut at SST is done. I haven't added it to the link yet because I've got to run for a couple hours and want to debug/polish it up a bit. Parsing those gribbed RAW data files isn't difficult per se, but it does make you want to kill byte arrays. Look for it to automatically be added either tonight ir tomorrow morning when your link refreshes. Here's a screenshot of the Alpha...
Re: NHC Track Forecast Models LynnA 7/29/05 7:14 PM
Thanks. Appreciate the tip. I'm starting to get the hang of it. Unfortunately, I am now having fetching errors when the NHC tracks update. I'll figure it out yet with the help of you great people!

Again, thanks,
Lynn
Re: NHC Track Forecast Models pseabury 7/29/05 7:50 PM
Lynn,

You may be getting fetch errors because I'm working on it. I'm sorry about that. If the kml is bad on a refresh, it should be fixed by the next timed update (10 mins I think). At least tonight, and probably at certain times tmw, you may get this same error. Hopefully it will be worth the fetch errors once I quit editing it.
Re: NHC Track Forecast Models LynnA 7/29/05 7:53 PM
Thanks for letting me know. I thought it was my computer or something I was doing wrong. Keep up the great work!!!

Lynn

PS Is the Invest data missing because you are working on it as well?
Re: NHC Track Forecast Models pseabury 7/29/05 8:27 PM
The track models (including Invest) aren't put out by the NHC in the most reliable format. For instance.....the main reports that they put out are at 00Z, 06Z, 12Z, and 18Z. Four times per day, 6 hrs apart. Unfortunately, right now I only check for the latest one of those 4 reports. They also put out intermediate reports at say 01Z, 07Z, maybe 11Z, etc. . I'm not sure why they do this, other than the models for a particular storm may not be ready yet. In any case, the way I coded by client was the check for the very latest file by timestamp (the youngest file), the check to see if it one of the {00,06,12,18) set. If it isn't, then I check the next oldest file until I find one that falls into the (00,06,12,18) set so that I have the "official" report. The problem is that sometimes the official 6hr ones don't get updated with the proper information, they just put out one of those intermediate files. So to maybe make it a little more clear (I tend to ramble) here's a typical situation if say we are tracking 3 storms(2 invests, and 1 proper named):

00Z - Invest1, Invest2, Franklin
06Z - Invest2, Franklin
07Z - invest1
12Z - Invest1, Invest2, Franklin
18Z - Invest1, Invest2, Franklin
00Z - Invest1, Franklin
01Z - Invest2


So you can see that sometimes all of the storms aren't included in a single 6hr report. I will be working on this problem tomorrow. Odds are that if you're missing a storm that you think should be there, it will be there upon the next update.

On another note, I've upped the resolution of the SST overlays DRAMATICALLY and they look great now.....I'm going to try and get the Tropical Atlantic built into the feed tonight.

Regards,

Paul
Re: NHC Track Forecast Models pseabury 7/29/05 10:47 PM
Ok, the first cut at the SST data is now in the Network Link. If you just let the link refresh, the SST data should show up. It's very late, so there may be bugs, but I'm sure I'll hear from you if there are. You can see the improvement in resolution in the screenshot below when compared to the screenshot above. I did have some problems with GE complaining about the image format, but that just magically dissapeared....at least for me. Let me know.

_________________________
There are 10 kinds of people in this world... those that understand binary, and those that don't.
Re: NHC Track Forecast Models LynnA 7/30/05 1:56 PM
Paul:

Thanks so much. I know there are quite a few of us at Storm2K (weather board) who are using this product and we really appreciate all the work you are puttiing into it! Great job.

Lynn
Re: NHC Track Forecast Models pseabury 7/30/05 4:00 PM
No problem at all. I enjoy solving interesting problems. I'm looking for fairly high-res Visible, Infrared, and Water Vapor imagery now to add to this dataset. It'd be nice if it was geocoded or GRIBBed so that it fits nice and snug without hand fitting it. If anyone has any suggestions please let me know. Also, I do have the capability to easily add more sections of SST if anyone wants it.....I have the raw data for the entire globe, and I wrote a routine to generate bitmaps on the fly from input coordinates....so it's rather easy. Just let me know.

Paul
Re: NHC Track Forecast Models rodziolkow 7/30/05 9:53 PM
Very impressive! It is cool to see how you and pseabury collaborated to make layers that combine to present a very powerful image. Great work!
Re: Tropical Data and NHC Storm Forecast Models Bamastormchaser 7/30/05 10:03 PM
Very nice. Is there any way you can add more data feeds into the selection? Just curious.
_________________________
Joseph B. Adair www.hardcoreweather.com Mississippi State Meteorology Student WBRC-FOX 6 Storm Chaser
Re: Tropical Data and NHC Storm Forecast Models pseabury 7/31/05 8:58 AM
Absolutely, just let me know what you are looking for and I'll definitely look into integrating it. I was looking at wind shear and vorticity overlays yesterday, but wasn't sure how many people may be interested in that. I don't want to add unneccessary things that just clutter up the display and network link, but I DO want things that are helpful in providing one-stop shopping for the tropical watchdogs.

Paul
Re: Tropical Data and NHC Storm Forecast Models Bamastormchaser 7/31/05 9:20 AM
Thanks Paul! I am interested in the wind shear/wind shear tendancy maps. You can take a look here at alot of cool stuff to integrate....

http://www.hurricanehollow.org/

Thanks!
Re: Tropical Data and NHC Storm Forecast Models pseabury 7/31/05 9:33 AM
Yes, those are the exact images I was testing out yesterday from http://cimss.ssec.wisc.edu . Not the best resolution, but as long as they aren't floaters, then we can use them. I'd also really like to lose the lat/lon lines in the images to make it look cleaner, but that's all I've found so far. I've got some stuff to do today outside the house, so I may not get to it until tonight or tomorrow, but keep an eye out for the next interation of the link.

Also, sorry if some of you had problems with the link and/or images last night through this morning. I was running the debug version of my program that builds the images and kml which wasn't the latest build. I had only rebuilt the release version with the latest changes. Anyway, it should be popping out the latest stuff now. I'll keep you posted.
Re: Tropical Data and NHC Storm Forecast Models Bamastormchaser 7/31/05 9:41 AM
Updating fine here, Paul. Now, we need to find a way to integrate NHC watches/warnings into the program the way you have done with the models. Also when we get storms, a forecast cone would be SWEET! Heck, you could take out lots of other software with some additions like this! Keep up the good work.
Re: Tropical Data and NHC Storm Forecast Models SoFlaChris 7/31/05 12:22 PM
Hi Paul,

Where is the latest placemark? Is it still in the first post?

TIA,
Chris
_________________________
chris :: wired
Re: Tropical Data and NHC Storm Forecast Models pseabury 7/31/05 12:54 PM
Yessir....the network link in the original post will always get the latest stuff. I'm about to add some more imagery, and fix the problem where not all storms are included (read thread for details on this problem). If your GE Client complains about this network link, the reason is because I'm working on it. Please bear with me.
Re: Tropical Data and NHC Storm Forecast Models SoFlaChris 7/31/05 3:10 PM
Thanks, Paul. You're a peach...
_________________________
chris :: wired
Re: Tropical Data and NHC Storm Forecast Models pseabury 7/31/05 5:23 PM
Ok, I've added some satellite views (IR, Enhanced IR, and Water Vapor) to the link. I've also changed the fetch logic in my program to do more than naively check the 00Z, 06Z, 12Z, and 18Z reports from NHC. It will check the latest 5 reports, and add all unique Atlantic storms from those reports (hopefully). I've had very little time to debug it, so I may run into a report that gives me a problem. Probably an empty one will do that......we'll have to see. Let me know if anyone has problems. I'll add the analyses imagery as soon as I have the time (wind shear, vorticity, etc).

Paully
Re: Tropical Data and NHC Storm Forecast Models pseabury 8/1/05 5:57 PM
Added a legend for Sea Surface Temperature (SST). Also set default refreshVisibility for the link to off....that means that it should remember which layers you had turned on or off even when it refreshes. I think you need to re-download the link from the first post in this thread for that last change to take effect. Enjoy.


[EDIT] - Yes, please delete your old link and download the new one from the first post in this thread. Usually changes won't require this, but I actually changed some attributes/elements of the network link, so it is necessary.

I've also added the small portion of SST coverage near Long Island that was missing before. In addition to that, I put some various analyses into the link like wind shear, convergence, divergence, vorticity, etc. that many of you were asking for. I think it's pretty useful now. As always, tell me what else you want/need and I'll do my best to add it.



Paul
Re: Tropical Data and NHC Storm Forecast Models pseabury 8/2/05 8:25 PM
Changes:

1.) Added new SST Overlay - Contoured SST. This one has less temperature resolution than the smooth one so that you can see the variation a little better. By default it's off and the Smooth one is on. Smooth one still looks nicer in my opinion.

2.) Fixed a logic error in the Storm model inclusion to fix the problem where old storms were still showing up. For instance, Invest(AL922005) was upgraded to Tropical depression Eight, but they were in fact the same storm and should not have shown up together. Logic still isn't perfect, if a storm hasn't been reported on in 12hrs, it is expired.

Paul
Re: Tropical Data and NHC Storm Forecast Models rich60 8/3/05 10:09 AM
Nice job.
Re: Tropical Data and NHC Storm Forecast Models pseabury 8/3/05 8:53 PM
Thanks Rich, glad you enjoy it.

More Minor Changes:

1.) SST Colors are now centered on 5 degree increments as follows with smooth single channel transitions between them....

0C = Black (0,0,0)
5C = DkBlue (0,0,255)
10C = LtBlue (0,255,255)
15C = Green (0,255,0)
20C = Yellow (255,255,0)
25C = Red (255,0,0)
30C = Magenta (255,0,255)
35C = White (255,255,255)

And of course land is Transparent.

2.) The legend, the Smooth SST map, and the Contour SST map have all been updated to reflect these changes.


Paul

[EDIT] - White is (255,255,255) not (255,255,0) DUH! ... Thanks McShea
Re: Tropical Data and NHC Storm Forecast Models rich60 8/4/05 8:56 AM
Again, great job. I really appreciate this information. I live in S. Fl and had two direct hits from Francis and Jeanne last season. THis is the best visual tracking system out there.

Below link is a daily video tropical update provided by AccuWeather. Just click in the Accu Weather Tropical Outlook box to view video.

http://weather.net-waves.com/tropics.php

Thanks again
Rich
Re: Tropical Data and NHC Storm Forecast Models hwwtdw 8/4/05 2:52 PM
First, let me say that the overlays are fantastic. Great work & thank you for them. Have you given any thought to adding watches and warnings or the infamous NHC cone of uncertainty aka their offical forecast track with margin of error? I didn't see this in the thread or any place else. If I missed it, I apologize. Thanks!!!
Re: Tropical Data and NHC Storm Forecast Models pseabury 8/4/05 3:18 PM
I haven't found any reliable sources for the information that you mention. The data that I use right now has to meet a couple of requirements.....these may change in the future, but as of now this is what I need.

1.) Data/Images/Etc that are reliably available. That is, they are always located at the same URL or FTP directory.

2.) They must have some logic in regards to temporal description. Ie., the files must have some sort of naming comvention that indicates their age (2005080400Z.dat), or a file with a set name must be updated in place....ie, daily.dat must be replaced with fresh data regularly.

3.) If dealing with graphics, they must be geolocatable (in addition to the above). The view cannot change from one point in time to the next (NOAA Floater satellite views), unless they are geoencoded images. I've got to be able to tell GoogleEarth where to put these images, and if their view changes, then they won't be aligned properly in GE.

4.) Images must also be projected in a way that it is possible to align them in GE.

By all means, if anyone finds any other relevant data that fits the above, I'll be glad to add it. I search for new stuff regularly, but I'm only 1 person with limited time, so I may miss some good stuff.

Thanks for the kind words hwwtdw.

Paul
Re: Tropical Data and NHC Storm Forecast Models Bamastormchaser 8/4/05 7:02 PM
You do any kind of sofware programming paul? Just out of curiosity. I might have a little project for ya if you do. AIM name is MissStateWXDawg and YIM is Bamastormchaser. Thanks.
Re: NHC Track Forecast Models CapeVerde 8/5/05 12:47 PM
For some reason, the SST layer always defaults to being on when I have the NHC model layer selected. I'm not sure why.

CV
Re: Tropical Data and NHC Storm Forecast Models pseabury 8/5/05 12:52 PM
Yes Bama,

As a matter of fact I'm a software engineer. Send me a private message with what you had in mind. I don't have a great deal of extra coding time outside of work, but it depends what you are looking for.

Paul
Re: NHC Track Forecast Models pseabury 8/5/05 12:54 PM
I'll look into that CapeVerde. It very well may be a mistake on my part. God knows I create my fair share of bugs. Which SST Layer in particular? The whole SST Folder? The Smooth? The Contoured? Both Smooth and Contoured bu not root folder?

Paul

[EDIT] BTW Cape....are you using the old network link, or have you re-downloaded the new one from the first post in the thread?
Re: Tropical Data and NHC Storm Forecast Models pseabury 8/5/05 3:30 PM
Changes :

1.) Added new SST Layer. SST 26+ shows sea surface temperatures 26C and greater, with everything else transparent. The resolution for this layer is higher still than the others at (34.5 - 26) / 350 = 0.024286 degrees per pixel.... albeit at a smaller temperature range, but a more interesting range (26+) for tropical weather. The resolution of the other SST overlays is approximately (34.5 - 0) / 350 = .1 degrees per pixel.

2.) Changed from 1 SST legend to one in each SST folder. This was necessary because the added 26+ legend was a different scale than the others.

As usual, report any errors.

Enjoy
Re: Tropical Data and NHC Storm Forecast Models dadmap 8/5/05 9:41 PM
The following maps are nice from Intellicast

Surface analysis including Radar, Cloud Cover, Fronts, High and Low areas:




Jet Stream



Current Surface Analysis



Along with 300mb, 500mb & 800mb pictured here:



and lots more to choose from.

Hope these are helpful. Love what you have done so far!!
Re: Tropical Data and NHC Storm Forecast Models pseabury 8/6/05 1:02 PM
Those are all very nice, but I'm not trying to cover the CONUS with this link, but rather the Tropical Atlantic, the Carribean, and the Gulf of Mexico. Thanks for the suggestions though.

Paul
Re: NHC Track Forecast Models CapeVerde 8/8/05 12:05 PM
It was the smooth and the contoured level. Automatically check on whenever the NHC Track box was checked. The entire SST folder was not checked.

However, nothing seems to be working at all today, so maybe I'm using an outdated link. I'll try re-downloading it to see if that's the problem. Thanks.
Re: NHC Track Forecast Models CapeVerde 8/8/05 12:22 PM
Thanks, that was EXACTLY the problem. Working like a charm now.
Re: NHC Track Forecast Models pseabury 8/8/05 1:08 PM
No problem at all. Please DO let me know if you suspect something is broken, either in this thread, or a personal message.

Paul
Re: NHC Track Forecast Models LynnA 8/8/05 2:11 PM
Cape Verde and Paul:

I am having the same problem even after d/l the newest version. Although SST is not checked, the default has them load. If I check and then uncheck, the SST's go away so it's not a big deal.

Also, none of the radar links are loading. I get an error message if I check any of them (Florida). ("could not load image" with reference to the noaa site which may be down).

Still love this thing and really appreciate all of the work you have down, Paul.

Lynn
Re: NHC Track Forecast Models CapeVerde 8/8/05 2:47 PM
I'm getting the SSTs loading when I first fire up Google Earth with the new version. The folders aren't checked, but all the descendants are in the SST Smooth and the 26+ folders.

It turns out the newer version has more stuff, but it has more stuff to turn off.

It's stil the coolest layer for weatherbugs, but it's got a programming bug in there somewhere.

Cape Verde
Re: NHC Track Forecast Models pseabury 8/8/05 3:16 PM
Lynne,

I'm looking into why the analysis folder's item's aren't available. Not a bug on my part (surprise), but it seems that the source is temporarily unavailable. Hopefully temporarily.......the images themselve's still exist, but their system must have a problem because it's putting no data into them. I'll keep an eye on it.

Paul
Re: NHC Track Forecast Models pseabury 8/8/05 3:17 PM
CapeVerde,

I definitely forgot to put a <visibility /> tag into the kml for each of those SST images....so it's my fault...sorry . Anyway, is there one of those SST variations that y'all would like to be on by default while I'm fixing this, or do you wan't them all off?

Paul
Re: NHC Track Forecast Models pseabury 8/8/05 4:12 PM
Changes:

1.) SST Smooth (entire Folder) is by default ON, and the other SST overlays are defaulted to OFF.

2.) Network link changed to kmz rather than kml. The compressed kmz saves about 90% of the transfer size for the kml only. (@64KB vs. @5KB)


The new network link is attached to this post and will be updated in the first post in a minute or two. Both of these changes should be pretty transparent., although I'd prefer if you'd delete the old link from your "My Places" and download the new link to cut the network transfer size down a bit. I will continue to support both the kml and kmz links. The content of both is identical, only the size of the file is different.

Paul

[EDIT] - I seem to have screwed up the kmz.....stay tuned and continue using the kml link from the first post in this thread. I'm removing this link temporarily.

[EDIT2] - OK, think I have the kmz fixed now. Was encoding the kml us-ascii instead of the proper utf-8.

[EDIT3] - Dangit, I think my server doesn't respond with the proper MIME type now....here we go again. Attachment removed again temporarily...use the link from the first post.
Re: NHC Track Forecast Models CapeVerde 8/9/05 1:06 PM
I'd prefer all the SST layers to be off by default because it's like stepping back into the psychedilic 1960s when I fire up Google Earth and the layer is on.

It's a very valuable tool, but one that I'd only leave on for a few minutes at a time.

CV
Re: NHC Track Forecast Models dadmap 8/9/05 3:33 PM
Quote:

I'd prefer all the SST layers to be off by default because it's like stepping back into the psychedilic 1960s when I fire up Google Earth and the layer is on.

It's a very valuable tool, but one that I'd only leave on for a few minutes at a time.

CV




Yes...me too please. GE has been locking up on me everytime I open it since you made that change.

Thanks!
Re: NHC Track Forecast Models pseabury 8/9/05 3:42 PM
Yeah sorry guys...I was in the process of changing the format of the link from kml to kmz when I ran into some problems. First problem was I was encoding the xml with ascii instead of utf-8. Second problem was I had to wait for my web host to add the kml and kmz MIME types to my server. Kml seems to work fine MIME'd as text/plain, but kmz definitely needs the new MIME types. Third, the client that aggregates all of the data, constructs the images, and generates the kml/kmz is on my home machine....after it generates all the data, it uploads it to my real web host......except when my connection was fubared all day long. That too, is now resolved. Look for the default OFF SST (all of them) and the kmz instead of kml in the next 20 mins or so.

Thanks so much for the feedback...that's exactly what I want you guys to tell me when you don't like something.

Paully
Re: NHC Track Forecast Models pseabury 8/9/05 3:52 PM
I wasn't around in the 60's, so I guess I wasn't feeling your pain. Anyway, the new kmz link is attached to this post ONLY for now (test it for a bit). The same exact changes are in the old kml link as well. The only thing defaulted to ON right now are the model forecasts. I also made a slight revision in the model logic that better removes old/duplicate storms.

Paul
Re: NHC Track Forecast Models CapeVerde 8/11/05 1:11 PM
Hey, it looks like it's fixed!!

Outstanding job!!!!

Cape Verde
Re: NHC Track Forecast Models pseabury 8/11/05 8:18 PM
Thanks Cape. As always, I'm working on some new stuff, and making the stuff that's already there hopefully better. Keep letting me know what you do / don't like. Here's a couple of things that I'm thinking about.

1.) Steering Currents overlay into the Analysis folder.
2.) 3 and 7 day SST Change to SST Folder (more 60's colors ) This is kinda cool to look at the wakes of storms. Maybe something I won't include in the link if you guys don't want it.
3.) Upper Ocrean Heat Content in kJ / cm^2. This is useful for showing how much energy the ocean has rather than just its surface temp. It's probably a better indication of potential strengthening areas of interest. Thicker layers of warm water have more energy than thin layers of hot water. I haven't found the data source I want for this yet.
4.) Wind Cone Forecast (for lack of a better term). This would probably require a lot of work since I may have to make this from raw data and break out my statistics book.

Also, I've already used a couple of gigs of bandwidth this month....I have plenty to go around, but would rather folks update their links to the KMZ from the KML as the KML accounts for about 60% of my bandwidth. I've seen an issue where some versions of the client doesn't like the KMZ (no subfolders show up), but if your's works with KMZ please switch. Again, the data in both is identical, KMZ is just compressed.

Link to KMZ

Link to KML
Re: NHC Track Forecast Models pseabury 8/12/05 9:22 PM
Changes:

1.) Added 7day SST Delta.
2.) Added 3day SST Delta.

These are useful for seeing how much the SST changes over time. It's also kinda cool to see how much heat a storm can suck out of the ocean. These were more for me just as entertainment, and I'll remove them if you guys don't want them there. Steering Currents should come tomorrow.

Remember, KMZ if you can...KML only if your version of the client doesn't work with the KMZ. I think after the next version of the client, I'll support KMZ only, so heads-up. As the size of the link increases, the KMZ gets a bigger efficiency advantage. Right now it's at about 57KB vs. 4KB (14x difference).

Paully
Re: Live Tropical Data and NHC Storm Forecast Models Solo_Barradas 8/13/05 8:39 AM
Excelent Job.
Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 8/13/05 9:43 AM
Thanks Solo, appreciate it.

Changes:

1.) Added Mean Steering Layer to Analysis Folder.
Re: Live Tropical Data and NHC Storm Forecast Mode hwwtdw 8/16/05 3:38 PM
I really like this creation of yours! Thanks again.

I am one of those users who can't get the KMZ to work. All I get is a heading with your name on it, no subfolders just like you said you've seen. Any suggestions for getting a better client? I subscribed to GE Plus but no luck. I would really like to comply and help cut down the bandwidth onslaught.

Thanks for all your efforts.
Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 8/17/05 7:42 PM
hwwtdw,

Yeah, I still haven't had time to fully investigate why the kmz doesn't work for some clients, but I should have time this weekend. I just appreciate that you gave it a try at least, that's all I can ask for now. My bandwidth should be ok for the time being, and probably will after the hurricane season is over....and maybe I'll figure it out this weekend. I'll keep y'all posted.

Also, I had a loooong day today and saw that my app had crashed at some point during the day today, so I apologize if that was an annoyance for some of you....I usually keep a fairly close eye on it during the day. It's one of those great

Quote:

"xxx.exe has caused a problem and needs to be closed. Please contact your support team..."




Well, I am the support team, so that doesn't help me very much Mr. Microsoft. Hopefully we'll have some nice storms to watch in the coming week.....TD 10 looks more promising now.

Paul
Re: Live Tropical Data and NHC Storm Forecast Models CapeVerde 8/26/05 9:29 AM
Would it be possible to add or replace some of the hurricane models that are displayed?

I would sure like to see the UKMET, GFS, and GFDL model runs, and I wouldn't care if I never saw the A98E model ever again since it has such a terrible time forecasting tropical weather systems.

Your dynamic layer is such an awesome tool this time of year. Fantastic.

Cape Verde
Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 8/26/05 2:04 PM
Hey Cape,

Anything's possible. It's just a matter of finding a nice source of that data. One of the wunderground meteorologists gave me some links for those other models, but they weren't in the same format as the ones I currently use. I need to spend a good day or 2 really cleaning up the code, and possibly adding some new stuff, but I've been working on a new pet project recently. The ones I have currently included are the official NHC ones that they make public via their FTP. I was surprised to see that getting access to some of this data was restricted and/or a pay service. I'll definitely look into the UKMET one in the next couple of days (probably not soon enough for katrina though) because even I am frustrated that it's not currently included. Just keep your fingers crossed that I can find the data in a reliable format.

Paully
Re: Live Tropical Data and NHC Storm Forecast Mode CapeVerde 8/27/05 8:48 AM
Thanks, my friend. You're doing a service with your efforts that can't be underestimated. Your layer can and will save lives and as more Americans discover Google Earth, the impact can only increase.

CV
Request - basic data only TheSHAD0W 8/28/05 8:53 AM
Could you please publish a KMZ containing only the model forecasts and not including the SST, Satellite Images or Analysis? I'd really appreciate it.
Re: Request - basic data only thobie1 8/28/05 1:55 PM
All you have to do is de-select the features you don't want. It works fine. By the way, this is an amazing addition to GE. Great work!
Re: Live Tropical Data and NHC Storm Forecast Mode bkdelong 8/28/05 2:25 PM
Anyone else having issues loading the Sat images from TheSHADOW's folder of this Network Link? They just seem to keep saying "loading". I've tried refreshing a few times but I don't want to completely overload the source.

Also looks like the GIF file from wisc.edu for Analysis > Mid Upper WV & IR Winds is giving intermittant load errors.

Is there alternative data sources to account for network overload?
_________________________
-- B.K. DeLong (K3GRN) bkde...@pobox.com +1.617.797.8471 http://www.wkdelong.org Son. http://www.haloworldwide.com Work. http://www.bostonredcross.org Volunteer. http://www.brain-stream.com Play. http://www.the-leaky-cauldron.org Potter. PGP Fingerprint: 38D4 D4D4 5819 8667 DFD5 A62D AF61 15FF 297D 67FE FOAF: http://foaf.brain-stream.org
Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 8/28/05 2:50 PM
Unfortuantely.....those are THE premier sources for that data. Their servers are just being overloaded. There's not much I can do at this time...sorry. I've still got family in New Orleans that I'm trying to get information on as they will not be leaving. With that in mind, I will not be making any updates to this link during this storm. I will make sure that it stays up though.

Paul
Re: Live Tropical Data and NHC Storm Forecast Mode bkdelong 8/28/05 3:07 PM
Understood. I wish you and yours a very safe ride through this unprescedented storm.
Re: Request - basic data only TheSHAD0W 8/28/05 8:51 PM
The problem is, I want to be able to enable it w/ a single checkmark for a parent directory, and have it disabled most of the time. As it is, I have to open it up and check the features I want, then go through and uncheck them to clear it. Checking the parent winds up enabling EVERYTHING.
Re: NHC Track Forecast Models pseabury 8/30/05 8:07 PM
Katrina's cold water wake. 3 day delta.

Re: NHC Track Forecast Models CapeVerde 8/31/05 11:33 AM
WOW!
Re: NHC Track Forecast Models pseabury 9/7/05 5:10 PM
Hey Guys,

I'm out of town until next Tuesday, so I won't have any time for upgrading/improving, and very little time to check in on my app in case it needs some babysitting. I do have some limited capability as long as my PC at home stays up (ie. no power loss) to restart and check in on it, but not nearly as regularly as usual. Best bet is to fire me an email if you know it, or post here if something goes awry.

Paully
Re: NHC Track Forecast Models Frank4 9/10/05 10:39 AM
Paul,

The hurricane models are not updating apparently. They are still showing 9/8/05 as the most recent update.
_________________________
Frank Taylor - Author of Google Earth Blog
All about Google Earth news, features, tips, technologies, and applications. Also read: http://TahinaExpedition.com
(If you have story ideas, please send me a private message.)
Re: NHC Track Forecast Models jptheriot 9/10/05 4:16 PM
Paul,

It also appears the SST is not updating.

This tool is by far the best I have found for GE. Many thanks for your efforts.

Jp - jpth...@charter.net
Re: NHC Track Forecast Models pseabury 9/11/05 1:40 PM
Sorry guys, my app took a dump and I'm away on vacation. I just got to a place with internet access and restarted it.....so hopefully it's good to go now. I'll check again tonight. Again, my apologies.

Paul
Re: NHC Track Forecast Models jptheriot 9/12/05 8:02 PM
Paul,

Was working again today.

Thanks,
Jp
Re: Live Tropical Data and NHC Storm Forecast Mode bkdelong 9/19/05 5:37 PM
Hey Paul -

For some reason Rita has disappeared from the list. Any ideas why?

Also, you did ask for more suggestions....how about tracking ALL the computer models? Maybe allow people to select and deselect which ones they want:

http://hurricane.methaz.org/hurapak/AAL182005_perf.html

http://hurricane.methaz.org/hurapak/AAL182005_rawp.html

Why don't you/we add Eastern Pacific Cyclones.....or Cyclones across the world?

We have the data:

http://severe.worldweather.org/

If you're worried about hosting bandwidth, I can help find you a reliable location.

Now I'm going to ask some stupid questions....being a newbie to weather. Are there Maps/Views of the Tropical Waves being discussed here:

http://www.nhc.noaa.gov/text/MIATWDAT.shtml?
Re: Live Tropical Data and NHC Storm Forecast Mode bkdelong 9/19/05 5:59 PM
OK....Rita is back. *sigh*. Was gone for the last hour or so.
Re: Live Tropical Data and NHC Storm Forecast Mode dadmap 9/19/05 8:47 PM
She passed through the Bermuda Triangle and we lost her for a bit...but she made it out alive...;-)
Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 9/20/05 7:04 AM
If Rita Dissapeared, I don't know why.....but have some theories. Either she dissapeared from the most recent NHC data for a bit, or my app made her dissapear for a bit unexpectedly.

I do welcome the suggestions, and I already have a list of things that I'd like to modify/add...but as always time for coding it is the biggest issue for me.

1.) Add UKMET, GFS, NOGAPS models. Dr. Masters pointed me in the right direction for these.

2.) Add track history in addition to track prediction.

3.) Expand to other Ocean basins.

4.) Cripple the kml feed to force folks to use the kmz.

5.) Add storm discussion and any other relevant data .

I'm expecting some time this weekend, so we'll see how it goes.
Re: Live Tropical Data and NHC Storm Forecast Mode bkdelong 9/20/05 8:24 AM
Quote:


1.) Add UKMET, GFS, NOGAPS models. Dr. Masters pointed me in the right direction for these.

2.) Add track history in addition to track prediction.

3.) Expand to other Ocean basins.

4.) Cripple the kml feed to force folks to use the kmz.

I'm expecting some time this weekend, so we'll see how it goes.






I'd be happy to setup a CVS server if you'd like additional trusted people to help develop this app. The worldwide cyclone app by glooten seems to do history VERY well.
_________________________
-- B.K. DeLong (K3GRN) bkde...@pobox.com +1.617.797.8471 http://www.wkdelong.org Son. http://www.haloworldwide.com Work. http://www.bostonredcross.org Volunteer. http://www.brain-stream.com Play. http://www.the-leaky-cauldron.org Potter. PGP Fingerprint: 38D4 D4D4 5819 8667 DFD5 A62D AF61 15FF 297D 67FE FOAF: http://foaf.brain-stream.org
Re: Live Tropical Data and NHC Storm Forecast Mode ChrisGaeth 9/20/05 9:33 AM
Paul,
I think you have done a great job with this. Talk about showcasing what a great tool Google Earth is. Keep up the good work. I see that you already plan to add the historic track to the active storms. I do have another question for you. When you get the data feed from NOAA is it possible to link to the storm discussion or advisory that goes along with the location?

Chris
Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 9/20/05 4:56 PM
I'll add that to my list and look into it. I'm working on the link right now, and will post a follow-up in just a minute. And thank you.


Paul
Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 9/20/05 5:03 PM
Ok, with all of the activity in the Atlantic and the Gulf, I have to stop being nice by just hoping that people will use the kmz instead of the kml. So here's what I've done.

1.) Not changed the kmz network link.

2.) Crippled the kml link by displaying a single Placemark that shows you how to use the kmz instead.

Now, I didn't want to do this at first, because it seemed that some versions of the GE client didn't like the kmz link very much. I'm hoping that all the subsequent versions have fixed that problem, and urge you to update to the latest version if you indeed have this problem. Other than that, my thinking was that it's better to be able to provide this info to those that are willing/able to use the kmz link rather than to not be able to provide it at all. Like I've said before, the Kmz provides identical functionality to the kml, so it should be transparent to those familiar with this Network Link. I'm actually upgrading my client as I type this because the version I had didn't play nice with the kmz network link, so keep your fingers crossed.

I probably need to eat something before the night is over, but I'm looking at a couple of the other things on my list above to see if I can squeeze them in tonight.

Paully
Re: Live Tropical Data and NHC Storm Forecast Models dd2020 9/20/05 6:47 PM
How is the possibility if we can have the storm images shown on googleearth?
May be atleast updated every 2-4 hours......



I'm just curious....but don't have much idea.
So..thank for reading.
Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 9/20/05 7:03 PM
Storm images are part of the Network Link.

/Satellite Images/EIR (Enhanced InfraRed)
/Satellite Images/WV (Water Vapor)
/Satellite Images/IR (InfraRed)

I didn't include visible because frankly I don't know of a good source (floater won't work for geoencoding it), and it wouldn't be of much use at night.

Paul
Re: Live Tropical Data and NHC Storm Forecast Mode dd2020 9/20/05 7:31 PM
Thank you for a fast reply

I'm just looking for a default interface on google earth....
Because I think most people (including me) will be able to use it...

May be 2-5 years ahead..

Re: Live Tropical Data and NHC Storm Forecast Mode ChrisGaeth 9/20/05 7:39 PM
Cool. Also I did update my link to make sure I was using KMZ.
Re: Live Tropical Data and NHC Storm Forecast Mode dadmap 9/21/05 7:08 AM
Quote:



Intellicast has pretty good visuals. However, you can't see them at night time.

The below image can be found here:

http://www.intellicast.com/Local/USNatio...ne&pid=none

http://www.intellicast.com/WeatherImg/Satellite/hifloat6.gif

Re: Live Tropical Data and NHC Storm Forecast Models rlburnett 9/21/05 2:24 PM

When I use this, everytime the refresh occurs, all the Rita predicted path points and the Trackline turn off automatically if I have them turned on. This is frustrating. What can I do to have my checked points remain on after a refresh? Thanks in advance.

RL
Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 9/21/05 5:08 PM
I don't have that problem, and specifically coded the Link to keep your preferences. Whatever I have checked, stays checked on refresh. What version Client are you using etc....hard to tell without more information or more people having similar problems to you.
Re: Live Tropical Data and NHC Storm Forecast Mode rlburnett 9/21/05 6:33 PM

Sorry, I'm using GE 0548.

I was mistaken about the projected path points getting unchecked. They do appear to be retained on refresh. Mea culpa.

However, the TrackLine DOES get turned off every single refresh, which is irritating.

Thanks again.

RL
Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 9/21/05 7:13 PM
Try version .0616. I've triple checked on my Client, and had a coup[le other people check as well......cannot repeat your problem at present.
Re: Live Tropical Data and NHC Storm Forecast Mode rlburnett 9/21/05 9:37 PM

Will do. Thanks again.

RL
Re: Live Tropical Data and NHC Storm Forecast Mode hwwtdw 9/22/05 8:01 AM
Paul, Have you seen the Hurricane Center's experimental product on warning coordinates? Remember we spoke about this months ago and you said you'd need a good source for coordinates. I think the NHC may have given us that in this product. I included a link below.

Thanks for everything!!!!

http://www.nhc.noaa.gov/text/refresh/MIATCVAT3+shtml/220859.shtml
Re: Live Tropical Data and NHC Storm Forecast Models wildbillhp 9/22/05 8:31 AM
I will be the first to admit, I am sort of a newbie at this, but I see no images of Rita at all.
Re: Live Tropical Data and NHC Storm Forecast Mode dart27 9/22/05 9:50 AM
Try updating your client. That fixed it for me.

Go click "Help" on the GE toolbar and select "Check for Updates Online"

Good luck,

James

PS - Great Tool Paul! Almost TMI, since my mother lives right in the middle of all the model plots, but good to have.
Re: Live Tropical Data and NHC Storm Forecast Mode porcus 9/22/05 4:46 PM
What else can I say besides, WOW!!? ... Oh, I know -- how about Cool!!!?

I was hoping to find an overlay to give me some "live" visuals of hurricane Rita, and I found this. After using it for the first time, I must admit that I'm very impressed with the various kinds of data that have been integrated into this network link.

I have been doing some development of my own involving Google Earth, and I've been very impressed with what it's made possible for me just in a short time! (I'm really excited about what the future holds for Google Earth.) Without a doubt, I could certainly learn a thing or two from your work here. For example, I'd be quite interested to learn what you've done to periodically update/refresh the data for this. (I wouldn't mind discussing these things and more offline.)

Keep up the excellent work! This is just the kind of thing that is needed to make GE even more useful!

Paul
Rita Live Radar pdchawaii 9/22/05 7:08 PM
Doppler Radar Stations along coast where Hurricane Rita impact likely.
Re: Rita Live Radar pseabury 9/22/05 8:22 PM
Excellent pdchawaii !!! I temporarily added it to the Network Link, giving you credit of course. If this is not ok, please let me know and I'll just put the same data together myself. I've already written the code so it wouldn't be that big of a deal, although I don't see it being a problem.

Again, good work.

Paul
Re: Rita Live Radar pdchawaii 9/22/05 9:16 PM
paul--fine to use LIVE RADAR KMZ--thanks.
Re: Live Tropical Data and NHC Storm Forecast Mode VikeST 9/23/05 1:54 AM
I've been trying to download this layer for the past few days but it seems that there's no connection to the server ... does anyone else have this problem?
(I've tried other layers and downloaded them without any problem)
Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 9/23/05 5:17 AM
No VikeST - The only problem I know about is some previous versions of the Client do not like to allow Network Links as KMZ...which this is. I've personally experienced this. The top level folder will show up, but nothing else.

If this is the case and you don't have the latest version of the Google Earth Client, please uninstall it, download/install the latest (0616), and then reload the network link.

Paul
Re: Live Tropical Data and NHC Storm Forecast Mode ChrisGaeth 9/23/05 10:09 AM
I noticed on the last update that TS Invest from 1998 popped up in the fetch. Thought you should be aware.

Chris
Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 9/23/05 11:17 AM
It's not from 1998......look at a current satellite overlay along with the Model Forecasts. Invest is also storm #982005 .....2005 being key.

I am dissapointed that NHC hasn't put out any more Track Forecasts on Rita. My app has retired the last model data because it is too stale. Hopefully they give us a 2pm EDT update.
Re: Live Tropical Data and NHC Storm Forecast Mode ChrisGaeth 9/23/05 12:57 PM
Ok. But the "I" storm for 2005 was Irene back in August.

Chris
Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 9/23/05 1:50 PM
"Invest" refers to an as-of-yet unnamed storm. It's usually just a system that the HNC is keeping an eye on, but isn't yet organized into a depression or something worth naming. There have been a couple dozen "Invests" this year so far.

Paul
Re: Live Tropical Data and NHC Storm Forecast Mode bkdelong 9/23/05 2:51 PM
I've heard "Invest" referred to mean "Investigation" which goes along with "keeping an eye on a storm".
_________________________
-- B.K. DeLong (K3GRN) bkde...@pobox.com +1.617.797.8471 http://www.wkdelong.org Son. http://www.haloworldwide.com Work. http://www.bostonredcross.org Volunteer. http://www.brain-stream.com Play. http://www.the-leaky-cauldron.org Potter. PGP Fingerprint: 38D4 D4D4 5819 8667 DFD5 A62D AF61 15FF 297D 67FE FOAF: http://foaf.brain-stream.org
Re: Rita Live Radar BigJacko 9/25/05 4:09 AM
Thanks to both of you for an EXCELLENT submission - this is a really fascinating tool, and I've been transfixed by it for days now... it's rapidly forming part of my life!

Having said that, being a 'never-satisfied' geek, I delved deeper into the 'Rita Radar' package that pdchawaii kindly donated to pseabury's project, and found a few things which caused me to raise an eyebrow.

It seemed to me that the coordinates of the LatLonBox on the overlay were very slightly 'off', when I compared them with current images.

Specifically, I went into the data at the NWS site (where the images are fetched from, on the RIDGE Radar experimental pages), and found that alongside each radar image, there is a corresponding GFW file, which denotes the bounding box for EACH separate picture. I have been looking carefully to see if these are changing much - and it doesn't appear that they have... but certainly, when I calculated the exact viewport positions, the numbers I got for some radar-sites where very slightly different to those already stored in pdchawaii's overlays. This made me wonder if some of them have changed in the intervening days, as radars are 'boosted' or otherwise tweaked, and thus the resulting image coefficients change when the final picture is 'squeezed' into a standard 600x550 pixel image.

What assumptions (if any) did you make, with regard to the GFW files, pdchawaii? Do you know if these change? And what was your approach to calculating the LatLonBox from these files? I have a slight feeling you may have applied the 600 and 550 multipliers to the wrong coordinate, possibly (either that, or the radar datasets DID change at some point recently).

Aside from all this, I have begun the process of creating an overlay set for ALL the RIDGE Radar sites, and for ALL their data products (they deliver seven: 3 types of reflectivity, 2 wind overlays and 2 for rainfall, plus a warning layer, and legends for all seven). So far, it's going very well, and I have developed a reasonably sensible set of sub-folders per site and type. My only worry at this point, is it is possible to unwittingly turn them ALL on at once, which would put massive load on the NWS servers, I reckon... (potentially 2325 refreshes per 5 mins!!!!) so I am trying to find ways to limit this possibility (ie, have one radar and only one product-type displayed at once, maybe).

And of course, the other concern is how best to 'scrape' the GIS positioning data from the GFW file on each refresh (if it turns out this is necessary - certainly NWS advise it), so that the overlay is correctly stretched over Google Earth. At the moment, KML doesn't allow this to be done in-situ on the client-side, and I thought it would be pointless me writing my own server-code to do this, if, ultimately, the end-result might be re-incorporated back into pseabury's package which is tied to his own server already (I know that is perhaps presumptive, but I'm sure once Rita is fully passed, we'll need these radar stations again, and perhaps having all data accessible from all the nearby sites on the coast will be useful - I just thought I'd save someone a job, and get the ball rolling).
Re: Rita Live Radar pseabury 9/25/05 10:03 AM
The Rita Radar was a temporary addition to this link, although a much appreciated one. I wil remove it shortly though.

You bring up a good point that I've been looking at for quite some time....a coastal radar addition to this link. I looked at fetching the raw radar data from the NWS gateways, and producing my own images, but time contraints haven't permitted me to learn the file format and write my own parsing code (like I do for the SST).

The other good point you bring up is the probalem with properly geolocation image overlays. I've tried to be very careful with this, and I don't want to deploy something that degrades over time, or otherwise needs a lot of babysitting. That's why I'm also dissatisfied with the GOES floater images...it'd be nice if they'd either geoencode these for us, or at least provide bounding coordinates.

I'm not bent on keeping everything in this package solely my work, in fact I'd like to be able to include as much as possible (within reason) as long as it's quality stuff. If you want to make a sollid coastal radar for this package, I think we'd all be grateful....and it certainly would save me some time. Remember, less is more in some senses. There are other layers that provide entire CONUS coverage...what I think we're interested in here is Gul/Atlantic coast first (maybe expand to pacific storms and other Pacific stuff later). If we could more than just base reflectivity that would be nice as well. Radial velocity, rainfall rate, stormtop heights etc could prove useful for analysis.

The problem with limitations as far as the GE client and it's ability (or inability) to group and limit information is also something to tke into account. I've tried to make it easier to only turn on so much information at once, but the inherent mechanisms that the GE client has to limit information with folders and checkboxes leaves a little to be desired. I hate (as I'm sure others do) when I accidentally click a top level folder and then start pulling Megs of data accidentally.

Anyway, keep me posted if you come up with something and we'll work to integrate it if that's what you want. If you have any suggestion regarding the data that's already there feel free to comment as well.....better is better whether it comes from me or someone else.

Paul
Re: Rita Live Radar BigJacko 9/25/05 1:20 PM
Quote:

I looked at fetching the raw radar data from the NWS gateways, and producing my own images, but time contraints haven't permitted me to learn the file format and write my own parsing code (like I do for the SST).



No problem there then... I've done it all, pretty much. I have a 'stock' folder arrangement for a given radar, with each legend+product pair, plus a generic warnings overlay. You're welcome to that bit, if it's of use.

Quote:

...geolocation image overlays. ... I don't want to deploy something that degrades over time, or otherwise needs a lot of babysitting.



Wholeheartedly agree there! That's kinda why I mentioned this at all, really. Without wishing to cast any aspersions on the work pdchawaii did, I was a tad worried that if the GFW/GIS files weren't regularly taken too, then things might drift.

Quote:

If you want to make a sollid coastal radar for this package, I think we'd all be grateful....and it certainly would save me some time. Remember, less is more in some senses. There are other layers that provide entire CONUS coverage...what I think we're interested in here is Gul/Atlantic coast first (maybe expand to pacific storms and other Pacific stuff later).



Agreed totally. It also limits the potential damage that could be done by having everything turned on at once (at least, to a degree).

I'm thinking of:

Brownsville, TX
Corpus Christi, TX
Houston/Galveston, TX
Lake Charles, TX (when it comes back online - sods law dictates that this is the one I did already, before it got blown over)
New Orleans/Baton Rouge, LA
Mobile, AL
NW Florida
Tallahassee, FL
one or all of Tampa Bay, Keywest, Jacksonville, Melbourne & Miami, FL (or some representative set - these seem like they must surely overlap a lot)
Charleston, SC
Wilmington, NC
Morehead City, NC
Wakefield, VA

Any point in going much higher?

Quote:


If we could more than just base reflectivity that would be nice as well. Radial velocity, rainfall rate, stormtop heights etc could prove useful for analysis.



The platter of offerings from the NWS RIDGE appears to be:
Short-range Reflectivity
Long-range Reflectivity
Composite Reflectivity
Storm Relation (wind) Motion
(wind) Velocity
1-hr Precipitation
Total Precipitation

and of course, the tornado/flood warning overlay. All templates done already... all I have to work on next is the GIS/GFW geolocation-file fetch. What language/system are you using to do your current parsing and fetching? I was going to knock something up in VB, but I can talk C++ and PHP (when pushed! ). At the very least, I can knock something up that would be fairly simple to reapply elsewhere, if that'd save you some dev-time?

Quote:

...the inherent mechanisms that the GE client has to limit information with folders and checkboxes leaves a little to be desired. I hate (as I'm sure others do) when I accidentally click a top level folder and then start pulling Megs of data accidentally.



Oh yes! I've raised this in the KML discussion forum, in the hope that someone takes note - it IS a little silly to force developers to write programs that allow users to be hopeless inefficient, and I really hope they can change that.

Likewise, same grief with the 'View-Based Refresh' almost-but-not-quite being useful - that would make a great deal of difference too.

And of course, the inability of the language to cope with variables, maths, or separate URL-fetches (which would mean all the geo-location could be client-driven, and perfect).

Still - it's early doors, and I'm not complaining - just suggesting. Rome wasn't built in a day, and GE is better than anything else I've seen in this field.

Quote:

Anyway, keep me posted if you come up with something and we'll work to integrate it if that's what you want. If you have any suggestion regarding the data that's already there feel free to comment as well.....better is better whether it comes from me or someone else.



Nice attitude Man after me own heart. I'll knock these up over the next day or two, and send it over to you as a PM or something. Then if it meets the standard, you're welcome to use it, if you like it.
Re: Rita Live Radar Frank4 9/25/05 1:33 PM
Paul, I found this radar collection useful when I've watched hurricanes. I was able to see Rita well into the gulf with this collection.

It's from the U of Oklahoma.
_________________________
Frank Taylor - Author of Google Earth Blog
All about Google Earth news, features, tips, technologies, and applications. Also read: http://TahinaExpedition.com
(If you have story ideas, please send me a private message.)
Re: Rita Live Radar pseabury 9/25/05 6:40 PM
Big Jacko,

Quote:


I'm thinking of:

Brownsville, TX
Corpus Christi, TX
Houston/Galveston, TX
Lake Charles, TX (when it comes back online - sods law dictates that this is the one I did already, before it got blown over)
New Orleans/Baton Rouge, LA
Mobile, AL
NW Florida
Tallahassee, FL
one or all of Tampa Bay, Keywest, Jacksonville, Melbourne & Miami, FL (or some representative set - these seem like they must surely overlap a lot)
Charleston, SC
Wilmington, NC
Morehead City, NC
Wakefield, VA





Yessir, maybe even up to New York Area...occasionally get an Atlantic storm up that way. The problem with the NSSL CONUS link (Like the one Frank attached below, which I'll reply to in a second) is that it's too much, and it's too big. I think for our purposes we want to focus in (and use resources) on what we are interested in only. I like the idea of using the Ridge Radars (NWS Nexrad)...BUT.

I toyed with the idea of adding the Ridge Radars myself when pdchawaii gave the Rita Radar coverage, but I found a couple of problems that I didn't particularly like about it so I didn't put forth the effort and jsut used what he provided. These may be nit-picks, but I've tried to keep this link as nice as possible and maybe I'm just being unrealistic. First, I noticed that at some points in time certain sites (Corpus Christi for example) weren't consistent with the other sites. For instance, CC's ground clutter had a totally different return signal strength for ground clutter than the rest. This made CC red while everything else was blue (50db vs 5db return strength via the scale provided). I'm not sure this is a common occurance, but it was annoying nonetheless. Along the same lines, the ground clutter from these sites is excessive isn't it? Now for me, and probably a lot of you that understand radar this isn't a problem, but for the layperson that is looking at the overlay and doesn't understand how radar works I can imagine them thinking that it's wrong, or broken, or just stupid. I mean if a normal user that expects to turn on the radar layer and expects to see only weather, turns it on and the coast lights up like a Christmas tree.....they may get turned off and/or confused by it. This is one area where the NSSL and other radar images that are somewhat post-processed are better. Again, maybe being too picky, but just trying to convey the point. This also may be the best we can do, and that's fine also......I guess I just don't know for sure and so would raise the question.


Quote:



The platter of offerings from the NWS RIDGE appears to be:
Short-range Reflectivity
Long-range Reflectivity
Composite Reflectivity
Storm Relation (wind) Motion
(wind) Velocity
1-hr Precipitation
Total Precipitation





Maybe the compostite solves the problem I described above? I should have fully investigated before responding. But all-in-all, most of those are what would be nice. Basically anything that would prove useful in following a storm without duplicating data.

Quote:



Nice attitude Man after me own heart. I'll knock these up over the next day or two, and send it over to you as a PM or something. Then if it meets the standard, you're welcome to use it, if you like it.





First off, that's awesome. I look forward to seeing what you come up with.

Secondly, I'm not setting standards here per se, but like you would like to provide the most amount of information that is useful AND, to be blunt, not just trash to say that it's in there. I basically don't want to just shoehorn stuff in there just because we can....you know what I mean. I'd also like to make this as much of a community effort as possible.....I may have started this but am not stupid enough to think that someone can't do something better or provide something different that would be of use. Next storm season this could be 1000x better than I made it this year, and I hope it is. The only reason I've kept a little bit of control over what has been in it so far is because #1 my name has been on it so far, and #2 I've had to limit it to what my resources can handle as far as time, ability, and bandwidth are concerned.

Also, from a technical standpoint, this is mostly implemented on top of the .NET framework in C#...only because I'm good at it, and it's super easy to rapidly develop in it. I used a fairly quick and dirty approach to the code because I basically started this while storm season was in full swing. I need to spend an entire weekend going back and cleaning up the code before I let anyone see it. Kinda like cleaning up the house before company arrives lol.

Hopefully as the GE Client API evolves, and more data becomes available from people who see the benefit of making it geo-friendly, we can shine this link up to something much better than it is now.

Paully
Re: Rita Live Radar pseabury 9/25/05 6:47 PM
Frank,

Like I said above.....I like that layer,and admit that I've used it from time to time for macro views of what's going on, but there are a couple reasons that I'm not sure we want it.

First, the files it loads are big.......maybe not a problem in the future, but as of now it takes forever to load and is a bit unwieldly for what we want I think. It also covers the entire CONUS, which is great, but not something that is in the scope of this link. I think we'd rather go smaller with both coverage and file size. This is something that we should discuss and be on the lookout for so that we can find the data that best fits our needs. Quality over quantity is one of my mottos .

Considering that this link and the other data files that it encompasses got hit over 1,000,000 times in the past week or two........size and efficiency is something that we should definitely keep in mind.

Paully
Re: Rita Live Radar BigJacko 9/26/05 6:44 AM
Quote:


Yessir, maybe even up to New York Area...occasionally get an Atlantic storm up that way.



Okeydokey - will extend up to NY then. Being a Limey, I'm not too familiar with how far up these hurricanes regularly go - so, if in doubt, my policy is to ask!

Quote:


First, I noticed that at some points in time certain sites (Corpus Christi for example) weren't consistent with the other sites. For instance, CC's ground clutter had a totally different return signal strength for ground clutter than the rest. This made CC red while everything else was blue (50db vs 5db return strength via the scale provided). I'm not sure this is a common occurance, but it was annoying nonetheless.



Yup, I've noticed this myself. That was the main motivation behind me deciding to add in the Legend overlay too - that way, even if the image returned is 'unusual', the user can at least see that the legend is referring to a different range of return strengths, and (hopefully) apply logic thereafter to what they are seeing. No guarantee, of course, but it's what the NWS themselves do (and if it's good enough for them...)


Quote:

Along the same lines, the ground clutter from these sites is excessive isn't it? Now for me, and probably a lot of you that understand radar this isn't a problem, but for the layperson that is looking at the overlay and doesn't understand how radar works I can imagine them thinking that it's wrong, or broken, or just stupid. I mean if a normal user that expects to turn on the radar layer and expects to see only weather, turns it on and the coast lights up like a Christmas tree.....they may get turned off and/or confused by it. This is one area where the NSSL and other radar images that are somewhat post-processed are better. Again, maybe being too picky, but just trying to convey the point. This also may be the best we can do, and that's fine also......I guess I just don't know for sure and so would raise the question.



I see the problem, but like you, don't have a solution for it. I guess really it just behoves the layperson to WISE UP and take the time to learn something they don't understand. We can do this with maybe judicious use of URLs linking to the 'Idiot's guide to radar-returns' (if there is such a document ) or maybe just the NWS FAQs?

My mission here is "enablement" primarily - giving people who know what they need, the ability to access it via one clean and handy interface in Google Earth. Educating people is a secondary consideration, really - and I expect them to take at least the most-basic steps to further their own learning. In a nutshell, that basically means I think we should give them the pointers, but responsibility for usage and development of their own brains, lies with them.


Quote:

Also, from a technical standpoint, this is mostly implemented on top of the .NET framework in C#...only because I'm good at it, and it's super easy to rapidly develop in it. I used a fairly quick and dirty approach to the code because I basically started this while storm season was in full swing. I need to spend an entire weekend going back and cleaning up the code before I let anyone see it. Kinda like cleaning up the house before company arrives lol.



LOL - I know exactly what you mean (especially having spent time this morning doing exactly that myself, in terms of tidying up the attached KMZ!) Anyway, cool - I may be able to pseudocode the logic for "how to fetch and apply the GIS files", in such a way that when you rebuild it in .NET/C# that it's a quick job. We'll see. I really ought to get more involved with .NET.... I've tended to shun it, because it looks like M$ hold all my code remotely by the short-and-curlies, and I'm not 100% sure I like that. But I've probably got the wrong end of the stick... it wouldn't be the first time

Quote:

Hopefully as the GE Client API evolves, and more data becomes available from people who see the benefit of making it geo-friendly, we can shine this link up to something much better than it is now.



Sure we can! It's pretty darned useful already, and looks good, and it's a credit to you and the other folks who have submitted stuff for inclusion. On a personal level, it provided a HUGELY exciting and entertaining insight into Rita's visitation, which is not something I would normally expect to see so clearly, from this far off, UK-based perspective. It struck me then how seriously useful this tool could be, for folks that (unlike me) weren't necessarily sitting in their comfortable living-rooms looking at drama vicariously unfolding thousands of safety-giving miles away, and who actually NEEDED to know this stuff, and NOW, so they could call up Mom to tell her when to get out. It's quite humbling, really.

This was backed up a bit when I found myself on the www.hurricanecity.com website watching a RealAudio live stream coming from somewhere in that area. Not only did it heighten the drama, and the sense of the scope of this ordeal, the guy running the show happened to use the old Keyhole program at one point, and brought up some very basic views of certain towns he thought would be most affected. Meanwhile, he was having to switch between programs and clumsily try and compare those maps, with the radar maps he had available in a different, NWS-specific program. I thought to myself... "How come he hasn't got Paul's overlay, and why isn't he using Google Earth?" Maybe next time, he will - and people may benefit from it, as a result?


Anyway - enough of my blather.... attached is ONE example NWS RIDGE radar set up as I envisage all the others would be. It features Brownsville, Texas, and all the products associated therein.

Points to note...
1 - you can probably tell just from this, why I think there are risks in providing TOO many radar folders in one package. There's just too much likelihood of someone ticking the top-folder, and selecting EVERYTHING for display, which would be as pointless as it is stupid, but GE's system currently doesn't enable me to prevent it. I do hope they change this in time.

2 - Brownsville's Velocity maps (at the time of writing) are currently not displaying transparency on their backgrounds. This is a fault their end - it's doing it on the NWS official site, too. Dunno why - maybe it'll fix itself again later - but the important thing is, it's not the KML at fault here - it's the returned image itself. [EDIT: This problem appears to have gone away now...]

3 - There are currently no warnings in force, so you can't see anything when you click this layer. In normal circumstances, if there WAS a warning, you'd see what the zoned areas meant, by looking at any of the Legends for any of the sub-products. They all carry that (even if they are different for the radar-return types and scales, on a per-product basis).

4 - GFW/GIS geo-location data being used for this current set, is the same as I was using a couple of days ago, in my own tests. It was calibrated perfectly then, but I have NOT checked today to see if the GFW data is different this time. I will be doing so later, and trying (again) to work out how pdchawaii's numbers became different, if it turns out the GFW has remained static all this time. This is the one area which worries me, slightly - but like I said, I know the algorithm to make it work - I just wish I could make it client-side, rather than have to force you or me to run a separate server just to calculate this 'munge' on each 5-minute fetch. Give us variables, GE, please [EDIT: I have now checked... Bad news.. The BRO GIS data for the N0R coefficients is different today than it was at the weekend. Darn. This means that the GFW files really DO need to be collected and parsed on EVERY fetch of the radar-image. I'll go write that code now!]

Any comments, feedback greatly appreciated. If you think it needs a different organisational approach, please let me know, and I'll start thinking - but this seems to me the most complete and accessible approach, given the limitations of GE. I'm open to ideas, though!

Note - I will probably remove this KMZ fairly shortly after I know you've received it, Paul. Sorry everyone else - you will get to see it in the long-run... but we want it to be right, and (most-especially) I couldn't live with myself if I 'killed' the NWS servers by releasing the full KMZ in haste. Please bear with us! Thanks...[EDIT: The KMZ has been removed now - updated & improved version for testing is posted later in this thread]
Re: Rita Live Radar pseabury 9/26/05 3:49 PM
Quote:



I see the problem, but like you, don't have a solution for it. I guess really it just behoves the layperson to WISE UP and take the time to learn something they don't understand. We can do this with maybe judicious use of URLs linking to the 'Idiot's guide to radar-returns' (if there is such a document ) or maybe just the NWS FAQs?

My mission here is "enablement" primarily - giving people who know what they need





I hear ya, and still agree that it's a problem, but if we can't come up with an obvious answer, then all we can do is what we can do......until and unless we find a better way.

Quote:



LOL - I know exactly what you mean (especially having spent time this morning doing exactly that myself, in terms of tidying up the attached KMZ!) Anyway, cool - I may be able to pseudocode the logic for "how to fetch and apply the GIS files", in such a way that when you rebuild it in .NET/C# that it's a quick job. We'll see. I really ought to get more involved with .NET.... I've tended to shun it, because it looks like M$ hold all my code remotely by the short-and-curlies, and I'm not 100% sure I like that. But I've probably got the wrong end of the stick... it wouldn't be the first time





You ought to give C# a look definitely.......the ability to rapidly develop is unrivaled. And in fact, you aren't tied down to MS because C# is an open spec and currently has implementations for *nixes included Mac, Linux, etc via the Mono Project.

Now to comment on your points 1 by 1.

1.) Agree totally......like I said before, that's one of my biggest worries with a large dataset. I guess the only thing we can do is group the stuff as smartly as possible.

2.) Good to go.

3.) Good to go.

4.) Why in the heck does it change? Am I missing something here or is the radar moving? I haven't looked into it properly yet, but I don't understand why this would change periodically. Not a huge deal if we have to fetch it, but it violates my "keep it simple" policy lol.

Sorry it took me awhile to get back to you on this, but I had a lot of paying work to do today. In any case, it's very nicely done. A lot of data mind you, but a very nice start. We may want to think about how we group it in order to mitigate #1 above. Maybe a top level folder with all base reflectivities, and another folder with all relative velocities, and another with all 1hr precips etc. Just something to think about how it would be most useful for people using it...maybe the arrangement you currently have it in is best.....I just don't know until we talk about it and/or get some feedback.

Paully
Re: Rita Live Radar BigJacko 9/26/05 5:34 PM
Quote:


Why in the heck does it change? Am I missing something here or is the radar moving? I haven't looked into it properly yet, but I don't understand why this would change periodically. Not a huge deal if we have to fetch it, but it violates my "keep it simple" policy lol.



Yeah - pain in the a&&, and no mistake! I'm guessing, but I wondered if it had something to do with radar strength. Like, if one day, the radar was running at a higher power, it would theoretically 'reach' further afield - and because the resulting image is ALWAYS a 600x550 pixel picture, there would be a change in the coefficient (ie, the ground-area size per pixel).

I haven't worked out (yet) exactly what size of variations we're seeing (in terms of ground size) - and it may not prove to be that much, even. But until I know, I'm wary of just lumping all images with a stock set of coordinates, in case someone is affected by that error one day in the future, and something bad happens as a result. People might well rely on this stuff, so I'm being careful!

However, I'm slowly starting to work out how it might be addressed. I had some luck today with a PHP experiment (thanks to another GE user on this thread here.

For a VERY short while, I've put it up as a PHP program here which does a synchronized GFW/GIS fetch and then gives you a KMZ file for that radar (so that you then pull down the image and it's geo-located appropriately)

Give it a play-around, by all means.

It doesn't yet feature the warnings overlays, nor the legends (but I only have one pair of coding hands, see ). I did it more to find out how easily I could generate KMZ, and parse the geo-location files, rather than this be an 'end-product'... so expect that link to disappear in a few days, when I've cracked the right approach for the final version.

Quote:


Sorry it took me awhile to get back to you on this, but I had a lot of paying work to do today. In any case, it's very nicely done. A lot of data mind you, but a very nice start. We may want to think about how we group it in order to mitigate #1 above. Maybe a top level folder with all base reflectivities, and another folder with all relative velocities, and another with all 1hr precips etc. Just something to think about how it would be most useful for people using it...maybe the arrangement you currently have it in is best.....I just don't know until we talk about it and/or get some feedback.




Thanks for the compliments - and don't worry about the delay. I had a lot of paid work on today, too... but I managed to get it done and still have time for a play-around. Tomorrow I may not be so lucky

I think I'm in agreement with your idea for the hierarchy, because it reduces the number of overlaps that would be mutually exclusive, if the user ticked a high-level folder. Obviously, there's nothing we can do if they tick the very top one - but it makes more sense to have them 'bagged together' in terms of data-product. That way, if someone ticks '1-Hour Precipitation', at the high-levels, they'll see all coastal radars' rainfall images, plastered next to each other along the coast.

This is better than my original approach (to put them all in groups of each radar station) - which would mean if someone ticked a 'Lake Charles' tickbox at the high-levels, they would see all of Lake Charles' 7 data-products on top of each other (and thus mostly an unreadable mess).

Convenience-wise, I guess it all depends whether people tend to 'hunt by product-type' or 'hunt-by-radar-station' for their info, as to which is the best approach.

But 'safety-wise', it's probably more sensible to group things by data-type, rather than location, because at least then what's returned will usually make more sense.

Anyway - probably more to report tomorrow, if all goes well! Ta-ta for now!
Coastal Radar Network Link (v1.0) BigJacko 9/27/05 3:06 PM
EDIT: This Network Link has now been updated, and moved to this post here. Please read the warnings below anyway, before jumping to get the new file! Thanks


Well, I think I've done it... pretty much!

Attached is a KMZ file containing a Network Link to a remote KMZ file which holds all the coastal radar stations and all of the products they offer.

WARNING!!!!
There is a huge amount of data in this collection. DO NOT tick the top-level folders in either the Network Link itself, or the NWS RIDGE Radar Folder below it, or you will cause a huge pullback of data from the NOAA/NWS servers and possibly stall them.

When you first download and install the attached KMZ file, it SHOULD automatically fetch the sub-folders from my server. If this doesn't happen, try refreshing the Network Link (called Coastal Radar, at the very top level), by right-clicking on it, and then selecting Refresh from the drop-down menu.

When the folders have loaded, use the black arrows to open them and navigate downwards to the radar data-types you're interested in. Once again, DO NOT tick the high-level checkboxes!

When you finally get inside a 'data type' folder (such as Short-Range Reflectivity, or 1-hr Precipitation), you can safely select a few radar station names using their nodes. (Eg, put a tick next to Brownsville, TX, to overlay the chosen data-type, the warnings in force at that station, and the Legend).

You can, if you desire, go one level deeper inside each station, and turn off the warnings or the legend, if you prefer a clearer display.

Don't go nuts.... don't select too many radar-stations at once, and certainly, don't have multiple data-types showing for the same stations, if you're looking at more than two or three. Do the math... if you choose too many, it is possible to end up causing HUNDREDS of SEPARATE file-fetches from the same poor NOAA/NWS server, ok? Each station has 7 different types of data, plus 7 Legends, and 7 Warnings (which are actually the same files anyway). With all 21 stations & everything else on, you would be doing 441 file-fetches every 5 minutes!!!



Other information:
The Network Link is set to refresh every 4 hours, in order to get a replacement set of sub-folders from my server, and thus keep the geo-location data fairly fresh. This seemed more sensible than having EVERYBODY refresh the geo-location files via my poor server, every five minutes! It may, however, result in the occasional overlay not being pixel perfect in its position. Such is life. I'll be monitoring and tweaking this as we go forward, depending on what bandwidth gets eaten.

The radar stations themselves are set to refresh automatically from the NOAA/NWS site, every five minutes, so apart from chosing the stations you want to see, you should NOT need to manually refresh those (and you are advised against it, really). Every five minutes, your copy of Google Earth will pull back new images for each station selected, for each data-type selected, PLUS the warnings overlay and Legend files (because even the Legend files regularly change). That is QUITE enough potential for inundating NOAA/NWS as it is, so PLEASE don't keep refreshing the station-entries manually. NOAA/NWS only update their files once every 5 minutes anyway, so banging it won't actually get you anything new, ok?

Any comments or feedback welcome. Ultimately (if Paul is still up for it), we'll probably integrate this sub-set with the main Storm Tracking set that Paul's kindly provided. It may take us a while to get it right (and thus, this KMZ/Network Link is very much a beta-test). As such, it may disappear overnight, or be altered or cut-down dramatically in the next few days (depending on how stupid the bandwidth numbers turn out to be, or whether we get told to quit it, by NOAA!) Therefore, please bear with us, and use commonsense when playing with this tool. Thanks.
Re: Coastal Radar Network Link (v1.0) pseabury 9/27/05 3:19 PM
Going to look at it right now. I'm sure that it's good stuff before I even look, and I'll get back to you promptly.

Quote:


Any comments or feedback welcome. Ultimately (if Paul is still up for it), we'll probably integrate this sub-set with the main Storm Tracking set that Paul's kindly provided. It may take us a while to get it right (and thus, this KMZ/Network Link is very much a beta-test). As such, it may disappear overnight, or be altered or cut-down dramatically in the next few days (depending on how stupid the bandwidth numbers turn out to be, or whether we get told to quit it, by NOAA!) Therefore, please bear with us, and use commonsense when playing with this tool. Thanks.





The KMZ of the whole network link was usually around 4-5KB (pretty small !), but I ended up using over 8GB and almost 9GB this last month. I think part of this was due to people setting refresh rates to small intervals and/or forcefully updating it hoping that something had changed. Unfortunately, we can't alter the behavior of the users to not do this ( can we? ) , but I/we'd ask that you not do this as it could mean the difference between having this tool and not if the costs become prohibitive.

I'll get back to you in a bit.

Paul
Re: Coastal Radar Network Link (v1.0) pseabury 9/27/05 3:56 PM
Ok, first impressions.

1.) We need to break down the radards into smaller groups still. Being a programmer, I decided to try and break it like most good programmer would do. Anyway, long story short, ouch lol . I checked one group of radars (Short Range Reflectivity) and watched my v0.616 Client grow to well over 1GB in size. I think too many people will do that (or worse), and that's a bad thing. Even with warning and such, we either need to mitigate that risk even further, or dissallow them from doing that (currently impossible I think).

2.) Can we make the legend layer so that it requires explicit turn-on to be visible? I know that if people go through and set it like they want it with regards to legends on or not, those will keep their state even over refreshes....but it might be nice to maybe separate them completely from the actual radar to declutter, and make the legends a separate folder to be able to turn them on if the need arises.

3.) Maybe further separate the radars by Coast (ie. Atlantic & Gulf) to further reduce the possibility of a catastrophic checkbox?

This is one reason why I wish that we could get the raw reflectivity data and display it as we wish by generating our own images from it etc......but I still think this is a mountain of work and probably not the right course. Let me know what you think and thanks for the work Jacko .

Paully
Re: Coastal Radar Network Link (v1.0) BigJacko 9/27/05 5:15 PM
Quote:

Ok, first impressions.

1.) We need to break down the radards into smaller groups still. Being a programmer, I decided to try and break it like most good programmer would do. Anyway, long story short, ouch lol . I checked one group of radars (Short Range Reflectivity) and watched my v0.616 Client grow to well over 1GB in size. I think too many people will do that (or worse), and that's a bad thing. Even with warning and such, we either need to mitigate that risk even further, or dissallow them from doing that (currently impossible I think).



Agreed - but how? I've racked my brains thinking about ways it can be organised so that, on the one hand, it gives quick and easy functionality to those that want specific things, but which, on the other hand, doesn't make it dead-simple for a clueless noob to whack NOAA with a big stick.

Alas, because GE doesn't allow 'exclusive options' (radio-buttons, effectively), you're right - it's impossible to disallow dumbness. The best we can do is make 'dumbness more difficult' (by obscurity)... which limits the usefulness to those with brains.

Tough call...but I'm all ears.

Quote:


2.) Can we make the legend layer so that it requires explicit turn-on to be visible? I know that if people go through and set it like they want it with regards to legends on or not, those will keep their state even over refreshes....but it might be nice to maybe separate them completely from the actual radar to declutter, and make the legends a separate folder to be able to turn them on if the need arises.



Technically, the Legend DOES need explicit turn-on to be visible. At least, to the same degree that everything else does! It's shipped 'off'... its just that if you select the tick-box for (say) Brownville, then the triplet of 'image, warnings & legend' below it is turned on - same as any other node, really.

Moving it to a separate 'Legends' folder (and similarly, one for Warnings, maybe) makes life difficult. First, the Legends - moving them to a separate folder would mean that someone who'd pulled up (say) 'Short-Range Reflectivity' for Lake Charles, and who wanted to see what colour scale was being used today, would then have to go shuffling off to the Legends folder, open that, then drill down till they found Lake Charles, then turn on the Legend. All a bit long-winded and inconvenient - purely for the sake of 'stopping stupid things from happening when stupid people are in control'... which, chances are, ain't them.

Similarly, with Warnings - I had thought about making them (effectively) a separate 'data-product' and giving them a folder of their own. But here we run into another wrinkle... the Warnings overlay is different for the Long-Range image (because it's bigger). This would mean that the Warnings folder would contain sub-folders for all 21 radar sites, each containing two Warnings overlays. People would have to remember that when looking at the Long-Range Reflectivity, they'd need to use the right warnings overlay, or else the geo-location will be completely off. Again, functionality would be impaired, I think - and certainly convenience would take a big hit.

Quote:


3.) Maybe further separate the radars by Coast (ie. Atlantic & Gulf) to further reduce the possibility of a catastrophic checkbox?



Yeah, I was thinking about this one too. Might be enough, perhaps. Or even divide them by state, maybe? Again, it doesn't physically STOP some idiot clicking the top-node... but nothing will, quite frankly. This might be a good halfway-house.

Something else I'd thought of was shipping a root-level KMZ which contained several Network Links, and somehow making the selection of one 'remove' the sub-trees on the others. Haven't quite worked out if that's possible - but gave up when I realised that it would mean people fetching the KMZ each time they changed their minds about what data-type they wanted to see... I don't think my humble 400MHz webserver would cope, quite frankly!

I'm still working on a few other thoughts which might help, but really, I think it's a GoogleDev topic for consideration. As the program becomes evermore popular, the chances of this kind of 'massive attack' KMZ becomes more evident, and I think they really will need to give us developers the ability to make certain selections mutually-exclusive, and prevent alteration of things like refresh times, etc. Or the program will simply get a bad reputation as a webserver rapist, worst-case.

Quote:


This is one reason why I wish that we could get the raw reflectivity data and display it as we wish by generating our own images from it etc......but I still think this is a mountain of work and probably not the right course. Let me know what you think and thanks for the work Jacko .




Anytime - it's been fun... a good challenge and a worthy cause. I'm sure we can come up with something that'll suit everyone's need, sooner or later! Keep those ideas coming... I'll put up a new version tomorrow if I get some time (my paying clients have a busy day planned for me on other things tomorrow, so there may not be a huge amount of changes, but we'll see).

Night all!
Re: Coastal Radar Network Link (v1.0) pseabury 9/27/05 5:54 PM
Quote:



Agreed - but how? I've racked my brains thinking about ways it can be organised so that, on the one hand, it gives quick and easy functionality to those that want specific things, but which, on the other hand, doesn't make it dead-simple for a clueless noob to whack NOAA with a big stick.

Alas, because GE doesn't allow 'exclusive options' (radio-buttons, effectively), you're right - it's impossible to disallow dumbness. The best we can do is make 'dumbness more difficult' (by obscurity)... which limits the usefulness to those with brains.

Tough call...but I'm all ears.





I still have no solution either, other than an improvement to the GE Client, or a different data source.

Quote:



Technically, the Legend DOES need explicit turn-on to be visible. At least, to the same degree that everything else does! It's shipped 'off'... its just that if you select the tick-box for (say) Brownville, then the triplet of 'image, warnings & legend' below it is turned on - same as any other node, really.

Moving it to a separate 'Legends' folder (and similarly, one for Warnings, maybe) makes life difficult. First, the Legends - moving them to a separate folder would mean that someone who'd pulled up (say) 'Short-Range Reflectivity' for Lake Charles, and who wanted to see what colour scale was being used today, would then have to go shuffling off to the Legends folder, open that, then drill down till they found Lake Charles, then turn on the Legend. All a bit long-winded and inconvenient - purely for the sake of 'stopping stupid things from happening when stupid people are in control'... which, chances are, ain't them.





I hear ya on that, and didn't explain all that clearly before because I was pressed for time... (actually was going to use the radio group example lol), but that's exactly what the client API, if you want to call it that, needs.

Another point on this that I can clarify in regards to generating our own images from raw return data is that the need for multiple legends would not be necessary. This is similar to how (and why) I did the SST data the way I did. Take all the data, and transform it via your own parameters so that's it's uniform across the board....then only 1 legend is neccesary. Again, this is the best solution, but likely the most difficult (not logically, but timewise investment). I think the entirety of the Gulf and Atlantic SST coverage results in less than 100KB of image data at (.25 x .25) degree resolution. This includes ALL of the SST folders. SO you can see the advantage to that now that we sort of have a benchmark for the way of aggregating premade imagery.

Still not saying that doing it ourself is the answer, but just trying to paint a full picture so that we can weight our options carefully.

Quote:



Yeah, I was thinking about this one too. Might be enough, perhaps. Or even divide them by state, maybe? Again, it doesn't physically STOP some idiot clicking the top-node... but nothing will, quite frankly. This might be a good halfway-house.

Something else I'd thought of was shipping a root-level KMZ which contained several Network Links, and somehow making the selection of one 'remove' the sub-trees on the others. Haven't quite worked out if that's possible - but gave up when I realised that it would mean people fetching the KMZ each time they changed their minds about what data-type they wanted to see... I don't think my humble 400MHz webserver would cope, quite frankly!





Agree that further parrying down the data into chunks doesn't ultimately help because the top level is still a bastard....and the further it's divided, the more cumbersome the interface for the user becomes.

About the network link magic.... I've tied my brain around that a couple of times since you brought it up, and can't work out a way that could make that happen. May be possible, but I'm just not aware of it. What we desperately need is a REAL Api that we can program against. I don't find it too offensive to think of this link as an actual application that makes calls directly into the GE Client, but again we don't have that available to us....yet. I made a post in the support forum regarding this issue here

I'll be looking for a new version in the next couple of days, and thanks again.

Paul
Coastal Radar Network Link (v1.1) BigJacko 9/29/05 6:56 AM
Quote:



Another point on this that I can clarify in regards to generating our own images from raw return data is that the need for multiple legends would not be necessary. This is similar to how (and why) I did the SST data the way I did. Take all the data, and transform it via your own parameters so that's it's uniform across the board....then only 1 legend is neccesary. Again, this is the best solution, but likely the most difficult (not logically, but timewise investment). I think the entirety of the Gulf and Atlantic SST coverage results in less than 100KB of image data at (.25 x .25) degree resolution. This includes ALL of the SST folders. SO you can see the advantage to that now that we sort of have a benchmark for the way of aggregating premade imagery.

Still not saying that doing it ourself is the answer, but just trying to paint a full picture so that we can weight our options carefully.




Yup - I understand - trouble is, the sheer amount of data that I or you would be required to fetch from the NWS every five minutes, if we did it that way. I don't think my systems could take it, frankly! Especially when coupled with that fact that once we'd grabbed and reorganised that bitmap data, we ALONE would then be responsible for shipping it back up to however many clients were using the Network Link, plus the KML itself! It could become an extremely heavy load, very quickly.

I suppose if we were going to do a 're-sampled' set of overlays, for GE users, we could limit the number of updates to one every hour, or something - but then the whole project starts to be come less useful in the GE environment... simply because people KNOW they can get the data from direct from the NWS website every 5 minutes....

Argh... this is such a great concept... but entirely banjaxed by the rather short-sighted limitations of KML. I do hope they fix it soon...

Quote:



Agree that further parrying down the data into chunks doesn't ultimately help because the top level is still a bastard....and the further it's divided, the more cumbersome the interface for the user becomes.




Well, I've given it a bash... I've reorganised the layout into Gulf and Atlantic layers - but all the problems about top-level check-boxes still remain, of course (Come on GE developers, at least acknowledge that you're aware this is a problem, per-lease! ).

Anyway - new version V1.1 of the placemark attached. Differences are...
  • a few more warnings, just in case people haven't twigged the issues already
  • reorganisation of the layers into Gulf & Atlantic folders
  • Network Link now set to refresh the underlying KMZ from my server once every HOUR now (instead of once every 4). This is an attempt to keep the geo-location data (which has to be hard-coded into the KMZ) more fresh. I will be monitoring to see what the effect of this is on my webserver!

As before - please heed the warnings contained within the placemark itself, and on this post here
Re: Coastal Radar Network Link (v1.1) OneJam 10/2/05 10:35 AM


Idea.....Way not ask the GE website admin to host the info.......a script would copy or transfer the info to GE's website for access. The bandwidth would increase on GE's website but an extra 500GB would not be anything major for that organization.

What I'm really suggesting is that Google allows us to host info on their servers permanently or until they allow us to use the SDK to code arround this problem.

This would also solve the problem not elegantly but workable.

Anyone with strong contacts with GE staff to put his forward to them urgently.
Re: Coastal Radar Network Link (v1.1) BigJacko 10/3/05 5:34 AM
A great idea, OneJam.

Alas, I have no 'in' at Google, but maybe a mod will pick up this thread, and see the potential? Good things come from collaboration, and Google seems much more attuned to that idea than some companies I could mention.

Anyway - have people been using the Coastal Radar v1.1 Network Link with any success? I know there's not a lot of activity on the radar lately (thank goodness - we don't need another Katrina or Rita!)... but I'd like to know what people's feedback is, about this placemark-set.

I've heard from someone else on another thread that they sometimes have trouble fetching the folders back, when they first use the link. Has anyone else experienced this? Does anyone have a clue why GE misbehaves with KMZ-based Network Links?

All feedback greatly appreciated, cos I'd like this to ultimately be useful to people.
Re: Live Tropical Data and NHC Storm Forecast Mode bkdelong 10/3/05 11:12 AM
Hey Paul -

What's the URL you're getting your location and models details from? Specifically I'm looking for a link to Invest AL922005 about 30+mi northeast of the Crooked Islands and 450+mi SE of Miami, FL.

Can you ADD the URL or links to the Weather data you're pulling so we can get to them or send other folks that way?
Re: Coastal Radar Network Link (v1.1) bkdelong 10/4/05 2:12 PM
Check out NING.com, which launched today. They're working through some login issues but it looks like various Dynamic Data Layer PHP apps can be hosted there.

If that's possible then this is a perfect place for the "live data" Google Earth files to live.
Re: Coastal Radar Network Link (v1.1) BigJacko 10/5/05 5:55 AM
Cool - thanks BKD, for the tip-off.

I've had a quick look, and from what I can tell, you're right... but I have a slight concern that they might not like (a) the load (when it cranks up to full speed next time there's a hurricane loose in the gulf) or (b) the fact that users technically don't have to 'view' the app at the Ning site. Once they have the KMZ file, it's all viewed within GE, and Ning is just 'pulled-from'. I'm wondering if (longterm) they'd prefer vistors to the site in a browser, because that way they get to see the ad-banners which (may) ultimately generate the revenue for the Ning project to survive.

Still, I'm not saying it WON'T work, at this point...

I'll keep an eye on Ning, and see what develops. If I can get a login, I might find out a bit more about any restrictions.
Re: Coastal Radar Network Link (v1.1) bkdelong 10/5/05 6:45 AM
Good point. Perhaps somewhere in the KMZ popups/label/description you can put a link. Definitely worth talking to them about it - I'll send an email.
Re: Coastal Radar Network Link (v1.1) BigJacko 10/5/05 8:50 AM
Cool - thanks.

I've signed up for the Beta-Dev program - we'll see what happens in due course when they respond.

It looks like a great idea (and I can think of other uses for it too, aside from this project ).

If we can do it, it's probably better-suited to Paul's original idea of actually grabbing ALL the data, and reprocessing it into a bunch of similarly-scaled images, so that there is less overall pressure on the NWS servers.

It would mean a fair bit of re-coding here, but I might work on it if anyone's still interested (and if time permits).

At the moment, I have a PHP file on my home-server, which fetches the geo-location data, and rebuilds the KMZ file every hour. People using the Network-Link re-fetch that KMZ from me every hour, and then their machines in turn, fetch the selected images direct from the NWS (but with hopefully geo-location positions that are less than an hour old, so not too far drifted).

Currently, I have the PHP running as a sheduled task on my server, so it merely 'dumps' the new KMZ to the location where the Network Link points to...

...which leads me to another problem... is there a way of making a NING PHP app run on a scheduled basis, or have they coded the site in such a way that they expect people to actually VISIT the php file itself?

I guess I can re-code it, so that it goes back to a network-link to a php file which does a 'live' re-fetch from NWS and spits out the geo-formatted KMZ - but that then means 'random-access' hits on NWS for the geo-location data, thus adding to their load.

I wish we could make the NWS host this themselves - it'd be great!

More to the point, I wish GE could be made a little 'smarter' so we can stop users from dragging the whole set of radar images back at once, by clicking that top-level folder... Surprised we've not heard any comment from the GE Devs on this score
Re: Coastal Radar Network Link (v1.1) bkdelong 10/5/05 8:56 AM
Well, they created RSS files and podcasts....why wouldn't the same group do conversions to KMZ files? Need to find the right people.
Hanging Invest in SE Florida/ New One where Stan.. bkdelong 10/5/05 9:31 AM
Hey Paul -

I have Tropical Invest AL922005 which I thought became TS Tammy, yes? Should the Invest still be lingering?

Also, a new Invest popped up, (AL932005), almost in the exact area Stan originated in. Is this a new one?

Finally, where is the URL you get your Invest info from?

Thanks
Re: NHC Track Forecast Models CapeVerde 10/10/05 2:22 PM
The upper ocean content layer would be very useful. And if you can ever figure out how to add some of the other model forecasts like the ukmet or gfdl models, I'll be thrilled!
Re: Live Tropical Data and NHC Storm Forecast Models gecci 10/24/05 2:19 PM
Hi there,

This is great stuff. I was interested in digging into the implementation a little more. You mention:

"pulls the lastest forecast tracks and predicted strength for tropical named storms (Depression, Storm, Hurricane) from the National Hurricane Center"

Would you mind posting a little more detail here? Like, where exactly did you go for this data? Is it an rss feed that you need to parse and geocode?
Re: Live Tropical Data and NHC Storm Forecast Models rosdol 11/15/05 1:42 AM
Hi, I was just using GE with the tropical forecast data. I am getting old data (i.e. storm Beta and AL902005)

Currently there is only TD 27 active in the carribean. the forecast tracks seem to be out of date.
I have downloaded and reinstallled NHC_Models1.knl but still the old tracks.

Any solution ??

thanks and regards
_________________________
Hewhoflieswithbirds
Re: Live Tropical Data and NHC Storm Forecast Mode SoFlaChris 11/19/05 10:10 AM
Concur... Seeing same here. (Forgive the "me too" post... Just enthusiastic)

Chris
_________________________
chris :: wired
Re: Live Tropical Data and NHC Storm Forecast Mode ItsAllInYourHead 6/12/06 1:14 PM
Okay, what happened to this network link? I'm shocked people haven't been asking about this all over the place!
_________________________
-Kevin
Re: Live Tropical Data and NHC Storm Forecast Mode bkdelong 6/12/06 1:52 PM
Quote:

Okay, what happened to this network link? I'm shocked people haven't been asking about this all over the place!




I emailed Paul directly to see what's up and if he needs network hosting due to bandwidth issues.
_________________________
-- B.K. DeLong (K3GRN) bkde...@pobox.com +1.617.797.8471 http://www.wkdelong.org Son. http://www.haloworldwide.com Work. http://www.bostonredcross.org Volunteer. http://www.brain-stream.com Play. http://www.the-leaky-cauldron.org Potter. PGP Fingerprint: 38D4 D4D4 5819 8667 DFD5 A62D AF61 15FF 297D 67FE FOAF: http://foaf.brain-stream.org
Re: Live Tropical Data and NHC Storm Forecast Mode CapeVerde 6/14/06 1:23 PM
Great!

I really miss having this overlay.

CV
Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 6/18/06 3:21 PM
BKD,

I got your message on wunderground.com, and responded (I think). Anyway, I'm trying to resurrect this thing right now, making sure data feeds are still up/maintained etc. . I can't be sure all this will work until I get new model data from NHC (ie. we need a storm to check it out). I think I'm ok with bandwidth, but I'll let you guys know if that becomes a problem. I'll keep you posted over the next week or two as to the status.

Paul
_________________________
There are 10 kinds of people in this world... those that understand binary, and those that don't.
Re: Live Tropical Data and NHC Storm Forecast Mode bkdelong 6/18/06 5:09 PM
Thanks, Paul. Looking forward to it. I'd love to work with you to potentially integrate gulf shore water gauges and such.
Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 6/18/06 8:12 PM
Working to make the SST (Via microwave @ 25km^2 resolution - www.discover-earth.org) better, along with adding Full Gulf/Atlantic radars via NWS.

Basically I'm going through my code and fixing any bonehead logic...along with trying to get ready to attack the model data logic for a complete overhaul. I see having something equivalent or slightly better than last year in a week or so (assuming we can get a TD or TS to track)...and then improving it over the course of the season. I need to get knee-deep in the newest kml spec to see what, if anything, I can now do better with the maturity of the spec.

I'll be slower during the week, but I'll keep in touch.
Re: Live Tropical Data and NHC Storm Forecast Models Daniel43 6/19/06 8:27 PM
hey this old data of the 2005 hurricane season, can you something to fix this problem?
_________________________
GOOD LUCK!
DAN
Re: Live Tropical Data and NHC Storm Forecast Models ed.sterrett 8/2/06 6:22 AM
It's been a year since this thread was front and center- worth taking a look at by those who have joined the community since then.

Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 8/19/06 9:14 AM
All,

As usual work is keeping me to a minimum of free time but I did update the link in my original post (page 1, post 1) to show the current data. The current data was actually being uploaded daily since the start of this season, but the network link kmz hadn't been updated to reflect that....sorry about that.

All the data is still up there in the form that it was most useful last season, and all of the new ideas haven't been forgotten about, just the time to implement them has.

The only issue I occasionally see it that the radar images aren't always available (ie. a radar is actually down, or radar.weather.gov serves a corrupt image...neither of which I can really do anyhing about.)

Regards,
Re: Live Tropical Data and NHC Storm Forecast Mode pseabury 8/25/06 2:24 PM
Now that we have some active storms I'd appreciate if you guys (the users) let me know if you see any problems other than outside bandwidth (ie. image overlays from cimss.ssec.wisc.edu or radars etc). I think my bandwidth is holding up fine, and surprisingly enough I am working on getting the source code in shape to release to you guys here. I'm just adding proper databasing (via db4o) and cleanup where possible. I'm on the database kick now, and it seems to be working to my satisfaction, so I'll let you know.

When I do release the source code, the only thing you'll need to have to make it work fully are a copy of visual studio which is a free download for the standard edition(or if someone wants to port it to monodevelop or eclipse), an internet connection to retrieve the raw data as the program runs, and a hosting account to upload the kml output to if you want to publish it.

I'm sure once you guys have the ability to mod the program yourselves(and the TIME!!!), then all the modifications we've batted around will pop up. (Hint BK DeLong )

Regards,

Paul
Source Code *DELETED* pseabury 8/27/06 7:38 PM
Post deleted by pseabury
Re: Source Code jptheriot 8/29/06 6:02 AM
Paul,

The addition of tracking history is great. Could you change the color to make it stand out a little.

Great work, especially with the addition of coastal radars!!

Jp
Re: Source Code pseabury 8/29/06 7:11 AM
Yeah...I noticed that too, it needs to be a lot lighter in color. I'll change it this evening. Thanks for the input.
Re: Source Code pseabury 8/29/06 3:45 PM
Ok, I have a Subversion repository up at Google Code ( http://code.google.com/p/tropicalwatch/ ). If you want write access just msg me or somehow let me know you want to be able to check stuff in and provide me with your gmail username.

The anonymous SVN is at http://tropicalwatch.googlecode.com/svn/trunk/ .

I'd rather see people that want to develop this link let me add you so that we can aggregate our changes and not have a bunch of disparate versions floating around.

If you're looking for a good Subversion client for Windows, I'd suggest TortoiseSVN ( http://www.tortoisesvn.org/ ).

I'm still tracking down a bug, so the link may be a little flaky tonight...I could create a separate test branch for that, but with time in mind I'd rather just mess with the live version.
Dynamic Radars pseabury 8/30/06 8:42 PM
Changes:

1.) The only radars listed in the network link will be those that are within 300NM of the last reported center. As the storm moves, different radars will be available automatically. Pretty cool eh?

2.) Radars now updated to show all that the NWS has to offer. Precip, velocity, long range, etc.

3 .) Also changed the radars to radio folders so that you can't load them all at once. (Will do the same to SST soon... well unless someone starts checking their own code into the repository - HINT:) )

4.) Also included the NWS/NOAA screen overlays to give them credit where credit is due.
Tropical Watch - Buoy Data Coming pseabury 8/31/06 5:57 PM
All, I'm in the process of adding buoy data to the link just like I did the radar. It will dynamically load the nearest buoy data as the storm moves. I'm having some formatting issues at the moment, and another snag is that the kml <description> tag that populates the balloon with text/info doesn't allow dynamic info like php/scripts etc. I'd like the graphs for the buoys to appear in the ballons, but they are generated via php on the fly at the NBDC. I'll get the buoy stuff wrapped up this weekend.
Re: Tropical Watch - Buoy Data Coming pseabury 9/4/06 12:46 PM
Ok, I spend a whole lotta time adding buoy data for all of the Carribean, the GOM, and up to the mid-Atlantic. What that means is that when a storm gets near any of these buoys, they will show up in the link and a graph of their data will show in the popup balloon. I also reorganized the link to be a little cleaner, and totally refactored the source code.

Right now there's only 1 buoy (41041) near (AL062006) TROPICAL DEPRESSION SIX, but you can watch the barometer, wind speed, wind gusts on the graph and/or load the NBDC page with more data for that buoy. Any storms closer to the US should give lots of buoy data.

Also the radar is still dynamic, so until a storm gets within range of a radar, you won't see any on the link.
Re: Tropical Watch - Buoy Data Coming stratnavcpo 9/5/06 2:15 PM
Paul - First off I would like to say that I enjoy your product - it is the best I have seen!

I am having a wee bit of a problem - the SST, the Satellite Images, and the Analysis always load when I start GE. I have turned them off and exit GE, but when I start GE again they come back on. Is there a way to turn them off so they do not come back on?

Thank you for your time,
Lyle

EDIT - 9/5/06 @ 9:45pm EDT

Well they are off now . . . I selected the ‘off’ on each of them, then right clicked each and selected 'snapshot view'.

Again thank you for your time - Lyle
Re: Tropical Watch - Buoy Data Coming pseabury 9/5/06 8:38 PM
I changed some of the source around and looked at your problem because I've noticed it myself. It stems from the new ListStyle - radioFolder Kml tag I think. I created specific empty folders, called "off" that I tell it to select by default, but it ignores them. My guess is a bug in the GE Client implementation of this tag...or it could be me, but I've looked pretty hard and it's just not doing what I'm telling it to. I'll keep making changes as time permits. I know there are still some minor formatting annoyances with the link, but it's getting better over time. Thanks for the kind words, hope you enjoy.
Re: Tropical Watch - Buoy Data Coming jcothran2 9/7/06 12:39 PM
Hi Paul,

Again great work this hurricane season on providing and packaging some great data feeds to kml/kmz.

My work similarly involves collecting buoy data and observations from the same sources using the same routines. Feel free to re-utilize via XPath or XSLT these existing feeds and time series graph product references via hourly referesh as:

zipped xml

kmz

you can also generate a query for a specific bounding box, platform or parameter using the REST oriented web service documented at

SEACOOS REST web service

or see some perl coding examples for gathering data from federal sources at get data code examples

What I would be interested with developing in conjunction with you or others is a more standardized rss type feed for latest observation data from platforms so developers can spend more time on the tailored product and packaging output end and less time on the repeated data gathering input end.

I've developed a basic xml straw man at ObsRSS
and am curious if other developers have feedback on this or something similar.

Thanks again for all the work,
Jeremy Cothran
Software Developer
Caro-COOPS
SEACOOS
Re: Live Tropical Data & NHC Forecast Models - Src pseabury 9/7/06 7:51 PM
Adding NHC Discussion data in addition to 4 computer models. This will break the database and so will lose trackhistory, so I'm waiting for Florence to become a non-issue before I stand these changes up live. Of course some other minor formatting improvements etc...recon/vortex to come. Stay tuned.

Paul
Re: Live Tropical Data & NHC Forecast Models - Src pseabury 9/9/06 1:29 PM
Ok, NHC Discussion data are now added per storm...if they exist. This lets you look at the history of how NHC has forecasted a storms path relative to its actual track. You can also obviously read the full discussion in the balloon for additional information.
Re: Live Tropical Data & NHC Forecast Models - Src pseabury 9/9/06 1:52 PM
I see a problem whereupon a refresh, the model track points dissapear (or get turned off). I just took a look at the code and kml, and I'm definitely telling it to NOT DO THAT. In any case...just bear with it for awhile until I can find a workaround for it.
Re: Live Tropical Data & NHC Forecast Models - Src fixman88 9/9/06 8:37 PM
I'm new here, but I've become a GE junkie ever since I bought my new computer (6 days ago!) This NHC add-on I really like a lot! I have my email set up to get regular reports from the NHC, but this is way better!
_________________________
Google Earth Fan Since 9-3-06 (when I got my new computer) Vulpix Fan Since 1998
Re: Live Tropical Data & NHC Forecast Models - Src pseabury 10/5/06 7:15 PM
Expanded SST's to cover entire globe (formerly just Northern hemishpere and Atlantic).

It's interesting to see the 7 day delta map...you can make out the El Niño event on the west coast of South America, and the cold water wake(s) in the western Pacific from the recent storms.
Re: Source Code pseabury 4/2/07 6:22 PM
New Layer coming for this season. See the new thread.
More topics »