Download dmes_talk - My FIT (my.fit.edu)

Survey
yes no Was this document useful for you?
   Thank you for your participation!

* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project

Document related concepts

Clusterpoint wikipedia , lookup

Big data wikipedia , lookup

Database model wikipedia , lookup

Functional Database Model wikipedia , lookup

Transcript
The DMES Meteorology Web Page and
Meteorology Education Software
Dr. Steven M. Lazarus
February 22, 2006
With contributions from:
Mike Splitt
Tim Coulter
Dale Means
Chris Hicks
Frank Leslie
Outline
Web pages overview
Unidata software:
GEMPAK
GARP
NSHARP
NMAP2
IDV
DMES Meteorology Home Page
*PHP based (linux scripting language, e.g., perl)
1. Student contribution/participation:
FITSCAMS
scroll bar
national forecast contest
employment/employer links
2. Real-Time Data Flow
on-campus (Roberts Hall, Suominet/GPS)
off-campus (LDM)  processed locally
MYSQL Data Base (on campus server)
3. Research/Courses
papers
presentations
syllabi
course material
4. Meteorology External Links (Favorites)
http://my.fit.edu/wx_fit/home/
What is scripting?
creates a file that:
1. logs into database
2. inserts data
3. runs script
cat << EOF > insert1_db.csh
#!/bin/csh
mysql -ujefstath -pjames135 UDB_jefstath_metdata << XXX
EOF
cat << EOF >> insert1_db.csh
INSERT INTO table1 (uploadtime, timegmt, pwv, pressure,
temp, rhumidity) VALUES ($ymdhms, $gmt1, $pwv1, $pmb1,
$tmp1, $rhu1);
VARIABLES
exit
XXX
EOF
# INSERT SOUMINET DATA INTO DATABASE
echo insert 30 data
csh $DATA/insert1_db.csh
fully autonomous (runs on server ‘crontab’)
hr
mo
00 07 * * 1-4 csh /users/faculty/slazarus/scripts/nfc_remind
min day day of week
pathname/file
Data availability: FIT (external)
• Meteorological and Oceanographic!
– surface weather observations
– C-MAN/buoy/ship
– atmospheric soundings (radiosonde)
– satellite (Visible, IR, Water Vapor)
– atmospheric models (RUC, GFS, Eta)
– wave model (NOAA Wave Watch)
– ACARS (aircraft)
– GPS
– dropsonde
– TAFS (terminal aerodrome forecasts)
– SIGMETS (severe weather, icing, turbulence, etc.)
– MOS (model output statistics)
Data flow to FIT: Cumulus/Olin
Tape Archive
CUMULUS
163.118.15.109
FTP
olin
my.fit.edu
163.118.131.24
software
LDM
A Work in Progress! Many other
data feeds can be added!
User
User
User
LDM
The Unidata Local Data Manager (LDM) is a collection of
cooperating programs that select, capture, manage, and
distribute arbitrary data products. The system is designed
for event-driven data distribution, and is currently used in
the Unidata Internet Data Distribution (IDD) project. The
LDM system includes network client and server programs
and their shared protocols. An important characteristic of
the LDM is its support for flexible, site-specific
configuration.
http://www.unidata.ucar.edu/software/ldm/
What is GEMPAK?
• GEMPAK, the GEneral Meteorology PAcKage, is
a suite of applications programs, libraries,
graphic routines, and device drivers for the
decoding, analysis, display and diagnosis of
geo-referenced and meteorological data.
GEMPAK provides a comprehensive set of
meteorological parameter calculations for
surface, upper-air, gridded, and remotely sensed
data.
• http://www.unidata.ucar.edu/packages/gempak/
GEMPAK
scriptable
research quality graphics
Concept Driven
•thermal wind
•vertical motion and mass conservation
•tilting of wave with height (baroclinic wave)
•cyclogenesis
•frontogenesis
•Advection
•thermodynamics (adiabatic processes, inversions, etc.)
What is GARP?
GEMPAK Analysis and Rendering Program
• X
Windows/Motif
software
application
designed by COMET* staff for the display and
analysis of meteorological data sets.
• GARP is a GUI interface to GEMPAK data
sources. It is more limited than using
GEMPAK directly.
*Cooperative program for Operational Meteorology, Education,
and Training.
What is NSHARP?
• NSHARP provides an interactive graphical
interface (skew-T/Hodograph) for atmospheric
soundings.
What is NMAP2?
• NMAP2 NMAP2 provides a graphical user
interface to the GEMPAK library functions, as
well as user interactive and synchronous
drawing, looping and product generation
capabilities.
What is IDV?
Four-dimensional visualization of satellite imagery,
gridded data (e.g., numerical weather prediction
model output, Climate Diagnostics Center grids),
surface observations, soundings, NWS NEXRAD
Level II and Level III RADAR data, and NOAA
National Profiler Network data, within a unified
interface. The IDV can display any Earth-located data
if it is provided in a known format .
How can I get my grubby hands on your data?
METHOD 1: Graphic User Interface (GUI) in MS environment
Instructor Workstations (cygwin)
a. log on
b. double-click on ‘xterminal’ icon
c. in ‘X’ box, type ‘xhost +’
d. in ‘X’ box type ssh –Y olin.fit.edu
e. login to your u-drive/tracks account
f. need ip to set display to current terminal
- go to start menu and select ‘run’
- type ‘cmd’ at command line
- type ‘ipconfig’ in command window
g. Go back to e.) and type (in the ‘X’ box):
setenv DISPLAY 163.118.##.####:0.0
What else is there?
OPeNDAP/ DODS (LDM for Ocean & Atm data!)
•OPen source Project for a Network Data Access Protocol)
is a protocol for accessing distributed scientific data (aka
DODS DAP).
•software framework (Netcdf-Java libraries) that simplifies
all aspects of scientific data networking, allowing simple
access to remote data.
•community of users and developers
•data delivery architecture provides remote access of data
via internet.
•uses HTTP (FTP, GridFTP, Telnet, et cetera) to transport
data
Identifying Data Sources
Thematic Realtime Environmental Distributed
Data Services (THREDDS)
bridges gap between data providers and data users
data from a multitude of sources:
Climate Diagnostic Center (CDC)
Fleet Numerical
National Centers for Environmental Prediction (NCEP)
National Climatic Data Center (NCDC)
http://www.unidata.ucar.edu/projects/THREDDS/