root/docs/usc/docs/JCothran_DevelopmentPlan1.txt

Some development plan notes from twiki page http://nautilus.baruch.sc.edu/twiki_dmcc/bin/view/Main/DevelopmentPlan1

    * Discussion phase - in-situ, rs, model
    * Development concerns
    * Xenia overlapping concerns
    * Related documentation, applications
          o Feeds
          o Documentation
    * trac tasks
    * Developer
          o possible shared
          o Jeremy
          o Monisha
          o Jesse
          o imagemap notes

Discussion phase - in-situ, rs, model

available data or products from provider(s)

data format - image, netcdf,etc

credits/disclaimers
temporal/spatial resolution of data/display/visual legend
qc

Data processing is either:
  file-oriented(high-volume gridded data like: WMS image, netcdf->shapefile)
  database/xenia oriented(low-volume sparse in-situ)
   
display or other follow-up issues

Development concerns

#technical documentation
data,product development documentation - subversion
usual tools - shapefile and other default product training, try to keep number of tools/techniques within a minimum for simplicity

#redundancy
redundancy/failover of data, product? as test of documentation. system backup? server/development redundancy/planning

#marketing and user documentation
website documentation/examples on data, products, services, desktop tools
   marketing/training brochures/powerpoints/video
   users - EMD, Coast Gaurd, SAFMC(tina udouj), murray brown(arcgis, mapwindows)
   discovery registries

#usual set of output formats/products, concerns
portal_rs, portal_obs, seacoos website image, animation, animation combinations?
WMS, GetCapabilities, ArcGIS
WFS on latest platform/obs for xenia

shapefile http archive
   readme&large folder or subfolders?
   in-situ, rs, model
search page for time infrequent product_id

csv by platform/observation for xenia
dods/opendap - xenia rdbms interface to in-situ with documentation
individual data provider dods/opendap servers

kml/obskml/obsrss, openioos,oostethys ogc/sos,ioos catalog
notification, sensor inventory

Xenia overlapping concerns

xenia website
   :below products are available in both SI/EN units
   html readout
   graph pages based on platform
   latestXML/ObsRSS
   archive CSV by platform(could be better optimized)

   time series query - graph, table, download
      graph types:time series, vector plot(coming)
   copy file of multi_obs, manual lkps for replication

   add_on:
      dods/opendap rdb server to multi_obs/lkps
   
   planning to develop:
      last xml/hazard readout fixes for CC
      kml by platform/obs(could be via SOS, but also separately)
      SOS/IOOS catalog/sensor inventory 
      query&download
      qc&notification - no/bad data, event range/change
      dynamic platform/sensor addes via xml, netcdf (still manual for now)
      automated lkp population order for replication

      archive CSV by obs
      CSV platform/obs->netCDF
      CSV exchange for ctd,etc
      platform/obs to shapefile/hotlinks/WMS+legend wrapper
      
      //dashboard readouts - develop last or use other off-shelf tool like FusionCharts

   registry/desktop training tools for:
      kml/ObsRSS
      SOS/IOOS catalog/sensor inventory
      dods/opendap
      images/animations+legend, shapefiles, WMS+legend
      CSV,exchange and/or netcdf(opendap)
      other data provider holdings
      
      modelers,etc work on metadata(credit,disclaimers,qc), temp/spatial resolution, common visual key
      netCDF->shapefile->WMS+legend
      image->WMS+legend
   
      MapWindows, ArcExplorer9(jesse?) WMS feeds? - murray brown
      tina udouj - SAFMC?
      simple products: sort datasets, shapefiles by indexes of interest(flooding for example)

Related documentation, applications

Seacoos
http://seacoos.org
Seacoos netcdf
http://seacoos.org/documents/metadata Seacoos cookbook
http://seacoos.org/documents/cookbook

Xenia package (general relational database schema for in-situ obs support)
http://nautilus.baruch.sc.edu/twiki_dmcc/bin/view/Main/XeniaPackageV2
http://nautilus.baruch.sc.edu/twiki_dmcc/pub/Main/XeniaPackage/XeniaPackage.ppt
http://nautilus.baruch.sc.edu/twiki_dmcc/bin/view/Main/XeniaSampleCase

Seacoos portal_rs http://nautilus.baruch.sc.edu/portal_rs
http://caro-coops.org/documents/presentations/seacoos/seacoos_mum_2004.ppt

Seacoos portal_obs http://nautilus.baruch.sc.edu/portal_obs

Seacoos portal_model http://nautilus.baruch.sc.edu/portal_model
Caro-COOPS
http://carocoops.org

Dashboard readouts http://nautilus.baruch.sc.edu/carocoops_website/buoy_detail.php?buoy=WLS2
Graphs http://nautilus.baruch.sc.edu/carocoops_website/buoy_graph.php?graph_type=all&interval=1_day
Query&Download http://nautilus.baruch.sc.edu/carocoops_website/buoy_query.php?platform_id=WLS2&observation_id=all

Storm surge products
http://nautilus.baruch.sc.edu/hurricane/latest/ Waves
http://carocoops.org/waves Longbay
http://carocoops.org/longbay/realtime.php Marmap
http://carocoops.org/ctd Carolinas Coast
http://carocoops.org/carolinas

Carolinas Coasts design concepts
   flat presentation, fewer clicks to data
   few unused bells and whistles of high maintenance
   reduction of complexity and maintenance through abtraction of design - break apart functionality into separate URL's
   small recent time window basis of functionality, no round-robining or map tables by default
   hopefully works as a template which is easy to customize using image/imagemap selection and XML processing

Meta-Door
http://carocoops.org/metadoor
http://nautilus.baruch.sc.edu/twiki_carocoops/bin/view/Metadoor/WebHome

Feeds

Openioos
http://openioos.org
OOSTethys
http://oostethys.org CSC/IOOS Catalog
??? Google Earth
http://www.ogleearth.com/2006/10/sensor_webs_you.html

Documentation

Data formats/transport
Online Browse
Data flow
Data catalog
see also http://seacoos.org , http://nautilus.baruch.sc.edu/twiki_dmcc/bin/view/Main/DataDownload
Data sharing whitepaper

trac tasks

trac #15 netcdf update - values, qc?
trac #23 nearest neighbor qc - xenia check
trac #25 qc in output products - addressed by xenia build-out

Developer

In addition to the usual meetings and progress/proposal reports...

possible shared

portal_rs,_obs
    imagemap query to url link
    data credit/prev/next
    rs,intermittent product_id search page

CC/Seacoos merge, backup

Jeremy

support Monisha,Jesse - currents PIC, etc - Charlton,Vembu - Carolinas Coast and USF

merge xenia schema/script edits where needed between mine, Seacoos and CC xenia efforts

Jesse
0>>>recent sql query question?
0>>>top of hour trigger - use latest top of hour comparison - shapefile generation
0>>>add carocoops/cormp adcp profiles(share netcdf create with xiaoyan), vembu? _latest.nc, _old.nc

Carocoops database/products move over to xenia, qc and flow to Seacoos xenia db
Carocoops - storm surge products

database, scripts, system audit, backup, documentation
xenia documentation/buildout
ObsKML/ObsRSS, oostethys, ioos catalog, nerrs

Monisha

adcp vector plot of profile
  (extra credit)make range break configurable (0,15,30,45) - y_title/units may change 
   darker colors for contrast/visibility against white background?

netcdf to xenia_v2 using charlton code

dmcc address - add qc to netcdf data? adcp profiler submit/questions? checks on new qc/adcp data?

#portal_rs,_obs
animations blank?

engage rs(currents PIC)?
usual tools - shapefile and other default product training

xenia as seacoos in-situ db, qc/notification(nearest neighbor) - breakout by provider/platform? - obs/qc data updates

Jesse

hf radar->netcdf for vembu's using format guide - monisha?

model as shapefiles? remove existing db infrastructure and load
engage modelers? document/develop process for modelers to provide netcdf - credits/disclaimers,temporal/spatial data/display - visual legend, qc

carolinas coast obs into xenia_v2 using charlton's latest scripts?
   sst,wind,water level
expand out platforms and test performance?
db archive, copy
time-series, shapefiles
potential backup for CC style apps - WMS, xml data feed, time series graph
potential html,graph,xml,archive by platform use

==

sensor inventory
   xenia - obs - qc/missing data notify, platform/sensor id's link
   ioos catalog
   purpose? gen instrumentation form within a controlled vocabulary lookup?
   
   
documentation - xenia/lessons learned? shapefile processing/WMS, revise cookbook? currents PIC?
   purpose? audience? existing docs? review? length/time?

imagemap notes

#mapserver - generate imagemap via mapfile template   
http://mapserver.gis.umn.edu/docs/howto/imagemaps

look in imagemap_...map
portal_rs references imagemap in metadata
look in portal_rs and portal_rs/wrapper
/usr2/maps/seacoos/util/mk_imagemap2.php

experiment referencing xenia instance - new var to see if pops in query/data provider html
build time-series link into mouseover instead of separate table lookoup?
same to portal_obs? build from scratch?

#dynamically process WMS/WFS requests
http://mapserver.gis.umn.edu/docs/howto/wxs_mapscript