| 1 |
Section 1 ================================================ |
|---|
| 2 |
#discussion topics |
|---|
| 3 |
|
|---|
| 4 |
#new servers - hardware provider, initial os, config profile ? |
|---|
| 5 |
|
|---|
| 6 |
#ideal arch/application/server configuration discussion |
|---|
| 7 |
|
|---|
| 8 |
#deep storage/archive ??? policy? |
|---|
| 9 |
main focus is providing longer term yearly type archival of data files, probably in formats which are simpler desktop/end user oriented(CSV, shapefile, etc) since the data will need to outlive the online web/application development space |
|---|
| 10 |
NODC, etc policy? usage? |
|---|
| 11 |
|
|---|
| 12 |
#tech review process ? |
|---|
| 13 |
|
|---|
| 14 |
#documentation ? |
|---|
| 15 |
|
|---|
| 16 |
#dmac submission |
|---|
| 17 |
secoora netcdf/vocab |
|---|
| 18 |
obskml format/vocab, (tbd)dsi schema/vocab |
|---|
| 19 |
(tbd)secoora netcdf <-> obskml/dynamicSensorInventory mapping |
|---|
| 20 |
xenia db/products |
|---|
| 21 |
|
|---|
| 22 |
|
|---|
| 23 |
|
|---|
| 24 |
|
|---|
| 25 |
Section 2 ================================================ |
|---|
| 26 |
#possible server configuration(s) |
|---|
| 27 |
|
|---|
| 28 |
########### |
|---|
| 29 |
#server1 webserver |
|---|
| 30 |
main focus is providing initial web access to webpages and associated data files/services |
|---|
| 31 |
would have say a minimum of 50 to 100 GB of immediate file storage available for application data file caching |
|---|
| 32 |
|
|---|
| 33 |
zope/plone |
|---|
| 34 |
trac |
|---|
| 35 |
|
|---|
| 36 |
openlayers ? simple browser-based javascript/ajax map interaction ? |
|---|
| 37 |
http://secoora.org/maps/dynamic |
|---|
| 38 |
|
|---|
| 39 |
#optimization |
|---|
| 40 |
cachebot |
|---|
| 41 |
web file/service throttling ? |
|---|
| 42 |
|
|---|
| 43 |
google analytics? web server log usage analysis |
|---|
| 44 |
|
|---|
| 45 |
php? javascript |
|---|
| 46 |
|
|---|
| 47 |
########### |
|---|
| 48 |
#server2 GIS/mapserver (open-source Minnesota mapserver for Secoora case) |
|---|
| 49 |
main focus is providing map images from associated geospatial data say in one of three base file formats: |
|---|
| 50 |
|
|---|
| 51 |
dan - mapserver install documentation |
|---|
| 52 |
http://code.google.com/p/rcoos/wiki/MapserverNotes |
|---|
| 53 |
|
|---|
| 54 |
1)raster image + world(.wld) file |
|---|
| 55 |
2)shapefile |
|---|
| 56 |
3)geospatial sqlite file (html/table content type links) |
|---|
| 57 |
|
|---|
| 58 |
should provide WMS/WMS-GFI/WFS access to map layers (existing openlayers as test? which layers learn with? include?) |
|---|
| 59 |
OGR - batch geospatial file processing ? |
|---|
| 60 |
|
|---|
| 61 |
optional? postgresql+postgis relational database |
|---|
| 62 |
|
|---|
| 63 |
########### |
|---|
| 64 |
#server3 database server - optional ? |
|---|
| 65 |
main focus is providing support to spatially enabled postgresql+postgis database |
|---|
| 66 |
|
|---|
| 67 |
If move to sqlite focused, file passing architecture, can we remove the need for a database specific server? |
|---|
| 68 |
|
|---|
| 69 |
instead maybe focus on: |
|---|
| 70 |
#server3a file/product server |
|---|
| 71 |
main focus are to provide some additional quickly available file storage space(say 200-1000 GB) and data/product processing capacity |
|---|
| 72 |
|
|---|
| 73 |
===================== |
|---|
| 74 |
#additional applications - put on webserver? separate product server(s)? |
|---|
| 75 |
|
|---|
| 76 |
perl - packages DBI, LibXML |
|---|
| 77 |
gnuplot |
|---|
| 78 |
|
|---|
| 79 |
#files |
|---|
| 80 |
http://secoora.org/data - various formats all_obs, by_obs latest/recent/weekly/monthly(CSV,shapefile,KML,sqlite db,georss) |
|---|
| 81 |
ObsRegistry (http://obsregistry.org) |
|---|
| 82 |
|
|---|
| 83 |
#services |
|---|
| 84 |
DODS/OPeNDAP |
|---|
| 85 |
OGC SOS,etc (IOOS DIF - pySOS(jesse?), Oostethys) |
|---|
| 86 |
|
|---|
| 87 |
telemetry/qc processing of original or other data providers to secoora netcdf ? |
|---|
| 88 |
|
|---|
| 89 |
Scout - ongoing data aggregation (does not have to be a high-end server) |
|---|
| 90 |
|
|---|
| 91 |
== |
|---|
| 92 |
|
|---|
| 93 |
|
|---|
| 94 |
|
|---|
| 95 |
Section 3 ================================================ |
|---|
| 96 |
#near-term development |
|---|
| 97 |
|
|---|
| 98 |
==develop |
|---|
| 99 |
obskml/xenia switch for scout and tables - understand/ok ? make sure equivalent, summary log check |
|---|
| 100 |
|
|---|
| 101 |
rcoos - update sqlite platform links for html_tables out |
|---|
| 102 |
sqlite time_series graphs, html table links |
|---|
| 103 |
|
|---|
| 104 |
top_of_hour trigger |
|---|
| 105 |
|
|---|
| 106 |
'dynamic' sensor inventory (dsi) |
|---|
| 107 |
instrument/event metrics/notification |
|---|
| 108 |
|
|---|
| 109 |
IOOS DIF SOS, XML feeds for Secoora |
|---|
| 110 |
status - waiting some for any final tweaks in design process on DIF side and validation test via CSC before moving forward |
|---|
| 111 |
|
|---|
| 112 |
RENCI interaction ? |
|---|
| 113 |
status - renci is pulling Secoora obs via ObsKML into the ODM database |
|---|
| 114 |
|
|---|
| 115 |
other obs of opportunity ? |
|---|
| 116 |
vembu - tampa area hf radar |
|---|
| 117 |
adcp bin currents, graphs |
|---|
| 118 |
hf radar - wave height |
|---|
| 119 |
|
|---|
| 120 |
|
|---|
| 121 |
==implement |
|---|
| 122 |
|
|---|
| 123 |
html_table approach, breakout by_obs? |
|---|
| 124 |
georss, etc link? |
|---|
| 125 |
|
|---|
| 126 |
qc in netcdf at data providers? |
|---|
| 127 |
|
|---|
| 128 |
|
|---|
| 129 |
|
|---|
| 130 |
==bonus |
|---|
| 131 |
|
|---|
| 132 |
sqlite query wrapper |
|---|
| 133 |
general sqlite table/html/ogr-GFI to replace imagemaps/shapefiles? |
|---|
| 134 |
internal/third party - training to utilize desktop tools/data maps/feeds |
|---|
| 135 |
|
|---|
| 136 |
==optimization |
|---|
| 137 |
|
|---|
| 138 |
web throttling, cachebot ? |
|---|
| 139 |
layer performance (firebug analysis) |
|---|
| 140 |
|
|---|
| 141 |
google analytics / webserver log analysis - file/product detail proxy for better usage tracking? |
|---|
| 142 |
|
|---|
| 143 |
data/processing/product redundancy |
|---|
| 144 |
|
|---|
| 145 |
|
|---|
| 146 |
|
|---|
| 147 |
|
|---|
| 148 |
|
|---|
| 149 |
|
|---|
| 150 |
|
|---|
| 151 |
Section 4 ============================ |
|---|
| 152 |
#documentation |
|---|
| 153 |
|
|---|
| 154 |
jesse/dan - openlayers/ajax proxy |
|---|
| 155 |
|
|---|
| 156 |
dan - mapserver install http://code.google.com/p/rcoos/wiki/MapserverNotes |
|---|
| 157 |
sensor metrics |
|---|
| 158 |
|
|---|
| 159 |
jesse - cgi/wms map layers optimize ? |
|---|
| 160 |
|
|---|
| 161 |
jeremy - xenia/sqlite products website |
|---|
| 162 |
http://code.google.com/p/xenia/wiki/XeniaHome |
|---|
| 163 |
|
|---|
| 164 |
jeremy/dan/jesse |
|---|
| 165 |
secoora netcdf <-> obskml/dynamicSensorInventory mapping |
|---|
| 166 |
|
|---|
