We want to find all Data.gov datasets that match a specific type of data (e.g. sea_water_temperature), in a specified geospatial extent and time window, and that have a specific type of data endpoint (e.g. OPeNDAP). Since data.gov uses CKAN, while waiting for a CSW interface, here we try using the CKAN API with the ckanclient package.
In [22]:
import ckanclient
import pandas as pd
from pprint import pprint
In [46]:
ckan = ckanclient.CkanClient('http://catalog.data.gov/api/3')
#ckan = ckanclient.CkanClient('https://data.noaa.gov/api/3')
Try a keyword search:
In [24]:
search_params = { 'q': 'tags:"sea_water_temperature" '}
d = ckan.action('package_search', **search_params)
print d['count']
108
Let's try a more complicated search:
In [25]:
search_params = {
'q': 'tags:"sea_water_temperature" AND metadata_modified:[2012-06-01T00:00:00.000Z TO NOW]',
'fq': 'res_format:HTML',
'extras': {"ext_bbox":"-71.5,41.,-63,46.0"},
'rows': 3
}
d = ckan.action('package_search', **search_params)
print d['count']
29
Try to find Bodega data through a restricted bounding box:
In [26]:
search_params = {
'q': 'tags:"sea_water_temperature"',
'extras': {"ext_bbox":"-125,38,-122,39"},
'rows': 10
}
d = ckan.action('package_search', **search_params)
print d['count']
29
Did we find it?
In [27]:
for rec in d['results']:
print rec['title']
NOAA NDBC SOS - waves
Argo Float Data from the APDRC DAPPER Server
NOAA Ship Bell M. Shimada Underway Meteorological Data, Quality Controlled
NOAA Ship Oscar Dyson Underway Meteorological Data, Quality Controlled
NCOM Region 7 Aggregation/Best Time Series
NOAA Ship Hi'ialakai Underway Meteorological Data, Quality Controlled
NOAA Ship Henry B. Bigelow Underway Meteorological Data, Quality Controlled
NOAA NOS SOS, EXPERIMENTAL - Water Temperature
NOAA Ship Bell M. Shimada Underway Meteorological Data, Near Real Time
Global Temperature and Salinity Profile Programme (GTSPP) Data
Find all NetCDF data:
In [56]:
search_params = {
'fq': 'res_format:WMS',
}
d = ckan.action('package_search', **search_params)
print d['count']
5019
In [52]:
search_params = {
'q': 'mvco',
'fq': 'res_format:WMS',
'rows': 10
}
d = ckan.action('package_search', **search_params)
print d['count']
1
So what does one of these results look like? Let's take a look at the keys
In [53]:
print d['results'][0].keys()
[u'license_title', u'maintainer', u'relationships_as_object', u'private', u'maintainer_email', u'num_tags', u'id', u'metadata_created', u'metadata_modified', u'author', u'author_email', u'state', u'version', u'license_id', u'type', u'resources', u'num_resources', u'tags', u'tracking_summary', u'groups', u'organization', u'relationships_as_subject', u'revision_timestamp', u'name', u'isopen', u'url', u'notes', u'owner_org', u'extras', u'title', u'revision_id']
Now let's see what the urls looks like for all the resources
In [54]:
pprint(d['results'][0]['resources'])
[{u'cache_last_updated': None,
u'cache_url': None,
u'created': u'2015-06-16T22:34:48.493931',
u'description': u"WinZip file containing bathymetric grid and associated metadata collected by the U.S. Geological Survey off the southern shore of Martha's Vineyard, 2007.",
u'format': u'ZIP',
u'hash': u'',
u'id': u'dc74af4b-8e47-4504-ab9c-423690b19ec3',
u'last_modified': None,
u'mimetype': None,
u'mimetype_inner': None,
u'name': u'WinZip',
u'position': 0,
u'resource_group_id': u'b1e04ec1-9f37-4bbf-af04-bb8e61d3e8c3',
u'resource_locator_function': u'',
u'resource_locator_protocol': u'',
u'resource_type': None,
u'revision_id': u'680ee925-0bfe-41b8-90b9-f6066299c137',
u'revision_timestamp': u'2015-06-17T02:34:48.201046',
u'size': None,
u'state': u'active',
u'tracking_summary': {u'recent': 0, u'total': 0},
u'url': u'http://pubs.usgs.gov/of/2008/1288/GIS_catalog/Bathy/bathy_2m.zip',
u'webstore_last_updated': None,
u'webstore_url': None},
{u'cache_last_updated': None,
u'cache_url': None,
u'created': u'2015-06-16T22:34:48.493969',
u'description': u'Online application available to view map services',
u'format': u'WMS',
u'hash': u'',
u'id': u'91e826af-1774-490e-9aba-a0a311f12cb4',
u'last_modified': None,
u'mimetype': None,
u'mimetype_inner': None,
u'name': u'Interactive Mapping Application',
u'position': 1,
u'resource_group_id': u'b1e04ec1-9f37-4bbf-af04-bb8e61d3e8c3',
u'resource_locator_function': u'',
u'resource_locator_protocol': u'',
u'resource_type': None,
u'revision_id': u'680ee925-0bfe-41b8-90b9-f6066299c137',
u'revision_timestamp': u'2015-06-17T02:34:48.201046',
u'size': None,
u'state': u'active',
u'tracking_summary': {u'recent': 0, u'total': 0},
u'url': u'http://cmgds.marine.usgs.gov/geoserver/bathy/wms?service=WMS&version=1.1.0&request=GetMap&layers=bathy:2008-1288_bathy&styles=&bbox=-70.60143471462636,41.300607371198,-70.51082222580634,41.3499367012399&srs=EPSG:4326&WIDTH=256&HEIGHT=256&FORMAT=image/png',
u'webstore_last_updated': None,
u'webstore_url': None},
{u'cache_last_updated': None,
u'cache_url': None,
u'created': u'2015-06-16T22:34:48.493989',
u'description': u'bathy_2m.zip',
u'format': u'ZIP',
u'hash': u'',
u'id': u'48473a59-c0a7-489f-9acc-b7a8ea816c5c',
u'last_modified': None,
u'mimetype': None,
u'mimetype_inner': None,
u'name': u'Zip File',
u'no_real_name': True,
u'position': 2,
u'resource_group_id': u'b1e04ec1-9f37-4bbf-af04-bb8e61d3e8c3',
u'resource_locator_function': u'',
u'resource_locator_protocol': u'',
u'resource_type': None,
u'revision_id': u'680ee925-0bfe-41b8-90b9-f6066299c137',
u'revision_timestamp': u'2015-06-17T02:34:48.201046',
u'size': None,
u'state': u'active',
u'tracking_summary': {u'recent': 0, u'total': 0},
u'url': u'http://pubs.usgs.gov/of/2008/1288/GIS_catalog/Bathy/bathy_2m.zip',
u'webstore_last_updated': None,
u'webstore_url': None},
{u'cache_last_updated': None,
u'cache_url': None,
u'created': u'2015-06-16T22:34:48.494002',
u'description': u'gis.html',
u'format': u'HTML',
u'hash': u'',
u'id': u'343ea234-52df-4720-8cb4-4c7ebe73a700',
u'last_modified': None,
u'mimetype': None,
u'mimetype_inner': None,
u'name': u'Web Page',
u'no_real_name': True,
u'position': 3,
u'resource_group_id': u'b1e04ec1-9f37-4bbf-af04-bb8e61d3e8c3',
u'resource_locator_function': u'',
u'resource_locator_protocol': u'',
u'resource_type': None,
u'revision_id': u'680ee925-0bfe-41b8-90b9-f6066299c137',
u'revision_timestamp': u'2015-06-17T02:34:48.201046',
u'size': None,
u'state': u'active',
u'tracking_summary': {u'recent': 1, u'total': 2},
u'url': u'http://pubs.usgs.gov/of/2008/1288/html/gis.html',
u'webstore_last_updated': None,
u'webstore_url': None},
{u'cache_last_updated': None,
u'cache_url': None,
u'created': u'2015-06-16T22:34:48.494017',
u'description': u'',
u'format': u'',
u'hash': u'',
u'id': u'c1375625-a42d-45a9-81f9-5a850a982b2f',
u'last_modified': None,
u'mimetype': None,
u'mimetype_inner': None,
u'name': u'Web Page',
u'no_real_name': True,
u'position': 4,
u'resource_group_id': u'b1e04ec1-9f37-4bbf-af04-bb8e61d3e8c3',
u'resource_locator_function': u'',
u'resource_locator_protocol': u'',
u'resource_type': None,
u'revision_id': u'680ee925-0bfe-41b8-90b9-f6066299c137',
u'revision_timestamp': u'2015-06-17T02:34:48.201046',
u'size': None,
u'state': u'active',
u'tracking_summary': {u'recent': 0, u'total': 0},
u'url': u'http://pubs.usgs.gov/of/2008/1288/',
u'webstore_last_updated': None,
u'webstore_url': None}]
So there are multiple resources for each record. Let's check out a some specific resource parameters for all datasets to see how the service endpoints might be defined:
In [31]:
urls=[]
for item in d['results']:
for member in item['resources']:
print 'url:',member['url']
print 'resource_locator_protocol:',member['resource_locator_protocol']
print 'resource_type:',member['resource_type']
print 'format:',member['format'],'\n'
if member['format'] == 'NetCDF' or member['resource_locator_protocol'] == 'THREDDS':
urls.append(member['url'])
url: http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/global/std/upstr.mean_lon.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/global/std/upstr.mean_lon.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/global/std/upstr.mean_lon.nc.html
resource_locator_protocol:
resource_type: None
format: HTML
url: http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/global/std/upstr.mean_lon.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: https://geo-ide.noaa.gov/
resource_locator_protocol: HTTPS
resource_type: None
format:
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/global/std/upstr.mean_lon.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/wcs/Datasets/icoads/1degree/global/std/upstr.mean_lon.nc?service=WCS&version=1.0.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WCS
url: http://www.esrl.noaa.gov/psd/thredds/wms/Datasets/icoads/1degree/global/std/upstr.mean_lon.nc?service=WMS&version=1.3.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WMS
url: http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/LTMs1981-2010/uwnd.ltm.perc.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/LTMs1981-2010/uwnd.ltm.perc.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/LTMs1981-2010/uwnd.ltm.perc.nc.html
resource_locator_protocol:
resource_type: None
format: HTML
url: http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/LTMs1981-2010/uwnd.ltm.perc.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: https://geo-ide.noaa.gov/
resource_locator_protocol: HTTPS
resource_type: None
format:
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/LTMs1981-2010/uwnd.ltm.perc.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/wcs/Datasets/coads/2degree/LTMs1981-2010/uwnd.ltm.perc.nc?service=WCS&version=1.0.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WCS
url: http://www.esrl.noaa.gov/psd/thredds/wms/Datasets/coads/2degree/LTMs1981-2010/uwnd.ltm.perc.nc?service=WMS&version=1.3.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WMS
url: http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/uspeh.mean_day.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/uspeh.mean_day.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/uspeh.mean_day.nc.html
resource_locator_protocol:
resource_type: None
format: HTML
url: http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/uspeh.mean_day.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: https://geo-ide.noaa.gov/
resource_locator_protocol: HTTPS
resource_type: None
format:
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/uspeh.mean_day.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/wcs/Datasets/coads/1degree/equatorial/std/uspeh.mean_day.nc?service=WCS&version=1.0.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WCS
url: http://www.esrl.noaa.gov/psd/thredds/wms/Datasets/coads/1degree/equatorial/std/uspeh.mean_day.nc?service=WMS&version=1.3.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WMS
url: http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/enh/LTMs1971-2000/uspeh.ltm.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/enh/LTMs1971-2000/uspeh.ltm.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/enh/LTMs1971-2000/uspeh.ltm.nc.html
resource_locator_protocol:
resource_type: None
format: HTML
url: http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/enh/LTMs1971-2000/uspeh.ltm.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: https://geo-ide.noaa.gov/
resource_locator_protocol: HTTPS
resource_type: None
format:
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/enh/LTMs1971-2000/uspeh.ltm.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/wcs/Datasets/icoads/2degree/enh/LTMs1971-2000/uspeh.ltm.nc?service=WCS&version=1.0.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WCS
url: http://www.esrl.noaa.gov/psd/thredds/wms/Datasets/icoads/2degree/enh/LTMs1971-2000/uspeh.ltm.nc?service=WMS&version=1.3.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WMS
url: http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/enh/vlflx.mean_lat.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/enh/vlflx.mean_lat.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/enh/vlflx.mean_lat.nc.html
resource_locator_protocol:
resource_type: None
format: HTML
url: http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/enh/vlflx.mean_lat.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: https://geo-ide.noaa.gov/
resource_locator_protocol: HTTPS
resource_type: None
format:
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/enh/vlflx.mean_lat.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/wcs/Datasets/coads/2degree/enh/vlflx.mean_lat.nc?service=WCS&version=1.0.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WCS
url: http://www.esrl.noaa.gov/psd/thredds/wms/Datasets/coads/2degree/enh/vlflx.mean_lat.nc?service=WMS&version=1.3.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WMS
url: http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/global/std/uairt.sextile5.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/global/std/uairt.sextile5.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/global/std/uairt.sextile5.nc.html
resource_locator_protocol:
resource_type: None
format: HTML
url: http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/global/std/uairt.sextile5.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: https://geo-ide.noaa.gov/
resource_locator_protocol: HTTPS
resource_type: None
format:
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/global/std/uairt.sextile5.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/wcs/Datasets/coads/1degree/global/std/uairt.sextile5.nc?service=WCS&version=1.0.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WCS
url: http://www.esrl.noaa.gov/psd/thredds/wms/Datasets/coads/1degree/global/std/uairt.sextile5.nc?service=WMS&version=1.3.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WMS
url: http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/equatorial/enh/shum.nobs.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/equatorial/enh/shum.nobs.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/equatorial/enh/shum.nobs.nc.html
resource_locator_protocol:
resource_type: None
format: HTML
url: http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/equatorial/enh/shum.nobs.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: https://geo-ide.noaa.gov/
resource_locator_protocol: HTTPS
resource_type: None
format:
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/equatorial/enh/shum.nobs.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/wcs/Datasets/icoads/1degree/equatorial/enh/shum.nobs.nc?service=WCS&version=1.0.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WCS
url: http://www.esrl.noaa.gov/psd/thredds/wms/Datasets/icoads/1degree/equatorial/enh/shum.nobs.nc?service=WMS&version=1.3.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WMS
url: http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/std/qsminq.day_fraction.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/std/qsminq.day_fraction.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/std/qsminq.day_fraction.nc.html
resource_locator_protocol:
resource_type: None
format: HTML
url: http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/std/qsminq.day_fraction.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: https://geo-ide.noaa.gov/
resource_locator_protocol: HTTPS
resource_type: None
format:
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/std/qsminq.day_fraction.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/wcs/Datasets/icoads/2degree/std/qsminq.day_fraction.nc?service=WCS&version=1.0.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WCS
url: http://www.esrl.noaa.gov/psd/thredds/wms/Datasets/icoads/2degree/std/qsminq.day_fraction.nc?service=WMS&version=1.3.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WMS
url: http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/upstr.mean_lon.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/upstr.mean_lon.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/upstr.mean_lon.nc.html
resource_locator_protocol:
resource_type: None
format: HTML
url: http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/upstr.mean_lon.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: https://geo-ide.noaa.gov/
resource_locator_protocol: HTTPS
resource_type: None
format:
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/upstr.mean_lon.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/wcs/Datasets/coads/1degree/equatorial/std/upstr.mean_lon.nc?service=WCS&version=1.0.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WCS
url: http://www.esrl.noaa.gov/psd/thredds/wms/Datasets/coads/1degree/equatorial/std/upstr.mean_lon.nc?service=WMS&version=1.3.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WMS
url: http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/smina.sextile3.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/smina.sextile3.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/smina.sextile3.nc.html
resource_locator_protocol:
resource_type: None
format: HTML
url: http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/smina.sextile3.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: https://geo-ide.noaa.gov/
resource_locator_protocol: HTTPS
resource_type: None
format:
url: http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/smina.sextile3.nc
resource_locator_protocol:
resource_type: None
format: NetCDF
url: http://www.esrl.noaa.gov/psd/thredds/wcs/Datasets/coads/1degree/equatorial/std/smina.sextile3.nc?service=WCS&version=1.0.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WCS
url: http://www.esrl.noaa.gov/psd/thredds/wms/Datasets/coads/1degree/equatorial/std/smina.sextile3.nc?service=WMS&version=1.3.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WMS
Lots of missing metadata information.
In [32]:
print(urls)
[u'http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/global/std/upstr.mean_lon.nc', u'http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/global/std/upstr.mean_lon.nc', u'http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/global/std/upstr.mean_lon.nc', u'http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/global/std/upstr.mean_lon.nc', u'http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/LTMs1981-2010/uwnd.ltm.perc.nc', u'http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/LTMs1981-2010/uwnd.ltm.perc.nc', u'http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/LTMs1981-2010/uwnd.ltm.perc.nc', u'http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/LTMs1981-2010/uwnd.ltm.perc.nc', u'http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/uspeh.mean_day.nc', u'http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/uspeh.mean_day.nc', u'http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/uspeh.mean_day.nc', u'http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/uspeh.mean_day.nc', u'http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/enh/LTMs1971-2000/uspeh.ltm.nc', u'http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/enh/LTMs1971-2000/uspeh.ltm.nc', u'http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/enh/LTMs1971-2000/uspeh.ltm.nc', u'http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/enh/LTMs1971-2000/uspeh.ltm.nc', u'http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/enh/vlflx.mean_lat.nc', u'http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/enh/vlflx.mean_lat.nc', u'http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/enh/vlflx.mean_lat.nc', u'http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/2degree/enh/vlflx.mean_lat.nc', u'http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/global/std/uairt.sextile5.nc', u'http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/global/std/uairt.sextile5.nc', u'http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/global/std/uairt.sextile5.nc', u'http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/global/std/uairt.sextile5.nc', u'http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/equatorial/enh/shum.nobs.nc', u'http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/equatorial/enh/shum.nobs.nc', u'http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/equatorial/enh/shum.nobs.nc', u'http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/1degree/equatorial/enh/shum.nobs.nc', u'http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/std/qsminq.day_fraction.nc', u'http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/std/qsminq.day_fraction.nc', u'http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/std/qsminq.day_fraction.nc', u'http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/icoads/2degree/std/qsminq.day_fraction.nc', u'http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/upstr.mean_lon.nc', u'http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/upstr.mean_lon.nc', u'http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/upstr.mean_lon.nc', u'http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/upstr.mean_lon.nc', u'http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/smina.sextile3.nc', u'http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/smina.sextile3.nc', u'http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/smina.sextile3.nc', u'http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/coads/1degree/equatorial/std/smina.sextile3.nc']
Hmmm... None of above URLs work. The THREDDS catalog exists, but none of the datasets here are in that catalog http://ecowatch.ncddc.noaa.gov/thredds/catalog/ocean_exploration_research/catalog.html
In [32]:
Let's back off and see what the broader search yields:
In [33]:
search_params = { 'q': 'tags:"sea_water_temperature"',
'extras': {"ext_bbox":"-60,60,-50,70"}
}
d = ckan.action('package_search', **search_params)
print d['count']
11
In [34]:
urls=[]
for item in d['results']:
for member in item['resources']:
print 'url:',member['url']
print 'resource_locator_protocol:',member['resource_locator_protocol']
print 'resource_type:',member['resource_type']
print 'format:',member['format'],'\n'
if member['format'] == 'NetCDF' or member['resource_locator_protocol'] == 'THREDDS':
urls.append(member['url'])
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/ndbcSosWaves.html
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/ndbcSosWaves.graph
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://sdf.ndbc.noaa.gov/sos/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://sdf.ndbc.noaa.gov/sos/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://sdf.ndbc.noaa.gov/sos/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/ndbcSosWaves
resource_locator_protocol: ERDDAP:tabledap
resource_type: None
format: HTML
url: http://sdf.ndbc.noaa.gov/sos/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/ndbcSosWaves
resource_locator_protocol: OPeNDAP:OPeNDAP
resource_type: None
format: HTML
url: http://sdf.ndbc.noaa.gov/sos/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/ndbcSosWaves.subset
resource_locator_protocol: search
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/apdrcArgoAll.html
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/apdrcArgoAll.graph
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://floats.pmel.noaa.gov/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://floats.pmel.noaa.gov/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://floats.pmel.noaa.gov/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/apdrcArgoAll
resource_locator_protocol: ERDDAP:tabledap
resource_type: None
format: HTML
url: http://floats.pmel.noaa.gov/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/apdrcArgoAll
resource_locator_protocol: OPeNDAP:OPeNDAP
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuNoaaShipWTEP.html
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuNoaaShipWTEP.graph
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuNoaaShipWTEP
resource_locator_protocol: ERDDAP:tabledap
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuNoaaShipWTEP
resource_locator_protocol: OPeNDAP:OPeNDAP
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuNoaaShipWTEP.subset
resource_locator_protocol: search
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/nosSosWTemp.html
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/nosSosWTemp.graph
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://opendap.co-ops.nos.noaa.gov/ioos-dif-sos/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://opendap.co-ops.nos.noaa.gov/ioos-dif-sos/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://opendap.co-ops.nos.noaa.gov/ioos-dif-sos/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/nosSosWTemp
resource_locator_protocol: ERDDAP:tabledap
resource_type: None
format: HTML
url: http://opendap.co-ops.nos.noaa.gov/ioos-dif-sos/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/nosSosWTemp
resource_locator_protocol: OPeNDAP:OPeNDAP
resource_type: None
format: HTML
url: http://opendap.co-ops.nos.noaa.gov/ioos-dif-sos/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/nosSosWTemp.subset
resource_locator_protocol: search
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/erdGtsppBest.html
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/erdGtsppBest.graph
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://www.nodc.noaa.gov/GTSPP/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://www.nodc.noaa.gov/GTSPP/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://www.nodc.noaa.gov/GTSPP/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/erdGtsppBest
resource_locator_protocol: ERDDAP:tabledap
resource_type: None
format: HTML
url: http://www.nodc.noaa.gov/GTSPP/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/erdGtsppBest
resource_locator_protocol: OPeNDAP:OPeNDAP
resource_type: None
format: HTML
url: http://www.nodc.noaa.gov/GTSPP/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/erdGtsppBest.subset
resource_locator_protocol: search
resource_type: None
format: HTML
url: http://ferret.pmel.noaa.gov/geoideLAS/getUI.do?data_url=http://ecowatch.ncddc.noaa.gov/thredds/dodsC/ncom/ncom_reg1_agg/NCOM_Region_1_Aggregation_best.ncd
resource_locator_protocol:
resource_type: None
format: HTML
url: http://upwell.pfeg.noaa.gov/erddap/search/index.html?searchFor=http://ecowatch.ncddc.noaa.gov/thredds/dodsC/ncom/ncom_reg1_agg/NCOM_Region_1_Aggregation_best.ncd
resource_locator_protocol:
resource_type: None
format: HTML
url: http://ecowatch.ncddc.noaa.gov/thredds/dodsC/ncom/ncom_reg1_agg/NCOM_Region_1_Aggregation_best.ncd.html
resource_locator_protocol:
resource_type: None
format: HTML
url: http://www.ncdc.noaa.gov/oa/wct/wct-jnlp-beta.php?singlefile=http://ecowatch.ncddc.noaa.gov/thredds/dodsC/ncom/ncom_reg1_agg/NCOM_Region_1_Aggregation_best.ncd
resource_locator_protocol:
resource_type: None
format: HTML
url: http://www.navo.navy.mil/
resource_locator_protocol: http
resource_type: None
format: HTML
url: https://geo-ide.noaa.gov/
resource_locator_protocol: HTTPS
resource_type: None
format:
url: http://www.navo.navy.mil/
resource_locator_protocol: http
resource_type: None
format: HTML
url: http://www.navo.navy.mil/
resource_locator_protocol: http
resource_type: None
format: HTML
url: http://ecowatch.ncddc.noaa.gov/thredds/dodsC/ncom/ncom_reg1_agg/NCOM_Region_1_Aggregation_best.ncd
resource_locator_protocol:
resource_type: None
format: HTML
url: http://www.navo.navy.mil/
resource_locator_protocol: http
resource_type: None
format: HTML
url: http://ecowatch.ncddc.noaa.gov/thredds/wcs/ncom/ncom_reg1_agg/NCOM_Region_1_Aggregation_best.ncd?service=WCS&version=1.0.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WCS
url: http://www.navo.navy.mil/
resource_locator_protocol: http
resource_type: None
format: HTML
url: http://ecowatch.ncddc.noaa.gov/thredds/wms/ncom/ncom_reg1_agg/NCOM_Region_1_Aggregation_best.ncd?service=WMS&version=1.3.0&request=GetCapabilities
resource_locator_protocol:
resource_type: None
format: WMS
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuResearchShipKCEJ.html
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuResearchShipKCEJ.graph
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuResearchShipKCEJ
resource_locator_protocol: ERDDAP:tabledap
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuResearchShipKCEJ
resource_locator_protocol: OPeNDAP:OPeNDAP
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuResearchShipKCEJ.subset
resource_locator_protocol: search
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/nosCoopsMWT.html
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/nosCoopsMWT.graph
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://tidesandcurrents.noaa.gov/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://tidesandcurrents.noaa.gov/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://tidesandcurrents.noaa.gov/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/nosCoopsMWT
resource_locator_protocol: ERDDAP:tabledap
resource_type: None
format: HTML
url: http://tidesandcurrents.noaa.gov/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/nosCoopsMWT
resource_locator_protocol: OPeNDAP:OPeNDAP
resource_type: None
format: HTML
url: http://tidesandcurrents.noaa.gov/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/nosCoopsMWT.subset
resource_locator_protocol: search
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuNoaaShipWTEC.html
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuNoaaShipWTEC.graph
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuNoaaShipWTEC
resource_locator_protocol: ERDDAP:tabledap
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuNoaaShipWTEC
resource_locator_protocol: OPeNDAP:OPeNDAP
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuNoaaShipWTEC.subset
resource_locator_protocol: search
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuNoaaShipWTDL.html
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuNoaaShipWTDL.graph
resource_locator_protocol: order
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuNoaaShipWTDL
resource_locator_protocol: ERDDAP:tabledap
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuNoaaShipWTDL
resource_locator_protocol: OPeNDAP:OPeNDAP
resource_type: None
format: HTML
url: http://samos.coaps.fsu.edu/html/
resource_locator_protocol: information
resource_type: None
format: HTML
url: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/fsuNoaaShipWTDL.subset
resource_locator_protocol: search
resource_type: None
format: HTML
In [35]:
print(urls)
[]
These are not DAP URLS, but collections of datasets on a THREDDS server. Lets try opening a DAP url (two clicks away)
In [36]:
url='http://data.nodc.noaa.gov/thredds/dodsC/glider/seaglider/uw/014/20040924/p0140001_20040924.nc'
In [37]:
import netCDF4
In [38]:
nc = netCDF4.Dataset(url)
ncvars = nc.variables
#pprint(ncvars.keys())
In [39]:
s = ncvars['salinity'][:]
time_var = nc.variables['time']
dtime = netCDF4.num2date(time_var[:],time_var.units)
# Create Pandas time series object
ts = pd.Series(s,index=dtime)
# Use Pandas plot() method
ts.plot(figsize=(16,4))
Out[39]:
<matplotlib.axes._subplots.AxesSubplot at 0x7f4aa73efc90>
In [40]:
#print the last few values
print ts[-5:]
2004-09-24 18:46:50 32.837085
2004-09-24 18:46:55 32.837255
2004-09-24 18:47:00 32.832002
2004-09-24 18:47:05 NaN
2004-09-24 18:47:10 NaN
dtype: float64
In [40]:
Content source: rsignell-usgs/notebook
Similar notebooks: