In [1]:
title = "Opening post"
name = '2015-09-28-OpeningPost'

In [2]:
import os
from datetime import datetime
from IPython.core.display import HTML

# Metadata and markdown generation.
hour = datetime.utcnow().strftime('%H:%M')
comments = "true"

date = '-'.join(name.split('-')[:3])
slug = '-'.join(name.split('-')[3:])

metadata = dict(title=title,

markdown = """Title: {title}
date:  {date} {hour}
comments: {comments}
slug: {slug}

{{% notebook {name}.ipynb cells[2:] %}}

content = os.path.abspath(os.path.join(os.getcwd(), os.pardir,
                                       os.pardir, '{}.md'.format(name)))

with open('{}'.format(content), 'w') as f:

This blog is a "notebook digest" for all, but not only, notebooks created during the IOOS DMAC System Integration Test exercise.

The goal is to post readable, bite size, and executable(!) notebooks.

Wait... Before we dive into the notebooks:

What is IOOS?

The US Integrated Ocean Observing System (IOOS) is a collaboration between Federal, State, Local, Academic and Commercial partners to manage and/or provide access to a wide range of ocean observing assets and data feeds, including in-situ buoys, drifters, gliders, radar, satellite data, and numerical models and meet the needs of the ocean data community.

What is DMAC?

The Data Management and Communications (DMAC) is a subsystem of IOOS that provides the procedures, protocols and technology solutions to allow integration of the disparate observational data feeds within and amongst the regional associations and other IOOS data providers. Much of the data delivery and access technologies implemented by the DMAC subsystem are leveraged from the atmospheric community, where these technologies had become community practice.

What is System Integration Test?

The System Integration Test (SIT) is an effort to stress-testing DMAC by evaluating how they scale across geographies, data types, very large datasets, and long term archives.

The SIT project has been organized into three themes

  • 1) Baseline Assessment,
  • 2) Extreme Events, and
  • 3) Species Protection and Marine Habitat Classification.

Click in the binder badge below to load the notebook binder. You can browse, open, modify, and run any of the notebooks available here.