notebook.community

Edit and run

Using a CFSv2 forecast

CFSv2 is a seasonal forecast system, used for analysing past climate and also making seasonal, up to 9-month, forecasts. Here we give a brief example on how to use Planet OS API to merge 9-month forecasts started at different initial times, into a single ensemble forecast.

Ensemble forecasting is a traditional technique in medium range (up to 10 days) weather forecasts, seasonal forecasts and climate modelling. By changing initial conditions or model parameters, a range of forecasts is created, which differ from each other slightly, due to the chaotic nature of fluid dynamics (which weather modelling is a subset of). For weather forecasting, the ensemble is usually created by small changes in initial conditions, but for seasonal forecast, it is much easier to just take real initial conditions every 6-hours. Here we are going to show, first how to merge the different dates into a single plot with the help of python pandas library, and in addition we show that even 6-hour changes in initial conditions can lead to large variability in long range forecasts.

In this example we look into 2 m temperture for upcoming winter. We are also adding climatological averages from CFS Reanalysis Climatologies to the plot for better overview.

If you have more interest in Planet OS API, please refer to our official documentation.

Please also note that the API_client python routine, used in this notebook, is still experimental and will change in the future, so take it just as a guidance using the API, and not as an official tool.

Note that we store 10 days of history on this dataset. So, this notebook will be updated with the latest data as well, which means that descriptions here might be little outdated as data is renewed.





In [1]:



    


%matplotlib notebook
import numpy as np
import pandas as pd
import matplotlib.pyplot as plt
import calendar
import datetime
import matplotlib.dates as mdates
from API_client.python.datahub import datahub_main
from API_client.python.lib.dataset import dataset
from API_client.python.lib.variables import variables
import matplotlib
import warnings
warnings.filterwarnings("ignore")
matplotlib.rcParams['font.family'] = 'Avenir Lt Std'
print (matplotlib.__version__)



    


















    






3.1.2

The API needs a file APIKEY with your API key in the work folder. We initialize a datahub and dataset objects.





In [2]:



    


apikey = open('APIKEY').readlines()[0].strip()
dh = datahub_main(apikey)
ds = dataset('ncep_cfsv2', dh, debug=False)
ds2 = dataset('ncep_cfsr_climatologies', dh, debug=False)



    











In [9]:



    


ds.variables()



    


















    
Out[9]:








[{'variableKey': 'GaussLatLon_Projection',
  'contextKey': 'reftime_time_lat_lon',
  'variableType': 'info',
  'dimensionKeys': [],
  'attributes': [{'attributeKey': 'grid_mapping_name',
    'attributeType': 'text',
    'attributeValue': 'latitude_longitude'},
   {'attributeKey': 'earth_radius',
    'attributeType': 'text',
    'attributeValue': '6371229.0'}],
  'datasetKey': 'ncep_cfsv2',
  'dataType': 'int'},
 {'variableKey': 'Downward_Short-Wave_Radiation_Flux_surface',
  'contextKey': 'reftime_time_lat_lon',
  'variableType': 'data',
  'dimensionKeys': ['time', 'lat', 'lon'],
  'attributes': [{'attributeKey': 'abbreviation',
    'attributeType': 'text',
    'attributeValue': 'DSWRF'},
   {'attributeKey': 'missing_value',
    'attributeType': 'text',
    'attributeValue': 'NaN'},
   {'attributeKey': 'grid_mapping',
    'attributeType': 'text',
    'attributeValue': 'GaussLatLon_Projection'},
   {'attributeKey': 'coordinates',
    'attributeType': 'text',
    'attributeValue': 'reftime time lat lon '},
   {'attributeKey': 'Grib_Variable_Id',
    'attributeType': 'text',
    'attributeValue': 'VAR_0-4-192_L1'},
   {'attributeKey': 'Grib2_Parameter',
    'attributeType': 'text',
    'attributeValue': '0,4,192'},
   {'attributeKey': 'Grib2_Parameter_Discipline',
    'attributeType': 'text',
    'attributeValue': 'Meteorological products'},
   {'attributeKey': 'Grib2_Parameter_Category',
    'attributeType': 'text',
    'attributeValue': 'Short wave radiation'},
   {'attributeKey': 'Grib2_Parameter_Name',
    'attributeType': 'text',
    'attributeValue': 'Downward Short-Wave Radiation Flux'},
   {'attributeKey': 'Grib2_Level_Type',
    'attributeType': 'text',
    'attributeValue': 'Ground or water surface'},
   {'attributeKey': 'Grib2_Generating_Process_Type',
    'attributeType': 'text',
    'attributeValue': 'Forecast'}],
  'datasetKey': 'ncep_cfsv2',
  'unit': 'W.m-2',
  'dataType': 'float',
  'temporalCoverage': {'start': 1588593600000, 'end': 1614556800000},
  'longName': 'Downward Short-Wave Radiation Flux @ Ground or water surface'},
 {'variableKey': 'lat',
  'contextKey': 'reftime_time_lat_lon',
  'variableType': 'coord',
  'dimensionKeys': ['lat'],
  'attributes': [],
  'datasetKey': 'ncep_cfsv2',
  'unit': 'degrees_north',
  'dataType': 'float'},
 {'variableKey': 'lon',
  'contextKey': 'reftime_time_lat_lon',
  'variableType': 'coord',
  'dimensionKeys': ['lon'],
  'attributes': [],
  'datasetKey': 'ncep_cfsv2',
  'unit': 'degrees_east',
  'dataType': 'float'},
 {'variableKey': 'reftime',
  'contextKey': 'reftime_time_lat_lon',
  'variableType': 'coord',
  'dimensionKeys': [],
  'attributes': [{'attributeKey': 'calendar',
    'attributeType': 'text',
    'attributeValue': 'proleptic_gregorian'}],
  'datasetKey': 'ncep_cfsv2',
  'dataType': 'double',
  'standardName': 'forecast_reference_time',
  'longName': 'GRIB reference time'},
 {'variableKey': 'time',
  'contextKey': 'reftime_time_lat_lon',
  'variableType': 'coord',
  'dimensionKeys': ['time'],
  'attributes': [{'attributeKey': 'calendar',
    'attributeType': 'text',
    'attributeValue': 'proleptic_gregorian'}],
  'datasetKey': 'ncep_cfsv2',
  'dataType': 'double',
  'standardName': 'time',
  'longName': 'GRIB forecast or observation time'},
 {'variableKey': 'Precipitation_rate_surface',
  'contextKey': 'reftime_time_lat_lon',
  'variableType': 'data',
  'dimensionKeys': ['time', 'lat', 'lon'],
  'attributes': [{'attributeKey': 'abbreviation',
    'attributeType': 'text',
    'attributeValue': 'PRATE'},
   {'attributeKey': 'missing_value',
    'attributeType': 'text',
    'attributeValue': 'NaN'},
   {'attributeKey': 'grid_mapping',
    'attributeType': 'text',
    'attributeValue': 'GaussLatLon_Projection'},
   {'attributeKey': 'coordinates',
    'attributeType': 'text',
    'attributeValue': 'reftime time lat lon '},
   {'attributeKey': 'Grib_Variable_Id',
    'attributeType': 'text',
    'attributeValue': 'VAR_0-1-7_L1'},
   {'attributeKey': 'Grib2_Parameter',
    'attributeType': 'text',
    'attributeValue': '0,1,7'},
   {'attributeKey': 'Grib2_Parameter_Discipline',
    'attributeType': 'text',
    'attributeValue': 'Meteorological products'},
   {'attributeKey': 'Grib2_Parameter_Category',
    'attributeType': 'text',
    'attributeValue': 'Moisture'},
   {'attributeKey': 'Grib2_Parameter_Name',
    'attributeType': 'text',
    'attributeValue': 'Precipitation rate'},
   {'attributeKey': 'Grib2_Level_Type',
    'attributeType': 'text',
    'attributeValue': 'Ground or water surface'},
   {'attributeKey': 'Grib2_Generating_Process_Type',
    'attributeType': 'text',
    'attributeValue': 'Forecast'}],
  'datasetKey': 'ncep_cfsv2',
  'unit': 'kg.m-2.s-1',
  'dataType': 'float',
  'temporalCoverage': {'start': 1588593600000, 'end': 1614556800000},
  'longName': 'Precipitation rate @ Ground or water surface'},
 {'variableKey': 'Pressure_surface',
  'contextKey': 'reftime_time_lat_lon',
  'variableType': 'data',
  'dimensionKeys': ['time', 'lat', 'lon'],
  'attributes': [{'attributeKey': 'abbreviation',
    'attributeType': 'text',
    'attributeValue': 'PRES'},
   {'attributeKey': 'missing_value',
    'attributeType': 'text',
    'attributeValue': 'NaN'},
   {'attributeKey': 'grid_mapping',
    'attributeType': 'text',
    'attributeValue': 'GaussLatLon_Projection'},
   {'attributeKey': 'coordinates',
    'attributeType': 'text',
    'attributeValue': 'reftime time lat lon '},
   {'attributeKey': 'Grib_Variable_Id',
    'attributeType': 'text',
    'attributeValue': 'VAR_0-3-0_L1'},
   {'attributeKey': 'Grib2_Parameter',
    'attributeType': 'text',
    'attributeValue': '0,3,0'},
   {'attributeKey': 'Grib2_Parameter_Discipline',
    'attributeType': 'text',
    'attributeValue': 'Meteorological products'},
   {'attributeKey': 'Grib2_Parameter_Category',
    'attributeType': 'text',
    'attributeValue': 'Mass'},
   {'attributeKey': 'Grib2_Parameter_Name',
    'attributeType': 'text',
    'attributeValue': 'Pressure'},
   {'attributeKey': 'Grib2_Level_Type',
    'attributeType': 'text',
    'attributeValue': 'Ground or water surface'},
   {'attributeKey': 'Grib2_Generating_Process_Type',
    'attributeType': 'text',
    'attributeValue': 'Forecast'}],
  'datasetKey': 'ncep_cfsv2',
  'unit': 'Pa',
  'dataType': 'float',
  'temporalCoverage': {'start': 1588593600000, 'end': 1614556800000},
  'longName': 'Pressure @ Ground or water surface'},
 {'variableKey': 'Convective_Precipitation_Rate_surface',
  'contextKey': 'reftime_time_lat_lon',
  'variableType': 'data',
  'dimensionKeys': ['time', 'lat', 'lon'],
  'attributes': [{'attributeKey': 'abbreviation',
    'attributeType': 'text',
    'attributeValue': 'CPRAT'},
   {'attributeKey': 'missing_value',
    'attributeType': 'text',
    'attributeValue': 'NaN'},
   {'attributeKey': 'grid_mapping',
    'attributeType': 'text',
    'attributeValue': 'GaussLatLon_Projection'},
   {'attributeKey': 'coordinates',
    'attributeType': 'text',
    'attributeValue': 'reftime time lat lon '},
   {'attributeKey': 'Grib_Variable_Id',
    'attributeType': 'text',
    'attributeValue': 'VAR_0-1-196_L1'},
   {'attributeKey': 'Grib2_Parameter',
    'attributeType': 'text',
    'attributeValue': '0,1,196'},
   {'attributeKey': 'Grib2_Parameter_Discipline',
    'attributeType': 'text',
    'attributeValue': 'Meteorological products'},
   {'attributeKey': 'Grib2_Parameter_Category',
    'attributeType': 'text',
    'attributeValue': 'Moisture'},
   {'attributeKey': 'Grib2_Parameter_Name',
    'attributeType': 'text',
    'attributeValue': 'Convective Precipitation Rate'},
   {'attributeKey': 'Grib2_Level_Type',
    'attributeType': 'text',
    'attributeValue': 'Ground or water surface'},
   {'attributeKey': 'Grib2_Generating_Process_Type',
    'attributeType': 'text',
    'attributeValue': 'Forecast'}],
  'datasetKey': 'ncep_cfsv2',
  'unit': 'kg.m-2.s-1',
  'dataType': 'float',
  'temporalCoverage': {'start': 1588636800000, 'end': 1614556800000},
  'longName': 'Convective Precipitation Rate @ Ground or water surface'},
 {'variableKey': 'GaussLatLon_Projection',
  'contextKey': 'reftime_time_height_above_ground_lat_lon',
  'variableType': 'info',
  'dimensionKeys': [],
  'attributes': [{'attributeKey': 'grid_mapping_name',
    'attributeType': 'text',
    'attributeValue': 'latitude_longitude'},
   {'attributeKey': 'earth_radius',
    'attributeType': 'text',
    'attributeValue': '6371229.0'}],
  'datasetKey': 'ncep_cfsv2',
  'dataType': 'int'},
 {'variableKey': 'Maximum_temperature_height_above_ground',
  'contextKey': 'reftime_time_height_above_ground_lat_lon',
  'variableType': 'data',
  'dimensionKeys': ['time', 'height_above_ground', 'lat', 'lon'],
  'attributes': [{'attributeKey': 'abbreviation',
    'attributeType': 'text',
    'attributeValue': 'TMAX'},
   {'attributeKey': 'missing_value',
    'attributeType': 'text',
    'attributeValue': 'NaN'},
   {'attributeKey': 'grid_mapping',
    'attributeType': 'text',
    'attributeValue': 'GaussLatLon_Projection'},
   {'attributeKey': 'coordinates',
    'attributeType': 'text',
    'attributeValue': 'reftime time height_above_ground lat lon '},
   {'attributeKey': 'Grib_Variable_Id',
    'attributeType': 'text',
    'attributeValue': 'VAR_0-0-4_L103'},
   {'attributeKey': 'Grib2_Parameter',
    'attributeType': 'text',
    'attributeValue': '0,0,4'},
   {'attributeKey': 'Grib2_Parameter_Discipline',
    'attributeType': 'text',
    'attributeValue': 'Meteorological products'},
   {'attributeKey': 'Grib2_Parameter_Category',
    'attributeType': 'text',
    'attributeValue': 'Temperature'},
   {'attributeKey': 'Grib2_Parameter_Name',
    'attributeType': 'text',
    'attributeValue': 'Maximum temperature'},
   {'attributeKey': 'Grib2_Level_Type',
    'attributeType': 'text',
    'attributeValue': 'Specified height level above ground'},
   {'attributeKey': 'Grib2_Generating_Process_Type',
    'attributeType': 'text',
    'attributeValue': 'Forecast'}],
  'datasetKey': 'ncep_cfsv2',
  'unit': 'K',
  'dataType': 'float',
  'temporalCoverage': {'start': 1588593600000, 'end': 1614556800000},
  'longName': 'Maximum temperature @ Specified height level above ground'},
 {'variableKey': 'lat',
  'contextKey': 'reftime_time_height_above_ground_lat_lon',
  'variableType': 'coord',
  'dimensionKeys': ['lat'],
  'attributes': [],
  'datasetKey': 'ncep_cfsv2',
  'unit': 'degrees_north',
  'dataType': 'float'},
 {'variableKey': 'lon',
  'contextKey': 'reftime_time_height_above_ground_lat_lon',
  'variableType': 'coord',
  'dimensionKeys': ['lon'],
  'attributes': [],
  'datasetKey': 'ncep_cfsv2',
  'unit': 'degrees_east',
  'dataType': 'float'},
 {'variableKey': 'reftime',
  'contextKey': 'reftime_time_height_above_ground_lat_lon',
  'variableType': 'coord',
  'dimensionKeys': [],
  'attributes': [{'attributeKey': 'calendar',
    'attributeType': 'text',
    'attributeValue': 'proleptic_gregorian'}],
  'datasetKey': 'ncep_cfsv2',
  'unit': 'Hour since 2020-05-14T06:00:00Z',
  'dataType': 'double',
  'standardName': 'forecast_reference_time',
  'longName': 'GRIB reference time'},
 {'variableKey': 'time',
  'contextKey': 'reftime_time_height_above_ground_lat_lon',
  'variableType': 'coord',
  'dimensionKeys': ['time'],
  'attributes': [{'attributeKey': 'calendar',
    'attributeType': 'text',
    'attributeValue': 'proleptic_gregorian'}],
  'datasetKey': 'ncep_cfsv2',
  'unit': 'Hour since 2020-05-14T06:00:00Z',
  'dataType': 'double',
  'standardName': 'time',
  'longName': 'GRIB forecast or observation time'},
 {'variableKey': 'height_above_ground',
  'contextKey': 'reftime_time_height_above_ground_lat_lon',
  'variableType': 'coord',
  'dimensionKeys': ['height_above_ground'],
  'attributes': [{'attributeKey': 'positive',
    'attributeType': 'text',
    'attributeValue': 'up'},
   {'attributeKey': 'Grib_level_type',
    'attributeType': 'text',
    'attributeValue': '103'},
   {'attributeKey': 'datum',
    'attributeType': 'text',
    'attributeValue': 'ground'}],
  'datasetKey': 'ncep_cfsv2',
  'unit': 'm',
  'dataType': 'float',
  'longName': 'Specified height level above ground'},
 {'variableKey': 'Temperature_height_above_ground',
  'contextKey': 'reftime_time_height_above_ground_lat_lon',
  'variableType': 'data',
  'dimensionKeys': ['time', 'height_above_ground', 'lat', 'lon'],
  'attributes': [{'attributeKey': 'abbreviation',
    'attributeType': 'text',
    'attributeValue': 'TMP'},
   {'attributeKey': 'missing_value',
    'attributeType': 'text',
    'attributeValue': 'NaN'},
   {'attributeKey': 'grid_mapping',
    'attributeType': 'text',
    'attributeValue': 'GaussLatLon_Projection'},
   {'attributeKey': 'coordinates',
    'attributeType': 'text',
    'attributeValue': 'reftime time height_above_ground lat lon '},
   {'attributeKey': 'Grib_Variable_Id',
    'attributeType': 'text',
    'attributeValue': 'VAR_0-0-0_L103'},
   {'attributeKey': 'Grib2_Parameter',
    'attributeType': 'text',
    'attributeValue': '0,0,0'},
   {'attributeKey': 'Grib2_Parameter_Discipline',
    'attributeType': 'text',
    'attributeValue': 'Meteorological products'},
   {'attributeKey': 'Grib2_Parameter_Category',
    'attributeType': 'text',
    'attributeValue': 'Temperature'},
   {'attributeKey': 'Grib2_Parameter_Name',
    'attributeType': 'text',
    'attributeValue': 'Temperature'},
   {'attributeKey': 'Grib2_Level_Type',
    'attributeType': 'text',
    'attributeValue': 'Specified height level above ground'},
   {'attributeKey': 'Grib2_Generating_Process_Type',
    'attributeType': 'text',
    'attributeValue': 'Forecast'}],
  'datasetKey': 'ncep_cfsv2',
  'unit': 'K',
  'dataType': 'float',
  'temporalCoverage': {'start': 1588593600000, 'end': 1614556800000},
  'longName': 'Temperature @ Specified height level above ground'},
 {'variableKey': 'u-component_of_wind_height_above_ground',
  'contextKey': 'reftime_time_height_above_ground_lat_lon',
  'variableType': 'data',
  'dimensionKeys': ['time', 'height_above_ground', 'lat', 'lon'],
  'attributes': [{'attributeKey': 'abbreviation',
    'attributeType': 'text',
    'attributeValue': 'UGRD'},
   {'attributeKey': 'missing_value',
    'attributeType': 'text',
    'attributeValue': 'NaN'},
   {'attributeKey': 'grid_mapping',
    'attributeType': 'text',
    'attributeValue': 'GaussLatLon_Projection'},
   {'attributeKey': 'coordinates',
    'attributeType': 'text',
    'attributeValue': 'reftime time height_above_ground lat lon '},
   {'attributeKey': 'Grib_Variable_Id',
    'attributeType': 'text',
    'attributeValue': 'VAR_0-2-2_L103'},
   {'attributeKey': 'Grib2_Parameter',
    'attributeType': 'text',
    'attributeValue': '0,2,2'},
   {'attributeKey': 'Grib2_Parameter_Discipline',
    'attributeType': 'text',
    'attributeValue': 'Meteorological products'},
   {'attributeKey': 'Grib2_Parameter_Category',
    'attributeType': 'text',
    'attributeValue': 'Momentum'},
   {'attributeKey': 'Grib2_Parameter_Name',
    'attributeType': 'text',
    'attributeValue': 'u-component of wind'},
   {'attributeKey': 'Grib2_Level_Type',
    'attributeType': 'text',
    'attributeValue': 'Specified height level above ground'},
   {'attributeKey': 'Grib2_Generating_Process_Type',
    'attributeType': 'text',
    'attributeValue': 'Forecast'}],
  'datasetKey': 'ncep_cfsv2',
  'unit': 'm/s',
  'dataType': 'float',
  'temporalCoverage': {'start': 1588593600000, 'end': 1614556800000},
  'longName': 'u-component of wind @ Specified height level above ground'},
 {'variableKey': 'v-component_of_wind_height_above_ground',
  'contextKey': 'reftime_time_height_above_ground_lat_lon',
  'variableType': 'data',
  'dimensionKeys': ['time', 'height_above_ground', 'lat', 'lon'],
  'attributes': [{'attributeKey': 'abbreviation',
    'attributeType': 'text',
    'attributeValue': 'VGRD'},
   {'attributeKey': 'missing_value',
    'attributeType': 'text',
    'attributeValue': 'NaN'},
   {'attributeKey': 'grid_mapping',
    'attributeType': 'text',
    'attributeValue': 'GaussLatLon_Projection'},
   {'attributeKey': 'coordinates',
    'attributeType': 'text',
    'attributeValue': 'reftime time height_above_ground lat lon '},
   {'attributeKey': 'Grib_Variable_Id',
    'attributeType': 'text',
    'attributeValue': 'VAR_0-2-3_L103'},
   {'attributeKey': 'Grib2_Parameter',
    'attributeType': 'text',
    'attributeValue': '0,2,3'},
   {'attributeKey': 'Grib2_Parameter_Discipline',
    'attributeType': 'text',
    'attributeValue': 'Meteorological products'},
   {'attributeKey': 'Grib2_Parameter_Category',
    'attributeType': 'text',
    'attributeValue': 'Momentum'},
   {'attributeKey': 'Grib2_Parameter_Name',
    'attributeType': 'text',
    'attributeValue': 'v-component of wind'},
   {'attributeKey': 'Grib2_Level_Type',
    'attributeType': 'text',
    'attributeValue': 'Specified height level above ground'},
   {'attributeKey': 'Grib2_Generating_Process_Type',
    'attributeType': 'text',
    'attributeValue': 'Forecast'}],
  'datasetKey': 'ncep_cfsv2',
  'unit': 'm/s',
  'dataType': 'float',
  'temporalCoverage': {'start': 1588593600000, 'end': 1614556800000},
  'longName': 'v-component of wind @ Specified height level above ground'},
 {'variableKey': 'Minimum_temperature_height_above_ground',
  'contextKey': 'reftime_time_height_above_ground_lat_lon',
  'variableType': 'data',
  'dimensionKeys': ['time', 'height_above_ground', 'lat', 'lon'],
  'attributes': [{'attributeKey': 'abbreviation',
    'attributeType': 'text',
    'attributeValue': 'TMIN'},
   {'attributeKey': 'missing_value',
    'attributeType': 'text',
    'attributeValue': 'NaN'},
   {'attributeKey': 'grid_mapping',
    'attributeType': 'text',
    'attributeValue': 'GaussLatLon_Projection'},
   {'attributeKey': 'coordinates',
    'attributeType': 'text',
    'attributeValue': 'reftime time height_above_ground lat lon '},
   {'attributeKey': 'Grib_Variable_Id',
    'attributeType': 'text',
    'attributeValue': 'VAR_0-0-5_L103'},
   {'attributeKey': 'Grib2_Parameter',
    'attributeType': 'text',
    'attributeValue': '0,0,5'},
   {'attributeKey': 'Grib2_Parameter_Discipline',
    'attributeType': 'text',
    'attributeValue': 'Meteorological products'},
   {'attributeKey': 'Grib2_Parameter_Category',
    'attributeType': 'text',
    'attributeValue': 'Temperature'},
   {'attributeKey': 'Grib2_Parameter_Name',
    'attributeType': 'text',
    'attributeValue': 'Minimum temperature'},
   {'attributeKey': 'Grib2_Level_Type',
    'attributeType': 'text',
    'attributeValue': 'Specified height level above ground'},
   {'attributeKey': 'Grib2_Generating_Process_Type',
    'attributeType': 'text',
    'attributeValue': 'Forecast'}],
  'datasetKey': 'ncep_cfsv2',
  'unit': 'K',
  'dataType': 'float',
  'temporalCoverage': {'start': 1588593600000, 'end': 1614556800000},
  'longName': 'Minimum temperature @ Specified height level above ground'}]

















In [3]:



    


ds.vars = variables(ds.variables(), {'reftimes':ds.reftimes,'timesteps':ds.timesteps},ds)
ds2.vars = variables(ds2.variables(), {},ds2)

At the moment we are going to look into Tallinn, Innsbruck, Paris, Berlin and Lisbon temperature. In order to the automatic location selection to work, add your custom location to the API_client.python.lib.predef_locations file and after add your location into the list of locations here.





In [4]:



    


start_date = datetime.datetime.now() - datetime.timedelta(days=9)
end_date = datetime.datetime.now() + datetime.timedelta(days=5)
reftime_start = start_date.strftime('%Y-%m-%d') + 'T00:00:00'
reftime_end = end_date.strftime('%Y-%m-%d') + 'T18:00:00'
locations = ['Tallinn','Innsbruck','Paris','Berlin','Lisbon']
for locat in locations:
    ds2.vars.TMAX_2maboveground.get_values_analysis(count=1000, location=locat)
    ds.vars.Temperature_height_above_ground.get_values(count=1000, location=locat, reftime=reftime_start,
                                                            reftime_end=reftime_end)



    


















    






---------------------------------------------------------------------------
KeyError                                  Traceback (most recent call last)
<ipython-input-4-88a503bd2e56> in <module>
      6 for locat in locations:
      7     ds2.vars.TMAX_2maboveground.get_values_analysis(count=1000, location=locat)
----> 8     ds.vars.Temperature_height_above_ground.get_values(count=1000, location=locat, reftime=reftime_start,
      9                                                             reftime_end=reftime_end)

~/notebooks/api-examples/API_client/python/lib/variables.py in get_values(self, location, reftime, reftime_end, count, debug)
     68         kwags['vars'] = self.varname
     69 
---> 70         self.values[location] = self.ds.get_json_data_in_pandas(debug=debug, **kwags)
     71 ## **{'reftime_start':selected_reftime.isoformat(),
     72                                    ## 'reftime_end':reftime_end.isoformat(),

~/notebooks/api-examples/API_client/python/lib/dataset.py in get_json_data_in_pandas(self, count, z, pandas, debug, **kwargs)
    121             kwargs["z"]=z
    122         retjson=parse_urls(self.datahub.server, self.datahub.version, "datasets/{0}/point".format(self.datasetkey), self.datahub.apikey, clean_reftime=False, debug=self.debug, **kwargs).r.json()
--> 123         if pandas: retjson=convert_json_to_some_pandas(retjson['entries'])
    124         return retjson
    125 

~/notebooks/api-examples/API_client/python/lib/dataset.py in convert_json_to_some_pandas(injson)
    108             [(new_dict['axes'].append(i['axes']),new_dict['data'].append(i['data'])) for i in injson];
    109             pd_temp = pd.DataFrame(injson)
--> 110             dev_frame = pd_temp[['context','axes']].join(pd.concat([pd.DataFrame(new_dict[i]) for i in param_list],axis=1))
    111             if 'reftime' in dev_frame.columns:
    112                 ## dev_frame = dev_frame[dev_frame['reftime'] == dev_frame['reftime'][0]]

~/anaconda3/envs/notebooks/lib/python3.8/site-packages/pandas/core/frame.py in __getitem__(self, key)
   2804             if is_iterator(key):
   2805                 key = list(key)
-> 2806             indexer = self.loc._get_listlike_indexer(key, axis=1, raise_missing=True)[1]
   2807 
   2808         # take() does not accept boolean indexers

~/anaconda3/envs/notebooks/lib/python3.8/site-packages/pandas/core/indexing.py in _get_listlike_indexer(self, key, axis, raise_missing)
   1550             keyarr, indexer, new_indexer = ax._reindex_non_unique(keyarr)
   1551 
-> 1552         self._validate_read_indexer(
   1553             keyarr, indexer, o._get_axis_number(axis), raise_missing=raise_missing
   1554         )

~/anaconda3/envs/notebooks/lib/python3.8/site-packages/pandas/core/indexing.py in _validate_read_indexer(self, key, indexer, axis, raise_missing)
   1638             if missing == len(indexer):
   1639                 axis_name = self.obj._get_axis_name(axis)
-> 1640                 raise KeyError(f"None of [{key}] are in the [{axis_name}]")
   1641 
   1642             # We (temporarily) allow for some missing keys with .loc, except in

KeyError: "None of [Index(['context', 'axes'], dtype='object')] are in the [columns]"

Here we clean the table just a bit and create time based index.





In [ ]:



    


def clean_table(loc):
    ddd_clim = ds2.vars.TMAX_2maboveground.values[loc][['time','TMAX_2maboveground']]
    ddd_temp = ds.vars.Temperature_height_above_ground.values[loc][['reftime','time','Temperature_height_above_ground']]
    dd_temp=ddd_temp.set_index('time')
    
    return ddd_clim,dd_temp

Next, we resample the data to 1-month totals.





In [ ]:



    


def resample_1month_totals(loc):
    reft_unique = ds.vars.Temperature_height_above_ground.values[loc]['reftime'].unique()
    nf_tmp = []
    for reft in reft_unique:
        abc = dd_temp[dd_temp.reftime==reft].resample('M').mean()
        abc['Temperature_height_above_ground'+'_'+reft.astype(str)] = \
             abc['Temperature_height_above_ground'] - 272.15
        del abc['Temperature_height_above_ground']
        nf_tmp.append(abc)
    nf2_tmp = pd.concat(nf_tmp,axis=1)
    return nf2_tmp



    











In [ ]:

Give new indexes to climatology dataframe to have data ordered the same way as cfsv2 forecast.





In [ ]:



    


def reindex_clim_convert_temp():
    i_new = 0
    ddd_clim_new_indxes = ddd_clim.copy()
    new_indexes = []
    converted_temp = []
    for i,clim_values in enumerate(ddd_clim['TMAX_2maboveground']):
        if i == 0:
            i_new = 12 - nf2_tmp.index[0].month + 2
        else:
            i_new = i_new + 1
            if i_new == 13:
                i_new = 1

        new_indexes.append(i_new)
        converted_temp.append(ddd_clim_new_indxes['TMAX_2maboveground'][i] -273.15)
    ddd_clim_new_indxes['new_index'] = new_indexes
    ddd_clim_new_indxes['tmp_c'] = converted_temp
    return ddd_clim_new_indxes

Finally, we are visualizing the monthly mean temperature for each different forecast, in a single plot.





In [ ]:



    


def make_image(loc):
    fig=plt.figure(figsize=(10,8))
    ax = fig.add_subplot(111)
    plt.ylim(np.min(np.min(nf2_tmp))-3,np.max(np.max(nf2_tmp))+3)
    plt.boxplot(nf2_tmp,medianprops=dict(color='#1B9AA0'))
    dates2 = [n.strftime('%b %Y') for n in nf2_tmp.index]
    if len(np.arange(1, len(dates2)+1))== len(ddd_clim_indexed.sort_values(by=['new_index'])['tmp_c'][:-3]):
        clim_len = -3
    else:
        clim_len = -2
    plt.plot(np.arange(1, len(dates2)+1),ddd_clim_indexed.sort_values(by=['new_index'])['tmp_c'][:clim_len],"*",color='#EC5840',linestyle='-')
    
    plt.xticks(np.arange(1, len(dates2)+1), dates2, rotation='vertical')
    plt.grid(color='#C3C8CE',alpha=1)
    plt.ylabel('Monthly Temperature [C]')
    ttl = plt.title('Monthly Temperature in ' + loc,fontsize=15,fontweight='bold')
    ttl.set_position([.5, 1.05])
    fig.autofmt_xdate() 
    #plt.savefig('Monthly_mean_temp_cfsv2_forecast_{0}.png'.format(loc),dpi=300,bbox_inches='tight')
    plt.show()

Below we can find five location graphs. It's forecasted that November seems to be quite similar to climatological mean (red line) while December might be much warmer than usual. January again is pretty similar to the climatology. After January all the months are forecasted to be colder as average, specially April and May.

Forecast for Innsbruck is intresting. It's forecasted that upcoming seven months will be colder as usual. For example, January mean temperature might be two degrees lower.

In the same time, Paris might face bit colder November, while December and January could be pretty average. After that, all the forecasted values are rather colder as climatology.

Berlin might get pretty average November. However, after that December could get much colder. January and February could be quite average. After that, temperatures might be colder as usual.

Temperatures in Lisbon are forecasted to be bit colder in winter and spring. However, May is forecasted to quite average, while June forecast is way warmer as climatological mean.





In [ ]:



    


for locat in locations:
    ddd_clim,dd_temp = clean_table(locat)
    nf2_tmp = resample_1month_totals(locat)
    ddd_clim_indexed = reindex_clim_convert_temp()
    make_image(locat)

In conclusion, temprerature varies a lot over Europe. Every region has it's own pattern. Keep in mind that it's just a forecast and it might be totally different. However, let us know if it was right for your location.





In [ ]:

Content source: planet-os/notebooks

Similar notebooks:

notebook.community | gallery | about