Ga verder naar de inhoud

Veranderingen

View changes from to


Op 25 augustus 2022 om 21:23:56 CEST, Gravatar bas :
  • Updated description of Energy consumption observed from

    # Introduction Within the frame of IRIS Utrecht, data regarding energy consumption is being collected from a number of apartment buildings. Purpose of collecting these data is to be able to evaluate the result of energy saving measures. To be able to calculate energy consumption, the following variables are needed: * electricity delivered (from net to connection) * electricity generated (by PV panels) * electricity returned (from connection to net) Using these variables, electricity consumption can be calculated using the following formula: electricity consumed = electricity delivered + electricity generated - electricity returned ![Electricity delivered, produced and generated explained](https://acc-ckan-dataplatform-nl.dataplatform.nl/dataset/ff31cc71-49d9-4e01-9825-68f8f38efe93/resource/4df5ddde-4320-49d2-b9e1-6d9a962b2c4b/download/energy_consumption_observed.png) *Electricity delivered, produced and generated explained* We are collecting energy consumption from different sources. ## Toon smart thermostat Every night, Quby uploads a file containing energy consumption data from Alexander de Grotelaan I, II, III and IV, Columbuslaan II and Rooseveldlaan I and II to a Amazon S3 bucket. Theses data contain average electricity delivered (from net to connection) and electricity received (from connection to net) for two tariffs (low and normal tariff) at 15 minute intervals. In addition to the average, the files contain the standard deviation and the number of connections involved in calculating the average and standard deviation values. The dataset does not contain energy generated, and can thus not be used to calculate energy consumption. To work around this issue, energy generated by Columbuslaan I (downloaded from the myBeNext API) is used to estimate energy generation by the other apartment buildings. The S3 file should contain four rows per hour for each apartment building/variable combination. In the picture below, hours for which this is not the case have been marked red. This is probably due to the fact that there are no households producing data for that timestamp/variable. If all variables are missing for a timestamp, this will lead to a missing data point in this dataset. If at least one variable is present for a timestamp, the missing ones will be zero. ![Missing data in S3 file](https://acc-ckan-dataplatform-nl.dataplatform.nl/dataset/ff31cc71-49d9-4e01-9825-68f8f38efe93/resource/320177c1-1587-49d4-b3cf-e1c8fc1358e8/download/missing_rows_in_s3_file.png) ## myBeNext API Every hour, quarterly data is being downloaded from the myBeNext API for two apartment buildings: Henriettedreef and Columbuslaan I. For Henriettedreef, data regarding electricity delivered, electricity returned and electricity produced is collected. This information is available at the level of the individual connections, but this information is never stored in the dataset. The dataset contains the sum for the entire apartment building. ## Access the data ### CKAN datastore API The data can be downloaded from the CKAN resource included in this package. Because of the size of the dataset, downloading the entire dataset in one go will probably fail due to time outs. The CKAN datastore API can be used to download the dataset in parts.Example code how that can be done can be found [here](https://github.com/CivityNL/Snuffelfiets-examples). To be able to run this code, you will need a resource identifier (in this case energy_consumption_observed_cepontod) and (in case of a private dataset) an API key. You can find your API key by logging in to CKAN and clicking on your username in the top right corner of the page. You will then find your API key on the left. ### FIWARE ContextBroker The [get entities](https://acc-toon.dataplatform.nl//smart-thermostat/orion/v2/entities?type=EnergyConsumptionObserved) gets the current state of the different enties. It provides a list of a) the entities and b) the attributes which can be used to compile requests for the Short Term History API. ### Short Term History API The Short Term History (STH) API provides access to historical information for the different entities in both raw and aggregated form. [Columbuslaan II, electricity consumed, raw values](https://acc-toon.dataplatform.nl/smart-thermostat/STH/v2/entities/columbuslaan_ii/attrs/electricityConsumed?type=EnergyConsumptionObserved&lastN=100&count=false) [Columbuslaan II, electricity delivered, aggregated values per month between January 1, 2022 and January 1, 2023](https://acc-toon.dataplatform.nl/smart-thermostat/STH/v2/entities/columbuslaan_ii/attrs/electricityDelivered?type=EnergyConsumptionObserved&aggrMethod=sum&aggrPeriod=month&dateFrom=2022-01-01T00%3A00%3A00.0%2B02%3A00&dateTo=2023-01-01T00%3A00%3A00.0%2B02%3A00&count=false)
    to
    # Introduction Within the frame of IRIS Utrecht, data regarding energy consumption is being collected from a number of apartment buildings. Purpose of collecting these data is to be able to evaluate the result of energy saving measures. To be able to calculate energy consumption, the following variables are needed: * electricity delivered (from net to connection) * electricity generated (by PV panels) * electricity returned (from connection to net) Using these variables, electricity consumption can be calculated using the following formula: electricity consumed = electricity delivered + electricity generated - electricity returned ![Electricity delivered, produced and generated explained](https://acc-ckan-dataplatform-nl.dataplatform.nl/dataset/ff31cc71-49d9-4e01-9825-68f8f38efe93/resource/4df5ddde-4320-49d2-b9e1-6d9a962b2c4b/download/energy_consumption_observed.png) *Electricity delivered, produced and generated explained* We are collecting energy consumption from different sources. ## Toon smart thermostat Every night, Quby uploads a file containing energy consumption data from Alexander de Grotelaan I, II, III and IV, Columbuslaan II and Rooseveldlaan I and II to a Amazon S3 bucket. Theses data contain average electricity delivered (from net to connection) and electricity received (from connection to net) for two tariffs (low and normal tariff) at 15 minute intervals. In addition to the average, the files contain the standard deviation and the number of connections involved in calculating the average and standard deviation values. The dataset does not contain energy generated, and can thus not be used to calculate energy consumption. To work around this issue, energy generated by Columbuslaan I (downloaded from the myBeNext API) is used to estimate energy generation by the other apartment buildings. The S3 file should contain four rows per hour for each apartment building/variable combination. In the picture below, hours for which this is not the case have been marked red. This is probably due to the fact that there are no households producing data for that timestamp/variable. If all variables are missing for a timestamp, this will lead to a missing data point in this dataset. If at least one variable is present for a timestamp, the missing ones will be zero. ![Missing data in S3 file](https://acc-ckan-dataplatform-nl.dataplatform.nl/dataset/ff31cc71-49d9-4e01-9825-68f8f38efe93/resource/320177c1-1587-49d4-b3cf-e1c8fc1358e8/download/missing_rows_in_s3_file.png) ## myBeNext API Every hour, quarterly data is being downloaded from the myBeNext API for two apartment buildings: Henriettedreef and Columbuslaan I. For Henriettedreef, data regarding electricity delivered, electricity returned and electricity produced is collected. This information is available at the level of the individual connections, but this information is never stored in the dataset. The dataset contains the sum for the entire apartment building. ## Access the data ### CKAN datastore API The data can be downloaded from the CKAN resource included in this package. Because of the size of the dataset, downloading the entire dataset in one go will probably fail due to time outs. The CKAN datastore API can be used to download the dataset in parts.Example code how that can be done can be found [here](https://github.com/CivityNL/Snuffelfiets-examples). To be able to run this code, you will need a resource identifier (in this case energy_consumption_observed_cepontod) and (in case of a private dataset) an API key. You can find your API key by logging in to CKAN and clicking on your username in the top right corner of the page. You will then find your API key on the left. ### FIWARE ContextBroker The [get entities](https://acc-toon.dataplatform.nl//smart-thermostat/orion/v2/entities?type=EnergyConsumptionObserved) gets the current state of the different enties. It provides a list of a) the entities and b) the attributes which can be used to compile requests for the Short Term History API. ### Short Term History API The Short Term History (STH) API provides access to historical information for the different entities in both raw and aggregated form. [Columbuslaan II, electricity consumed, raw values](https://acc-toon.dataplatform.nl/smart-thermostat/STH/v2/entities/columbuslaan_ii/attrs/electricityConsumed?type=EnergyConsumptionObserved&lastN=100&count=false) [Number of connections corresponding to the previous API call](https://acc-toon.dataplatform.nl/smart-thermostat/STH/v2/entities/columbuslaan_ii/attrs/noConnectionsElectricityConsumed?type=EnergyConsumptionObserved&lastN=100&count=false) [Columbuslaan II, electricity delivered, aggregated values per month between January 1, 2022 and January 1, 2023](https://acc-toon.dataplatform.nl/smart-thermostat/STH/v2/entities/columbuslaan_ii/attrs/electricityDelivered?type=EnergyConsumptionObserved&aggrMethod=sum&aggrPeriod=month&dateFrom=2022-01-01T00%3A00%3A00.0%2B02%3A00&dateTo=2023-01-01T00%3A00%3A00.0%2B02%3A00&count=false)