database: submission, status, future. send data and receive email confirmation is not enough!!!!...

Database: submission, status, future

Send data and receive email confirmation is not enough!!!!Remember to import or discard your variables!!

Dear CarboeuropeIP PI, your file IT-TolMET05_01_10811200513240.xls has been recived and readed. As you know we perform some simple checks to find possible errors in the data. Attached you can find the remark file created. Take into account that it is possible that not all the problem reported in the remark are really due to not correct data. However, your data are ready to be imported in the database. To do this please visit to the page: http://gaia.agraria.unitus.it/database/prexvars.asp where you can decide which variables to import or discard and send again. This message has been automatically generated. For any additional information you can reply to this message. Best Regards The Carboeurope IP - Ecosystem Component Database Staff

Status

Looking to who submitted what…..

Sta

tus

Mai

n s

ites

Site 2004 2005BE-Bra OK OKBE-Lon OK OKBE-Vie OK OKCH-Lae OK OKCH-Oe1 OK OKCH-Oe2 OK OKCZ-BK1 OK OKDE-Geb OK OKDE-Gri OK OKDE-Hai OK OKDE-Kli OK OKDE-Tha OK OKDE-Wet OK OKDK-Lva OK OKDK-Ris NO NODK-Sor OK OKES-ES2 unilt 3/04 OKES-LMa OK OKES-VDA until 4/04 NOFI-Hyy OK OKFI-Kaa OK OKFI-Sod OK OKFR-Fon NO from 3/05FR-Gri from 5/04 OKFR-Hes until 4/04 NOFR-LBr OK OK

Site 2004 2005FR-Lq1 OK OKFR-Lq2 OK OKFR-Pue OK OKHU-Bug OK NOIE-Ca1 OK NOIE-Dri NO NOIT-Amp OK OKIT-Col from 5/04 NOIT-MBo OK OKIT-PT1 until 8/04 NOIT-Ren until 4/04 OKIT-Ro1 OK OKNL-Ca1 until 7/04 NONL-Hor OK OKNL-Loo OK OKPL-wet OK OKPT-Esp OK OKPT-Mi1 until 8/04 NOPT-Mi2 from 8/04 OKSE-Nor until 10/04 NOSE-Sk1 until 10/04 NOSE-Sk2 until 10/04 NOUK-EBu OK NOUK-ESa until 10/04 NOUK-Gri from 10/04 OKUK-PL3 OK NO

Site 2004 2005 2006BE-Bra OK OK OKBE-Lon OK OK OKBE-Vie OK OK OKCH-Lae OK OK NOCH-Oe1 OK OK OKCH-Oe2 OK OK NOCZ-BK1 OK OK OKDE-Geb OK OK OKDE-Gri OK OK OKDE-Hai OK OK OKDE-Kli OK OK OKDE-Tha OK OK OKDE-Wet OK OK OKDK-Lva OK OK OKDK-Ris OK OK OKDK-Sor OK OK OKES-ES2 OK OK OKES-LMa OK OK OKES-VDA OK OK OKFI-Hyy OK OK OKFI-Kaa OK OK OKFI-Sod OK OK OKFR-Fon x OK OKFR-Gri OK OK OKFR-Hes OK OK OKFR-LBr OK OK OK

Site 2004 2005 2006FR-Lq1 OK OK OKFR-Lq2 OK OK OKFR-Pue OK OK OKHU-Bug OK OK OKIE-Ca1 OK OK OKIE-Dri OK OK NOIT-Amp OK OK OKIT-Col OK OK NO FLUXIT-MBo OK OK NO FLUXIT-Sro OK OK CONIT-Ren OK OK OKIT-Ro1 OK OK OKNL-Ca1 OK OK NONL-Hor OK OK CONNL-Loo OK OK OKPL-wet OK OK OKPT-Esp OK OK CONPT-Mi1 OK OK OKPT-Mi2 OK OK OKSE-Nor OK OK OKSE-Sk1 OK OK OKSE-Sk2 OK OK OKUK-EBu OK OK NO FLUXUK-ESa OK OK OKUK-Gri few OK OKUK-PL3 OK OK OK

Site 2004 2005BE-Bra OK NOBE-Lon OK OKBE-Vie OK OKCH-Lae NO NOCH-Oe1 OK OKCH-Oe2 NO OKCZ-BK1 NO OKDE-Geb OK OKDE-Gri NO OKDE-Hai OK OKDE-Kli OK OKDE-Tha OK OKDE-Wet OK OKDK-Lva NO OKDK-Ris OK OKDK-Sor OK OKES-ES2 NO OKES-LMa OK OKES-VDA OK NOFI-Hyy OK OKFI-Kaa OK OKFI-Sod OK OKFR-Fon NO OKFR-Gri NO OKFR-Hes OK OKFR-LBr OK OK

Site 2004 2005FR-Lq1 OK OKFR-Lq2 OK OKFR-Pue OK OKHU-Bug OK OKIE-Ca1 OK OKIE-Dri OK NOIT-Amp OK OKIT-Col OK OKIT-MBo OK OKIT-Sro OK OKIT-Ren NO OKIT-Ro1 OK OKNL-Ca1 OK NONL-Hor OK OKNL-Loo OK OKPL-wet NO OKPT-Esp OK NOPT-Mi1 OK OKPT-Mi2 OK OKSE-Nor NO OKSE-Sk1 NO OKSE-Sk2 NO OKUK-EBu NO NOUK-ESa OK OKUK-Gri NO OKUK-PL3 NO OKS

tatu

s M

ain

sit

es –

LE

VE

L4

pro

d.

Ass

oci

ated

Mai

n s

ites

Site 2004 2005NL-Ca2 5 5CZ-BK2 6 6DK-Fou 6UK-Ham 12 4DE-Meh 12 6IL-Yat 12 6IT-Cpz 12 9IT-Ro2 12 9HU-Mat 12IT-Lav 12IT-LMa 12IT-Mal 12IT-Tol 10

Site 2004 2005 2006IT-NonNL-Ca2CZ-BK2DK-FouUK-HamDE-MehIL-YatIT-CpzIT-Ro2HU-MatIT-LavIT-LMaIT-MalIT-TolBE-JalCZ-wetES-ES1IT-BCiUK-Har

Status of General information and Soil Respiration files submission

-5 -4 -3 -2 -1 0 1 2 3 4 5

BE-Bra

BE-Vie

DE-Tha

DK-Sor

FI-Hyy

FR-Hes

FR-LBr

IT-Col

NL-Loo

SE-Nor

UK-Gri

CZ-BK1

DE-Hai

FI-Kaa

FI-Sod

FR-Pue

IT-SRo

IT-Ren

IT-Ro1

PT-Esp

PT-Mi1

BE-Lon

CH-Lae

CH-Oe1

CH-Oe2

-5 -4 -3 -2 -1 0 1 2 3 4 5

DE-Geb

DE-Gri

DE-Kli

DE-Wet

DK-Lva

DK-Ris

ES-ES2

ES-LMa

ES-VDA

FR-Fon

FR-Gri

FR-Laq

HU-Bug

IE-Ca1

IE-Dri

IT-Amp

IT-Mbo

NL-Ca1

NL-Hor

PL-w et

PT-Mi2

SE-Sk1

SE-Sk2

UK-EBu

UK-ESa

UK-PL3

Soil Resp Gen file Soil Resp Gen file

Site name 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005BE-Bra Brasschaat

BE-Jal Jalhay

BE-Lon Lonzee

BE-Vie Vielsalm

CH-Lae Laegern

CH-Oe1 Oensingen grassland

CH-Oe2 Oensingen crop

CZ-BK1 Bily Kriz forest

CZ-BK2 Bily Kriz grassland

CZ-wet CZECHWET

DE-Bay Bayreuth

DE-Geb Gebesee

DE-Gri Grillenburg

DE-Hai Hainich

DE-Kli Klingenberg

DE-Meh Mehrstedt

DE-Obe Oberbärenburg

DE-Sch Schönau

DE-Tha Tharandt

DE-Wet Wetzstein

DK-Fou Foulum

DK-Lva Rimi

DK-Ris Risbyholm

DK-Sor Soroe

DK-Ulb Ulborg

ES-ES1 El Saler

ES-ES2 El Saler-Sueca

ES-LJu Llano de los Juanes

ES-LMa Las Majadas del Tietar

ES-Tol Toledo

ES-VDA Vall de Aliñá (Lleida)

ES-Zam Zambrana

FI-Hyy Hyytiälä

FI-Kaa Kaamanen

Site name 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005FI-Sod Sodankylä

FR-Aur Auradé

FR-Avi Avignon

FR-Bil Bilos

FR-Cou Couhins

FR-Fon Fontainbleu

FR-Gri Grignon

FR-Hes Hesse

FR-Lam Lamasquère

FR-LBr Le Bray

FR-Lq1 Laqueuille intensive

FR-Lq2 Laqueuille extensive

FR-Lus Lusignan

FR-Pue Puechabon

HU-Bug Bugac

HU-Mat Matra

IE-Ca1 Carlow crop

IE-Ca2 Carlow grassland

IE-CLa Co. Laois

IE-Dri Dripsey

IE-Kil Killorglin

IE-Wex Wexford

IL-Yat Yatir

IS-Gun Gunnarsholt

IT-Amp Amplero

IT-BCi Borgo Cioffi

IT-Bon Bonis

IT-Col Collelongo

IT-Cpz Castelporziano

IT-Gro Grosseto

IT-Lav Lavarone

IT-LMa La Mandria

IT-Mal Malga Arpaco

Site name 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005IT-MBo Monte Bondone

IT-Noe Arca di Noé

IT-Non Nonantola

IT-Pia Pianosa

IT-PT1 Parco Ticino forest

IT-PT2 Parco Ticino crop

IT-Ren Renon

IT-Ro1 Roccarespampani 1

IT-Ro2 Roccarespampani 2

IT-SRo San Rossore

IT-To1 Tolfa wet

IT-To2 Tolfa dry

IT-Tol Tolfa

NL-Ca1 Cabauw

NL-Ca2 Cabauw extension

NL-Hor Horstermeer

NL-Lel Lelystad

NL-Loo Loobos

NL-Re1 Reeuwijk 1

NL-Re2 Reeuwijk 2

PL-Pol Polana

PL-wet POLWET

PT-Esp Espirra

PT-Mi1 Mitra II (Evora)

PT-Mi2 Mitra IV (Tojal)

RU-Fyo Fyodorovskoye

SE-Asa Asa

SE-Deg Degerö

SE-Fla Flakaliden

SE-Kno Knottåsen

SE-Nor Norunda

SE-Sk1 Skyttorp 1

SE-Sk2 Skyttorp 2

Site name 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005SE-St1 Stordalen grassland

SE-St2 Stordalen forest

UK-AMo Auchencorth Moss

UK-EBu Easter Bush

UK-ESa East Saltoun

UK-Gri Griffin

UK-Ham Hampshire

UK-Har Harwood

UK-Her Hertfordshire

UK-PL1 Pang/Lambourne cr

UK-PL2 Pang/Lambourne gr

UK-PL3 Pang/Lambourne fo

UK-Tad Tadham Moor

• In the next weeks the Greengrass database will be incorporated in the Carboeurope IP database and processed.

• We asked also the data from Carbomont without answer

• We are waiting the data from the Siberian projects (from Eurasia-net to TCOS)

• We will try also to obtain data from the Amazonian project from EU

• Any other dataset is welcome

We invite also the PIs to send their data and in particular the 2003 missed months!!!

NO (only partially)…

Still without (partially)…

Coming

Coming

Questions/discussion about the status?

Gapfilling intercomparison results

From the Gapfilling WS: Do we need more variables?

Flag indicating if there are footprint problems (particularly for crop)

Flags indicating the management

LAI or NDVI or Vegetation height (crop and grass)

NOTE!It is not a good solution to

put simply qcFc = 2 because the qcFc are defined from

Spoleto!

The database role in standardization

1) Storage correction whit Sc provided by the PI (NEE_or) and calculated from the CO2 concentration top of tower (NEE_st)

2) Ustar threshold calculated centrally

3) Spike filtering performed centrally

4) Gapfilling performed centrally using the two best methods from the gapfilling intercomparison

5) Partitioning in GPP and TER performed centrally

BUT

What about “standard quality flags obtained from the raw data”?

What about the corrections/checks applied to the raw data?

What about the corrections implemented in your software?

Unfortunately not all the PIs are sending the correct quality flags. Many sites have all the data with qc=0, or with all qc=2.

There are sites that are not applying the qc correctly and mix-up with ustar filtering or footprint

How many of you provided these info correctly to the database?

Are these information important?

Setting Comparison BA – 3D – ConstTLag

LD – 3D – AutTLag

BA

LD

µm

olC

O2

m-2 s

-1

Generally this has a small effect to the sums

However can have effect on the single half hour

How to solve this problem? How to avoid these differences?

Using the same software with exactly the same settings

BUTWe compared different software and they give very similar results with the same settings

Using the exactly the same settings

BUTCan we define a “right” set of corrections and settings? What about the uniqueness of the sites?

Use what you want but tell me what you did…

BUTHow can you send these information to the database? How many of you sent the information about the 2D 3D or PF correction applied?How many of you are sending the updated versions of the GEN file?

The best would be to have a common software where:

- The user could decide which correction to apply

- There would be implemented all the possible corrections

- The user could also propose and add new options/corrections

- All the settings used would be summarized in a table as metadata

- The output would be directly formatted to be uploaded in the DB

But to work, this software should be:

- As flexible as possible

- Available for all the HW/OS platforms

- Continuously updated

- User friendly for not expert users

And in particular:

- FREE- OPEN SOURCE- COMMON PROPERTY (CarboeuropeIP, Fluxnet)

Are you interested in developing a common “community owned eddy covariance software”?

We started developing the structure of such a software and now it is ready for your input…

code: FORTRAN 77/90

OPEN-SOURCE CODEOPEN-SOURCE CODE

SET-UP BASED ON “.ini”-filesSET-UP BASED ON “.ini”-files

ACQUISITIONACQUISITION

PROCESSINGPROCESSING

core: FORTRAN 77/90

•Features a user-friendly GUI

•Simple but less flexible

GUI: C (LabWindows)

Graphical version available

RAW DATA

SPECTRAL ANALYSIS

PLANAR FIT

ACQUISITION SOFTWARE

RAW DATA SCREENING

time-lag detection and data alignment

fluctuation calculation

mean, variances, co-variances

Axis rotation

Schotanus and WPL correction

Fluxes, u*, T*, z/L etc.. calculation

Spectral correction

Quality Check / Quality Flagging

CE-IP STANDARD OUTPUT

.med FILES

selected datasetsall raw data

TRANSLATOROTHER RAW

DATA




Axis rotation



Spectral correction


Moncrieff et al., 1997 – Journal of IdrologyAubinet et al., 2000 – Advances in Eological Research

Moncrieff et al, 2004 – Handbook of Micrometeorology

Lee et al. 2004, Handbook of Micrometeorology

Aubinet et al., 2000 – Advances in Eological Research

Liu et al., 2001 – Boundary Layer MeteorolgyWebb et al., 1980 – Quart. J. R. Soc.

Moncrieff et al., 1997 – Journal of IdrologyHorst, 1997 – Boundary Layer Meteorology

Aubinet et al., 2001 – Agricultural and Forest Meteorology

Foken and Wichura, 1996 – Agricultural and Forest Meteorology

Foken et al., 2004 – Handbook of Micrometeorology

Thomas and Foken, 2002 – Am. Meteorol. Soc.

warm thanks to the Eddy Covariance CE-IP Summer School (Wépion, July 10-21, 2006) organizers and speakers!!

RAW DATA

SPECTRAL ANALYSIS

PLANAR FIT


RAW DATA SCREENING




Axis rotation



Spectral correction


.med FILES


TRANSLATOROTHER RAW DATA


RAW DATA

SPECTRAL ANALYSIS

PLANAR FITRAW DATA SCREENING




Axis rotation



Spectral correction



.med FILES


headers, anemometer format, scaling factors, offsets, binary …

TRANSLATOR

suitable format


RAW DATA

SPECTRAL ANALYSIS

PLANAR FIT


RAW DATA SCREENING




Axis rotation



Spectral correction


.med FILES


TRANSLATOROTHER RAW

DATA




Axis rotation



Spectral correction


RAW DATA

SPECTRAL ANALYSIS

PLANAR FIT


RAW DATA SCREENING

.med FILES


spike removal (*)

amplitude resolution (*)

drop-outs (*)

absolute limits (*)

discontinuities (*)

Skewness and Kurtosis (*)

unrealistic time-lag (*)

angle of attack (*)

non-steady horizontal wind (*) .med FILES

MODIFIED RAW DATA



(*) Vickers and Mahrt, 1997 – Jour. Atm. Ocean. Tech.

RAW DATA

PLANAR FIT


RAW DATA SCREENING




Axis rotation



Spectral correction


.med FILES


TRANSLATOROTHER RAW

DATA

SPECTRAL ANALYSIS




RAW DATA

PLANAR FIT


RAW DATA SCREENING




Axis rotation



.med FILES


Calculation of scalars / w co-spetra

Calculation sens. heat / w co-spectrum

Calculation of exper. transfer functions

automatic or manual regression with a given function

Spectral correction

1,00E-09

1,00E-08

1,00E-07

1,00E-06

1,00E-05

1,00E-04

1,00E-03

1,00E-02

1,00E-01

1,00E+00

1,00E-04 1,00E-03 1,00E-02 1,00E-01 1,00E+00 1,00E+01

1,00E-09

1,00E-08

1,00E-07

1,00E-06

1,00E-05

1,00E-04

1,00E-03

1,00E-02

1,00E-01

1,00E+00

1,00E-04 1,00E-03 1,00E-02 1,00E-01 1,00E+00 1,00E+01

0

0,2

0,4

0,6

0,8

1

1,2

1,4

0,001 0,01 0,1 1 10 100

0

0,2

0,4

0,6

0,8

1

1,2

1,4

0,001 0,01 0,1 1 10 100

SPECTRAL ANALYSIS

If user wants to use the <exp> or <mix> spectral correction options..

RAW DATA

SPECTRAL ANALYSIS

PLANAR FIT


RAW DATA SCREENING




Axis rotation



Spectral correction


.med FILES


TRANSLATOROTHER RAW

DATA



RAW DATA

SPECTRAL ANALYSIS

PLANAR FIT


RAW DATA SCREENING






Spectral correction


CIP STANDARD OUTPUT .med FILES


Axis rotation

passes plane coefficients to main prog for rotation angle calculation

calculates planar fit (bi-linear regression) of w vs u/v

If user wants to use the <pf> option..

Some preliminary validation

With EDIRE BA 3D

With MASE LD 3D

SOME CORRECTIONS, TESTS, OPTIONS ARE NOT YET IMPLEMENTED (EX: OGIVE TEST, FOOTPRINT TEST…)

SOME ANEMOMETER AND IRGA ARE ALSO NOT YET SUPPORTED

THE MODULE TO IMPORT RAW DATA FORM OTHER SOFTWARE READS NOW ONLY FEW DATA-TYPES

THE SW STILL NEEDS A THOROUGH VALIDATION

THE AVAILABLE GUI PRESENTLY RUNS ONLY ON WINDOWS (2000 and later)

.. AND SOME BUGS ARE TO BE FIXED!!

WHERE WE ARE AND WHAT WE NEED..

THE SOFTWARE CURRENTLY SUPPORTS MANY OF THE FEATURES AND PROCESSING OPTIONS PRESENTED DURING THE SUMMER SCHOOL. NONETHELESS…

FLUXNET Synthesis Workshop 2007

19-22 February 2007 – La Thuille - Italy

Different networks involved:

CarboeuropeIP, Ameriflux, Fluxnet-Canada, LBA, CarboAfrica, OzFlux, TCOS

Siberia, ChinaFlux, KoFlux, AsiaFlux, NECC, US-China Carbon Consortium

Sponsors (not all confirmed):

GTOS

ILEAPS

NASA

DAO

Global Carbon Project

CarboeuropeIP

Organizing Commitee:D. BaldocchiT. BodenP. CiaisB. CookB. LawD. PapaleM. ReichsteinS. RunningR. Valentini


The workshop has been designed as a real hands-on data synthesis workshop

It will be restrict to 30-50 people coming from the different regional networks

Particularly scientists most interested in synthesis activities should participate

This does not preclude valuable post-workshop intellectual input from non-participating scientists for the scientific papers and co-authorship

The harmonized global dataset will be available to all the community for other synthesis works particularly for the many topics that will be not discussed at the WS

Dataset will be pre-processed in an harmonized way before the WS




Carboeurope-IP Ecosystem Component will participate to the synthesis

All the datasets submitted to the CarboeuropeIP database will be included (only if with good quality) and the PIs will be part of the activity. If you don’t want that your data will be used in this activity please send us a note.

Carboeurope will have 7-8 participants to the WS and we have to provide a list of about 12-15 names with topic of interest to the Organising Committee before November 30th, with if possible a good balance between experienced and young PostDoc-level scientists

Based on the suggestions of all networks and in consultation with networks, the Organising Commitee will propose a final participant list before December 10th (in order to avoid gaps or overloaded topics).



First draft of the list:

Proposed names Area of interest

M. Aubinet / C. Bernhofer / A. Knohl Energy partitioning

I. Janssen / S. Luysaaert / G. Matteucci GPP / NPP

N. Buchmann / A. Granier / D. Yakir Ecophysiology data driven

J. Grace / D. Lousteau / D. Schulze Forest age/management effect

JF. Soussana / P. Smith / M. Wattenbach Grassland and croplands

E. Falge / J. Tenhunen Ecophysiology model based

F. Miglietta / S. Rambal / G. Suefert Mediterranean synthesis

T. Laurila, A. Lindroth, T. Vesala… Boreal ecosystems synth. - NECC

database: submission, status, future. send data and receive email confirmation is not enough!!!!...

Documents

future slide

coming slide

d auttlag ba ld slide

raw data

single half hour slide

status of general information

database role

greengrass database