noise and fsv

Upload: max-paterson

Post on 07-Apr-2018

235 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/6/2019 Noise and FSV

    1/14

    Published in IET Science, Measurement & Technology

    Received on 26th July 2007

    Revised on 1st October 2007

    doi: 10.1049/iet-smt:20070063

    ISSN 1751-8822

    Modifying the feature-selective validationmethod to validate noisy data setsJ. Knockaert

    1 J. Peuteman

    2 J. Catrysse

    2R. Belmans

    1

    1Department of Electrical Engineering (ESAT), Katholieke Universiteit Leuven, Onderzoeksgroep ELECTA, Kasteelpark

    Arenberg 10, Heverlee B-3001, Belgium2Department of IW&T, Katholieke Hogeschool Brugge Oostende, Zeedijk 101, Oostende B-8400, Belgium

    E-mail: [email protected]

    Abstract: Objective validation and ranking of measurements and simulations may be done by methods such as

    feature selective validation (FSV). FSV is used to compare two EMC-measurement results. Owing to

    the noisy nature of these type of data, the FSV results are corrupted. The reasons are discussed and

    solutions are proposed to make FSV feasible in a broader area of applications. The final solution is a

    combination of denoising the data and changing the weight of the data to be in accordance with our visual

    interpretation.

    1 IntroductionTo put computational electromagnetics (CEM)validation methods in a wider context, someexplanations on the search for CEM standardisationare needed. Section 2 places feature-selectivevalidation (FSV) method and integrated error againstlog frequency (IELF) in the area of standardisation.Some remarks on this history are necessary tounderstand the main purpose of FSV and whymodifications are needed if FSV is to be used for otherpurposes. Section 3 starts with a discussion on

    detectors. The width of the noise band is estimatedfor peak and quasi-peak measurements. The rest ofthis section discusses why noise corrupts the FSVresult. Three possible solutions are investigated in theSection 4. One solution changes FSV, and two othersolutions reduce the noise. The Section 5 combinesthe ideas of both the modified FSV and IELF. The lastsection discusses a real application where the modifiedFSV versions were used.

    2 Validation

    2.1 Background

    For simulation of electromagnetics, engineers andscientists have to choose from a vast amount of CEM

    methods. Examples are finite element method (FEM),method of moments (MoM), finite-difference timedomain and so on. As these methods are numerical,discretisation both in space and time is used and asimplification of a complex reality is needed.Therefore all methods may give different results. Thisraises the question which method is correct or gives atleast the best approximation. This unansweredquestion resulted in the start of the IEEE standardproject P1597.1 in 2001 Standard for validation ofcomputational electromagnetics (CEM) computermodelling and simulation [1].

    Two key areas for benchmarking can be distinguished.The first area is the validation by canonical models. Thisinvestigation results in a set of standard EMC problemsusable to evaluate the modelling tools [2]. The secondarea is the validation by simulation againstmeasurement. Validation methods such as FSV andIELF are in this area.

    2.2 Need for objective validation

    While presenting a paper on an EMC-symposium, the25 participants were asked to evaluate 5 EMC results

    from different measuring setups (Mini-symposiumEMC 2007, 5th April 2007, Hogeschool vanAmsterdam, organised by the Dutch EMC-ESD

    / IET Sci. Meas. Technol., 2008, Vol. 2, No. 4, pp. 244257 & The Institution of Engineering and Technology 2008doi: 10.1049/iet-smt:20070063

    244

    www.ietdl.org

  • 8/6/2019 Noise and FSV

    2/14

    organisation). Fifteen of them did fill in the form. Thefive spectra can be found in the example at the end ofthe paper. The participants had to give a ranking (15), to express the best to worst correlation. Fig. 1shows a histogram of the votes. For the LISNVP (lineimpedance stabilisation network used as voltage probe,see Section 6.2.1.), six people found this the bestcomparison, four people the second best and so on.

    Some statistics are shown in Table 1. The meanvalue for the LISNVP is 2.00 with a standarddeviation of 1.00, thereby reaching the second placein the ranking. Some conclusions can be drawn.There is no consensus at all. The largest consensus(smallest standard deviation) is noted on the finallybest (LISNVP) and worst (EFT, electrical fasttransients) ranked method. This is only aconfirmation of what statisticians have already proved

    for decades.

    This small inquiry shows that a validation ofmeasurement data is very subjective and may lead tohuge discussions. An objective validation can avoidsubjective discussions.

    2.3 Feature-selective Validation

    FSV is a method for validation of CEM [3], withapplications in EMC and signal integrity. This methodhas shown its usefulness in the validation of EMC

    models [3].

    When comparing two data sets, normallymeasurements and simulations, FSV decomposes bothdata sets into two parts, trend and feature data. Thetrend data can be seen as the low frequency part,whereas the feature data or fast variations can be seenas the high-frequency part. The terms low and highfrequency can be confusing when the data sets

    represent a measurement in the frequency domain.The low and high-frequency parts have nothing to dowith the frequency axis, but with slow or fastvariation of the shape of data set itself. Analysing the

    low-frequency part gives a measure of similarity ofthe trend (ADM or amplitude difference measure).Analysing the high-frequency part of both data setsgives a measure of the similarity of the feature (FDMor feature difference measure). These figures combineto a global goodness-of-fit value (GDM or globaldifference measure). The strength of the FSV-methodis the point-by-point comparison showing at whichdata points the comparison fails. Combination of allmeasures to one figure, expressed by a naturallanguage description (excellent up to very poor), isa further strength.

    One of the weak points of FSV is the choice of theboundary between low- and high-frequency parts. Theseparation point is chosen empirically. According to asensitivity analysis, this boundary is considered asrather good [4]. The actual problem is that theboundary is possibly not optimal for comparison ofother typical data sets, like two EMC peakmeasurements. The boundary is considered as one ofthe future research points [4].

    In this paper, FSV is used to compare the conductedemission measurements. EMC measurements, as shown

    in Fig. 2, are characterised by noisy data, especiallywhen using a peak and average detector.

    2.4 Integrated error against logfrequency

    Consider both measurements in Figs. 2a and 2b. Whenanalysing the correlation of both curves, it is unclearwhich one has the best value. In reality, there is nodifference between the top and bottom one.The measurements are the same, but on the top figurethe frequency axis is linear, on the bottom one, the

    frequency axis is logarithmic. EMC measurementsare measured by linear steps, but are visualisedlogarithmically.Figure 1 Histograms of the votes

    Table 1 Mean value, standard deviation and

    ranking according to the participants

    Mean Standard deviation Rank

    LISNVP 2.00 1.00 2

    VP 4.00 1.00 4

    CVP 1.67 0.82 1

    EFT 4.20 0.86 5

    CFP 3.13 1.30 3

    & The Institution of Engineering and Technology 2008 IET Sci. Meas. Technol., 2008, Vol. 2, No. 4, pp. 244257/doi: 10.1049/iet-smt:20070063

    245

    www.ietdl.org

  • 8/6/2019 Noise and FSV

    3/14

    To compare data sets, statistical methods can beused. However, with linear data, logarithmically

    visualised, 50% of the data is compressed in 15% ofthe picture. Normal statistic methods such as aPearsons correlation put the same weight on alldata points, and by visual inspection, there is moreweight on the first (left) part of the data points.Visual inspection emphasises the left part of the datapoints.

    IELF was developed to cope with this problem [5]. Itputs more weight on the left part of the data set anddecreases this weight logarithmically. Evaluating thedifference on a logarithmic frequency base increases

    the accordance with the visual interpretation. It isshown that this evaluation gives better results whenranking various measurements [5]. The basic IELF

    equation (1)

    IELF

    Pn1i1

    jerrorij:{ l n ( fi1) ln ( fi1)}=2ln(f

    n)

    ln(f0)

    (1)

    has been modified to (2) to provide better results

    IELFmod

    Pn1i1 jerrorij:{ln(( fi1 fi)=2)

    ln(( fi fi1)=2)}ln ( fn) ln ( f0)

    (2)

    The problem of the IELF equations mentioned is that thedata is not normalised: data sets with a different meanvalue are not ranked correctly [6]. A very simplenormalisation gives good results. An example of atwo-step normalisation is:

    make the mean value 0,

    make the standard deviation 1.

    3 Noisy data sets and FSV

    3.1 Detectors

    EMC measurements are performed by a

    superheterodyne receiver (spectrum analyzer ormeasuring receiver). Four types of detectors arecommonly used: PK (peak), AV (average), QP (quasi-peak) and RMS. The basic detector for emissionmeasurements is the quasi-peak detector. Althoughit is difficult to analyse the quasi-peak detectortheoretically, for noise measurements, some interestingproperties have been illustrated. The ratio betweenquasi-peak and RMS value for a zero-mean Gaussiannoise or normally distributed (ND) noise input isapproximately 1.85 [7]. For the same type of input,the ratio between peak and RMS value is not known,but as a rule of thumb, 4 can be taken with high

    confidence [7]. Combining both values gives thefollowing rule of thumb: the ratio between peak andquasi-peak value and the RMS for ND noise input canbe taken as 2.16. This means that the results of quasi-peak measurements are 6.7 dB lower than those of thepeak measurements in the case of ND noise or, inother words, the noise band is 6.7 dB smaller. Thisproperty is used in Section 4.3.

    When performing emission measurements with apeak detector, the result is a trend line with a noiseband and particular features, such as small and broad

    peaks. The noise band is typical ND noise as seen inSection 4.2. For the quasi-peak measurement, thenoise band is much smaller. Peak and average

    Figure 2 Two peak measurements

    a Linear axisb Logarithmic axis

    / IET Sci. Meas. Technol., 2008, Vol. 2, No. 4, pp. 244257 & The Institution of Engineering and Technology 2008doi: 10.1049/iet-smt:20070063

    246

    www.ietdl.org

  • 8/6/2019 Noise and FSV

    4/14

    measurements are much noisier than quasi-peakmeasurement.

    3.2 FSV and noisy data sets

    As can be seen from Fig. 2, conducted EMI peakmeasurements are very noisy. A simple test canshow that this noise corrupts the FSV results. Thedevice under test is a PWM frequency inverter(three-phase, 400 V, 5.5 kVA) supplying aninduction motor. The measurements are doneconforming to the standards, using an LISN and testreceiver, in the range of 150 kHz to 30 MHz. Sixmeasurements are performed, twice a peak, averageand quasi-peak measurement. Equal measurementsare done directly after each other, without changing

    disturbing factors in the surrounding area. Thismeans that both peak measurements should bealmost identical. The same can be said for theaverage and quasi-peak measurements. The threemeasurements are shown in Figs. 3a, 4a and 5a.

    The black line on each figure shows the differencebetween both measurements.

    Figs. 3b, 4b and 5b show the FSV results. The left partshows the probability density function of ADM, the

    right part FDM. On the figures, also an overall ADMand FDM value is given.

    As an additional test, two types of noise aregenerated. The first type is white noise, uniformlydistributed (UD) noise. The second type is ND whitenoise. Two data sets of UD noise are generated andvalidated by FSV (Fig. 6), the same is done for twotypes of ND noise (Fig. 7).

    Table 2 shows the correlation and results of FSV. Thefirst row provides a comparison of identical data to havean idea of the best possible case. Comparing the results,the following things can be decided. Correlation has nomeaning in this comparison. ADM gives a valuableresult, whereas FDM only gives a valuable result onthe quasi-peak measurement. FDM makes nodifference between PK, AV and both noise types.

    Figure 3 Peak measurements

    a Two peak measurements (dark grey, light grey) and thedifference (black)b Validation of Fig. 3a (by FSV 3.2)

    Figure 4 Average measurements

    a Two average measurements (dark grey, light grey) and thedifference (black)b Validation of Fig. 4a (by FSV 3.2)

    & The Institution of Engineering and Technology 2008 IET Sci. Meas. Technol., 2008, Vol. 2, No. 4, pp. 244257/doi: 10.1049/iet-smt:20070063

    247

    www.ietdl.org

  • 8/6/2019 Noise and FSV

    5/14

    FDM in Figs. 3b, 4b and 6 is very similar. GDM iscalculated by a simple quadratic mean formula

    GDMi ffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffi

    ADM2i FDM2ip

    (3)

    A property of this formula is the emphasis on the largestvalue. Because FDM is corrupted by the noise, GDM isalso overestimated.

    4 Modification of FSV

    4.1 Weighted values

    The peak and average measurements contain a lot ofhigh-frequency components which cannot be seen as afeature but act as noise. The point-by-point GDM iscalculated by (3).

    In comparing conducted emission measurements, agood (small) ADM is combined with a bad (large)FDM. Using (3), the largest value (FDM) isemphasised. In noisy data, the ADM part is almostneglected in the GDM result. Only using ADM whenevaluating and neglecting FDM is not an option, as thefeature cannot be neglected.

    To solve this problem, (3) can be changed.

    GDMi mod 1

    2: 2 ADMi FDMi

    1(2=ADMi) (1=FDMi)

    (4)

    Equation (4) emphasises on ADM, while FDM is notneglected. The results of the classic FSV incomparison to the weighted FSV are given in Table 3.

    This basic idea has been used in FSV 3.2 [8]. Theprinciple of weighing is more generalised and the

    Figure 5 Quasi-peak measurement

    a Two quasi-peak measurements (dark grey, light grey) and thedifference (black)b Validation of Fig. 5a (by FSV 3.2)

    Figure 6 Validation of UD noise (by FSV 3.2)

    Figure 7 Validation of ND noise (by FSV 3.2)

    Table 2 FSV-results of the measurements

    Comparison (Fig.) Corr% ADM FDM GDM

    identical 100 0 0 0

    peak (3a) 97.53 0.104 0.430 0.461

    average (4a) 98.83 0.067 0.398 0.414

    quasi-peak (5a) 99.83 0.031 0.150 0.159

    UD noise2

    0.42 0.401 0.435 0.658

    ND noise 20.0034 0.415 0.454 0.687

    / IET Sci. Meas. Technol., 2008, Vol. 2, No. 4, pp. 244257 & The Institution of Engineering and Technology 2008doi: 10.1049/iet-smt:20070063

    248

    www.ietdl.org

  • 8/6/2019 Noise and FSV

    6/14

    weighting factors are calculated objectively, according tothe grade and the spread of the FSV results.

    4.2 Preprocessing the dataPreprocessing the data is a possible method to eliminatenoise, while keeping the feature. Nevertheless,eliminating noise and keeping the feature is not fullypossible, as this is even by visual inspection a difficultissue. Data sets under consideration are one with onlya trend and noise, but no feature (Fig. 8a) and onewith a trend, noise and an obvious feature (Fig. 9a).

    The validation of the data shown in Fig. 9a by FSVgives better FDM results. This means that if datacontain more pronounced feature, FSV recognises it in

    a better way and quantifies the results. A conclusion isthat eliminating the noise improves the validation

    obviously. A way to do this is by detrending the dataand using a histogram on the noise.

    For detrending the data, a simple moving average

    algorithm (SMA) can be used. Other moving averagealgorithms, such as weighted moving average andexponential moving average, show no obvious benefit.EMC measurements are expressed in dB mV. For acorrect moving average of the measured data, the datashould be expressed linearly first. Nevertheless,applying an SMA to logarithmic instead of linear datais the same as applying a geometric mean instead ofan arithmetic mean, as proven in (5) and (6) for ann-point moving average

    MAdBP

    ni1 Ai dB

    n Pni1 20 log10 (Ai)

    n

    20 log10

    ffiffiffiffiffiffiffiffiffiffiffiYni1

    Ain

    s (5)

    MA 10MAdB=20 ffiffiffiffiffiffiffiffiffiffiffiYn

    i1Ain

    s(6)

    To approximate a featureless trend, a 100-point SMAgives good results for the approximately 6000-pointdata set. Figs. 10 and 11 show the the trend data of

    Figure 8 Data set with no feature and its validationa Data with trendline and noise, no particular featureb Validation of the data set in Fig. 8a (by FSV 3.0)

    Figure 9 Data set with obvious feature and its validation

    a Data with trendline, noise and obvious featureb Validation of the data set in Fig. 9a (by FSV 3.0)

    Table 3 Results of GDM and GDMmod(FSV 3.0)

    Comparison (Fig.) GDM GDM mod

    identical 0 0 (limit)

    peak (3a) 0.461 0.339

    average (4a) 0.414 0.280

    quasipeak (5a) 0.159 0.111

    UD noise 0.658 0.671

    ND noise 0.687 0.696

    & The Institution of Engineering and Technology 2008 IET Sci. Meas. Technol., 2008, Vol. 2, No. 4, pp. 244257/doi: 10.1049/iet-smt:20070063

    249

    www.ietdl.org

  • 8/6/2019 Noise and FSV

    7/14

    both data sets under consideration, Figs. 12 and 13 thedetrended and Figs. 14 and 15 show the histogram ofthis detrended data sets.

    Visual inspection of the first histogram (Fig. 14)learns that the detrended data of the left data set

    resembles the histogram of ND noise. These data canbe seen as a trend line with noise and no particularfeature. To eliminate noise, the left and rightboundaries have to be chosen wherein all data can beeliminated. For the histogram of the second data set(Fig. 15), it is far more difficult to choose boundaries.It is obvious that the upper boundary can be seen.The noise goes approximately up to bin 10 or 12. Thereal peaks give values between 15 and 43. For thelower boundary, we can see two Gaussian curves. It isdifficult to say what boundary to choose, 210 or220. For EMC measurements, the problems arerelated to the upper parts. The boundary of the lowerparts is less important to be chosen right. Thedetrended data between the boundaries is just roughlycut away. This is what people also do by visualinspection. As FSV wants to conform with the visualinspection, this rough method gives good results.

    Figs. 16 and 17 show the results after denoising thefigures.

    It is obvious that choosing a boundary is the weak partof this method. Choosing the boundary is subjective,

    where FSV just wants objectivity. A way to help theinterpretation is by processing the detrended data on alinear (mV) instead of a logarithmic scale (dB mV). By

    this, the histogram is smaller, with some values forbins far from the histogram, indicating real feature.

    Table 4 shows that, after preprocessing, the resultsare more in accordance to the visual perception.

    4.3 Multiple measurements

    The previous method cancels the entire noise band. Thiscan lead to errors, as specific peaks can be hidden in thatnoise band. These peaks are even by visual inspectionnot noticed, so it is also not the task of FSV to do so.Nevertheless, finding real peaks can be a method tocancel the noise as noise creates random peaks. Amethod to see these real features is by performingtime-consuming quasi-peak measurements. As

    mentioned before, the quasi-peak measurement has avery small noise band. However, there is no possibilityto perform peak measurements and conclude what thequasi-peak result would be, because there is a lack ofinformation on the repetitive nature of the signal.However, multiple peak measurements can give anidea of this repeatability and can cancel out part of thenoise. Combining n ND data set of noise decreases thestandard deviation with 1=

    ffiffin

    p. This can be proved as

    follows.

    For a set of unrelated samples X, the estimator is

    defined as E[X]. The mean value and variance can be

    Figure 12 Detrended data (Fig. 8a)

    Figure 13 Detrended data (Fig. 9a)Figure 11 Trend of the data (Fig. 9a)

    Figure 10 Trend of the data (Fig. 8a)

    / IET Sci. Meas. Technol., 2008, Vol. 2, No. 4, pp. 244257 & The Institution of Engineering and Technology 2008doi: 10.1049/iet-smt:20070063

    250

    www.ietdl.org

  • 8/6/2019 Noise and FSV

    8/14

    written as follows

    m E[X] (7)

    Var[X] s2 E[(X m)2] (8)

    The linearity of the estimator can be proved

    E[a X b Y] a E[X] b E[Y] (9)

    Equation (8) can be rewritten as

    Var[X] E[X2] 2 m E[X] m2 (10)

    Using (7)

    Var[X] E[X2] (E[X])2 (11)

    The variance has the following properties [7]

    Var[a X] a2 Var[X] (12)

    Var

    XiXi

    " #Xi

    Var[Xi] (13)

    Consider n independent data sets Xi. It has to be proved

    that

    s

    Pni1 Xin

    s(Xi)ffiffi

    np (14)

    where s(X) is the standard deviation of the data set X.

    From (12), it is clear that

    Var

    Pni1 Xin

    ! 1

    n

    2Var

    Xni1

    Xi

    " #(15)

    Figure 16 Preprocessed data (Fig. 8a)

    Figure 17 Preprocessed data (Fig. 9a)Figure 15 Histogram (Fig. 13)

    Figure 14 Histogram (Fig. 12)

    & The Institution of Engineering and Technology 2008 IET Sci. Meas. Technol., 2008, Vol. 2, No. 4, pp. 244257/doi: 10.1049/iet-smt:20070063

    251

    www.ietdl.org

  • 8/6/2019 Noise and FSV

    9/14

    Using (13) results in

    1n

    2 Var Xni1

    Xi" # 1

    n

    2 Xni1

    Var[Xi]( )

    (16)

    For n data sets, randomly generated under the sameconditions, the variance is

    8Xi, Xj:Var(Xi) Var(Xj) (17)

    For n uncorrelated data sets, this can be rewritten as

    1

    n 2 X

    n

    i1 Var[Xi]

    ( ) 1n 2

    n Var[Xi]

    Var[Xi]n

    (18)

    Combining (18) and (8) gives (14).

    A question that can be asked is how many peakmeasurements need to be combined to decrease thenoise band to the level of the quasi-peak noise band.Consider the quasi-peak measurement of Fig. 5a.After detrending the line, the noiseband has a standard

    deviation of 1.25. One peak measurement (Fig. 3a)has a standard deviation of 2.63. To reach a noiseband with a standard deviation of 1.25, according to(14), approximately five peak measurements have tobe combined. The benefit here is the objective natureof the method.

    There is another way to deal with these figures. Theratio between the standard deviations for peak andquasi-peak for the noise band is 2.63/1.25 2.10 or6.46 dB. This is very close to the 6.7 dB, mentionedbefore (Section 3.1).

    Applying this to real data results in Fig. 18. With thecombination of several peak measurements (five

    measurements on Fig. 18), it is obvious that the morethe combinations, the better the quasi-peakmeasurement reached. The advantage in comparisonto the histogram method is that no decisions onborders have to be made. However, fivemeasurements including the calculation are equallytime-consuming as one quasi-peak measurement. Thismethod is not further investigated.

    5 Combination of FSV and IELF

    5.1 Introduction

    Until now, two different problems have been discussed.Noise corrupts the FSV results and the differencebetween the visual interpretation of linear data on alogarithmic axis and the FSV interpretation. The first

    problem is solved by the histogram method, whereasthe IELF method accounts for the second problem.The conclusion can be made that the best solution is acombination of these two. There are two possibilities:

    preprocessing the data to denoise and evaluate byIELF,

    convert the data measured in linear steps to alogarithmic equivalent, preprocess the data to decreasethe noise and evaluate by FSV.

    The first method seems to be the easiest. The secondtakes much more time, but has the benefit it can finallybe integrated in the FSV method. In this way, the area ofapplication of FSV is increased.

    Figure 18 To p: o ne p ea k m ea su rement ; m id dl e:combination of five peak measurements; bottom: quasi-

    peak measurement

    Table 4 Rough data in comparison to

    preprocessed data with histograms, logarithmic

    noise elimination and FSV

    GDM GDM after preprocessing

    identical 0 0

    peak 0.461 0.241

    average 0.414 0.224

    quasi-peak 0.159 0.183

    UD noise 0.658 0.697

    ND noise 0.687 1.981

    / IET Sci. Meas. Technol., 2008, Vol. 2, No. 4, pp. 244257 & The Institution of Engineering and Technology 2008doi: 10.1049/iet-smt:20070063

    252

    www.ietdl.org

  • 8/6/2019 Noise and FSV

    10/14

    5.2 Changing linear to logarithmic datasets

    Conducted EMC measurements are performed between150 kHz and 30 MHz. Measurement frequenciesincrease by linear steps. When visualising data, a

    logarithmic axis is used. By visual inspection, theemphasis is on the lower frequencies, whereasmathematical methods stress higher frequencies. Tohave the same weight visually and mathematically, theamount of data points also has to be spreadlogarithmically.

    Consider a set ofn datapoints representing a normalEMC measurement. This data set is equally spaced witha distance Dfi for all points i.

    To create the logarithmic data, there are two

    possibilities. The number of data points n can be keptconstant or the maximum distance between two datapoints can be kept constant and equal to the currentdistance Df

    n. The second possibility is chosen, because

    in that case no information is lost. The largest stepDf

    n

    0 is equal to Dfn. All the other steps are calculated

    logarithmically. The new data points are calculated bylinear interpolation. This results visually in twoexactly same data sets, except that the logarithmicdata set contains much more data points (five timesmore in the case of conducted emission).

    For the calculation of each step, the relative increase xcan be calculated by

    fn fn1(1 x) (19)

    The distance between the last points is set to themaximum step

    fn fn1 Dfn (20)

    Combining these two gives

    x fnDfn

    (21)

    The number of steps n can be calculated by writing fn

    asa function of f1

    fn f1(1 x)n1 (22)

    n log( fn=f1)

    log (1 x) 1 (23)These n points have to be calculated, starting with f1,

    where

    fi fi1(1 x) (24)

    Evaluating the discussed typical data sets by FSV

    (Figs. 3a, 4a and 5a), linearly and logarithmicallyspaced, gives the results shown in Table 5. These datasets are not yet denoised in order to see only theeffect of making the data set logarithmic.

    It can be noticed that for the logarithmic data set, theFSV value is higher than for the linear. There are tworeasons for this. The logarithmic data set containsmore data points. As these data are not denoised,there is more noise. The second reason is that themore the data points, the more the differences can beseen by FSV. This is important to notice. The

    conclusion can be made that FSV is valuable for arelative comparison between several data sets, but lessvaluable to give an absolute value to the comparison.Preprocessing data lowers the GDM result as expected(Table 6). For the linear data, a 100-point SMAhas been used or 1.7% of the total length.The logarithmic data contains five times more datapoints. Therefore a 500-point SMA has been tested,giving other results. The relative classification ofbest to worst does not change, but the absolute resultdoes.

    6 Example: ranking ofmeasurement methods for EMI

    6.1 Introduction

    To test the proposed methods, a real application, wherevalidation is needed, is used.

    Testing conducted and radiated emission in largesystems is not always possible in an EMC testlaboratory. Besides the large physical dimensions, largeassemblies or systems need special arrangements forpower supply. In some cases, even only in situ

    Table 5 FSV results of the linear and

    logarithmic data sets

    GDM linear GDM log

    identical 0 0

    peak 0.461 0.607

    average 0.414 0.491

    quasi-peak 0.159 0.240

    UD noise 0.658 0.822

    ND noise 0.687 1.350

    & The Institution of Engineering and Technology 2008 IET Sci. Meas. Technol., 2008, Vol. 2, No. 4, pp. 244257/doi: 10.1049/iet-smt:20070063

    253

    www.ietdl.org

  • 8/6/2019 Noise and FSV

    11/14

    assembling of the systems is possible, leading to the needfor in situ measurements.

    Performing in situ measurements of conductedemission is not always possible by using an LISN. Thisis especially the case when testing large systems,where an LISN with a high current capacity is needed.As there is a demand for alternative test methods,special methods for emission and immunity for largemachines are defined. Testing conducted emission inthe range of 150 kHz to 30 MHz is normally done byan LISN or a VP, as proposed by European Standards[9, 10]. For large machines, an LISN with a highcurrent capacity is needed and a high power isolationtransformer is favoured. In many cases, this type of

    equipment is too expensive, or even not available. Theproposed alternative test methods are the capacitiveVP (CVP), the capacitive foil probe (CFP) and theEFT clamp, normally used to test immunity againstfast transients, and now used as a sensor for emission.These methods were discussed in [1113].

    6.2 Alternative test methods

    6.2.1 LISN as VP or parallel: As a first alternativemethod, the LISN is connected to the mains (Fig. 19).This is still complying with CISPR 16-1 standard. For

    these measurements, inductances of 50 mH are placedin series with the EUT, to filter the mains. In a real insitu measurement, this is not the case. For a correctconnection, notice that the mains input of the LISN isleft unconnected. Fig. 20 shows the resultingmeasurement and the difference between thismeasurement and the reference measurement.

    It is seen that there is nearly no difference betweenboth measuring methods. In fact, the only differencein the setup is the lack of Y-capacitors between wiresand PE connection. Especially at higher frequencies,

    the effects of the (LC) filter of the LISN interactingwith the EUT and the power network are observed,showing differences of about 10 dB. However, this is a

    well-known resonance effect, even observed whenusing another LISN with the same EUT.

    6.2.2 Voltage probe: The 50/1500 V VP used is theone as specified in CISPR16-1 and proposed as analternative measuring setup in EN 55011. Themeasuring results are shown in Fig. 21.

    The measurement with the VP is executed as statedin the standard EN 55011. It is well known that somedifferences are observed in the beginning of the MHzregion.

    6.2.3 Capacitive VP: The main advantage of the CVPin comparison to the other capacitive methods is the

    built-in amplifier, decreasing and flattening theattenuation to 20 dB [12].

    The measurement results are given in Fig. 22.Although the CVP probe is originally intended tomeasure conducted emission of data andcommunication cables, it is clear that the probe may

    Figure 19 LISN as VP

    Figure 20 LISN (black), LISN as VP (grey) and difference

    (bottom)

    Table 6 FSV result after preprocessing with 100 and 500

    point SMA

    Log and preprocess

    100 points

    Log and preprocess

    500 points

    identical 0 0

    peak 0.457 0.337

    average 0.354 0.309

    quasi-peak 0.292 0.249

    UD noise 0.779 0.754

    ND noise 1.304 1.300

    / IET Sci. Meas. Technol., 2008, Vol. 2, No. 4, pp. 244257 & The Institution of Engineering and Technology 2008doi: 10.1049/iet-smt:20070063

    254

    www.ietdl.org

  • 8/6/2019 Noise and FSV

    12/14

  • 8/6/2019 Noise and FSV

    13/14

    to the input of the measuring receiver or a preamplifier.Because of the small capacitance and the 50 V inputimpedance of the measuring equipment, a largeattenuation factor occurs. The use of an appropriateamplifier, as it is integrated in the CVP probe, should

    provide better results. Another point is the unknownimpedance Z2, being the capacitance (lowerfrequencies) or impedance (higher frequencies)between the foil and an (undefined) ground. The foilshave a length of 30 cm and 1 m. The largest foil hassmaller attenuation, but is more difficult to handle. Inthis paper the measurements of the largest foil areused (Fig. 24).

    As a first conclusion about all alternativemeasurement methods, it may be stated that they allbehave very similar, and a more in-depth validation

    criterion is needed to rank their performances.As reference, the visual interpretation of the experts

    has been taken. As can be seen from Table 7, thepreprocessed data recalculated for logarithmic spacedfrequency points give the best results. The best,second and worst (1, 2 and 5 in the ranking) arevalidated in the same way by FSV. The ranking for theother measurements is not the same as the ranking byvisual inspection, but also by visual inspection, it isdifficult to reach a consensus. Nevertheless,preprocessing the data and recalculating these to get itlogarithmically spaced, improve the FSV results, when

    dealing with EMC measurements.

    7 Conclusion

    It is very difficult to reach a consensus among expertswhen validating measurement results. To avoid thesediscussions, tools such as FSV can be useful. In thispaper, several methods are discussed to improve theFSV results, to be more in accordance to the visualinspection of a panel of experts.

    It is very difficult to know when the modifications to

    FSV are needed. Using the results of the group ofexperts as a reference is one method, but as has beendiscussed, most experts agree on the best and worst

    measurements, but the other measurements are verydifficult to rank. The ranking of these othermeasurements have also the largest standard deviation,showing a lack of unanimity. This is a possible reasonwhy exactly the same results as the reference groupare not reached. It is difficult to say if there is now anerror or not. The number of participants was rathersmall. One different vote can change the ranking.

    For the modified FSV, the data are denoised andchanged to a logarithmically spaced data set instead ofa linear one. As has been shown by a real-lifeexample, the results are much better than those withthe classic FSV. It can be concluded that the largestproblems that can corrupt the FSV results arecountered.

    8 References

    [1] Available at: http://grouper.ieee.org/groups/emc/emc/

    ieee_emcs_-_sdcom_mainpage.htm , accessed July 2007

    [2] ARCHAMBEAULT B., PRATAPNENI S., ZHANG L., WITTWER D.C., CHEN J.:

    A proposed set of specific standard EMC problems to help

    engineersevaluate EMC modeling tools. Proc. IEEE Int.

    Symp. EMC, Montreal, Canada, August 2001, vol. 2,

    pp. 1335 1340

    [3] ANTONINI G., CICCOMANCINI SCOGNA A., ORLANDI A., RITOTA C.,

    DUFFY A.: Applications of FSV to EMC and SI data. Proc.

    IEEE Int. Symp. EMC, Chicago, USA, August 2005, vol. 2,

    pp. 278283

    [4] DUFFY A., MARTIN A., ANTONINI G., ORLANDI A., RITOTA C.: The

    feature selective validation method (FSV) method. Proc.

    IEEE Int. Symp. EMC, Chicago, USA, August 2005, vol. 1,

    pp. 272277

    [5] SIMPSON R.J., JONES C.R., MACDIARMID I., DUFFY A., COLEBY D.:

    The integrated error against log frequency (IELF) method

    for CEM validation. Proc. IEEE Int. Symp. EMC, Chicago,

    USA, August 2005, vol. 1, pp. 296300

    [6] KNOCKAERT J., CATRYSSE J., BELMANS R.: Comparison and

    validation of EMC-measurements by FSV and IELF. Int.

    Symp. EMC, Barcelona, Spain, September 2006, pp. 324 329

    [7] STENUMGAARD P.: On digital radio receiver performance

    in electromagnetic disturbance environments. Radio

    Communication Systems Laboratory Department of

    Signals, Sensors and Systems, 2000

    [8] ORLANDI A., ANTONINI G., RITOTA C., DUFFY A.P.: Enhancing

    feature selective validation (FSV) interpretation of EMC/SIresults with grade-spread. Proc. IEEE Int. Symp. EMC,

    Portland, USA, August 2006, vol. 2, pp. 362 367

    Table 7 Results

    Visual Classic

    GDM

    Preprocessed

    linear GDM

    Preprocessed

    log GDM

    LISNVP 2 3 4 2 (0.453)

    VP 4 5 5 3 (0.465)

    CVP 1 4 1 1 (0.423)

    EFT 5 2 3 5 (0.575)

    CFP 3 1 2 4 (0.511)

    / IET Sci. Meas. Technol., 2008, Vol. 2, No. 4, pp. 244257 & The Institution of Engineering and Technology 2008doi: 10.1049/iet-smt:20070063

    256

    www.ietdl.org

  • 8/6/2019 Noise and FSV

    14/14

    [9] EN55016-1-1: Specification for radio disturbance and

    immunity measuring apparatus and methods. Radio

    disturbance and immunity measuring apparatus, 2004

    [10] EN50370-1 Electromagnetic compatibility (EMC)

    Product family standard for machine tools part 1:

    emission, 2005

    [11] KNOCKAERT J., CATRYSSE J., BELMANS R.: Comparison of

    alternative conducted emission measurement methods by

    using FSV and IELF algorithms. Int. Symp. EMC,

    Barcelona, Spain, September 2006, pp. 718722

    [12] HARLACHER B., STEWART R.: CISPR 22 conducted common

    mode voltage measurements along a wire using a

    capacitive voltage probe. Proc. IEEE Int. Symp. EMC,

    Minneapolis, USA, August 2002, vol. 1, pp. 15

    [13] CATRYSSE J.: Workshop TEMCA2, Int. Symp. EMC,

    Barcelona, Spain, September 2006

    & The Institution of Engineering and Technology 2008 IET Sci. Meas. Technol., 2008, Vol. 2, No. 4, pp. 244257/doi: 10 1049/iet-smt:20070063

    257

    www.ietdl.org