6
Measurement accuracy and ranges *
Conditions :
temperature range 23 °C ±5 °C (73 °F ±9 °F), 80% rh or less (no condensation)
After a 60-minute warm-up period, and open-circuit and short-circuit corrections are made.
Using the 9262 TEST FIXTURE, and measurement signal levels 1 V to 5 V (3522-50), 0.501 V to 1.000 V (3532-50); measurement speed SLOW2.
* Measurement ranges and accuracy depend on the test fixture used, the measurement signal levels, and the measurement speed.
DC
A=1
B=1
1m to 99.99Hz
B=5
B=3
B=0.5
B=0.2
B=0.03
B=0.02
B=0.01
B=0.002
B=0.002
B=0.001
B=0.001
100.0 to 999.9Hz 1.000 to 10.00kHz 10.01 to 100.0kHz
A=4.5
A=3
A=0.7
A=0.7
A=0.25
A=0.15
A=0.2
A=0.12
A=0.15
A=0.1
A=0.12
B=1
B=1.5
B=0.4
B=0.2
B=0.03
B=0.02
B=0.002
B=0.002
B=0.002
B=0.001
B=0.001
A=4.5
A=2.5
A=0.7
A=0.5
A=0.2
A=0.1
A=0.15
A=0.08
A=0.1
A=0.05
A=0.08
B=1
B=1.5
B=0.4
B=0.2
B=0.03
B=0.02
B=0.002
B=0.002
B=0.002
B=0.001
B=0.001
3522-50 Accuracy
Range
Impedance
100MΩ
10MΩ
1MΩ
100kΩ
10kΩ
1kΩ
100Ω
10Ω
1Ω
100mΩ
200MΩ
10MΩ
10MΩ
1MΩ
1MΩ
100kΩ
100kΩ
10kΩ
10kΩ
1kΩ
1kΩ
100Ω
100Ω
10Ω
10Ω
1Ω
1Ω
100mΩ
100mΩ
10mΩ
A=7
A=4
A=2
A=0.5 B=0.3
A=1
A=0.7
A=0.2 B=0.05
A=0.35
A=0.4
A=0.28
A=0.38
A=0.1 B=0.01
A=0.25
A=0.36
Upper figure A .. basic accuracy for |Z|
(± % rdg.)
B is coefficient for sample impedance
Lower figure A .. basic accuracy for
θ
(± deg.)
B is coefficient for sample impedance
When DC resistance measurement,
A is accuracy for R
(± % rdg.)
B is coefficient for sample resistance
The expression for calculating accuracy is
different in the ranges above 1 kΩ and below
100
Ω.
For details refer to the following expressions.
Range 1 kΩ and above...
Accuracy = A + B
×
| 10
×
Zx - range |
Range
Range 100
Ω
and below...
Accuracy = A +
B
×
| range - Zx |
×
10
Range
A=1.5
A=2
A=0.7
A=0.5
A=0.35
A=0.1
A=0.2
A=0.08
A=0.15
B=0.5
B=0.3
B=0.03
B=0.1
B=0.01
B=0.02
B=0.002
B=0.002
B=0.001
A=0.25 B=0.001 A=0.1 B=0.001 A=0.05 B=0.001 A=0.08 B=0.002
A=0.36 B=0.01 A=0.15 B=0.01 A=0.15 B=0.01 A=0.15 B=0.02
A=0.1 B=0.02
A=0.25 B=0.005 A=0.1 B=0.005 A=0.05 B=0.005 A=0.08 B=0.01
A=0.2 B=0.05
A=0.3 B=0.3
A=1
B=0.5
A=0.5 B=0.04 A=0.25 B=0.02 A=0.25 B=0.01 A=0.35 B=0.02
A=0.35 B=0.02 A=0.2 B=0.01 A=0.15 B=0.01 A=0.2 B=0.02
A=1
A=7
A=5
B=0.6
B=4
B=2
A=0.5 B=0.3
A=0.35 B=0.2
A=3.5 B=1.5
A=2.5 B=1
A=0.35 B=0.2
A=0.3 B=0.1
A=2.5 B=1.5
A=1.5 B=1
A=0.7 B=0.3
A=0.45 B=0.1
A=3.5 B=1.5
A=2
B=1
A=0.6 B=0.4
Zx is the measured impedance
of the sample (|Z|).
3532-50 Accuracy
Range
Impedance
42 to 99.99 Hz
A=4
A=2.5
A=0.8
A=1
A=0.4
A=0.3
A=0.35
A=0.25
B=4
B=2
B=0.4
B=0.2
B=0.05
B=0.1
B=0.01
B=0.01
100.0 Hz to 1.000 kHz 1.001 to 10.00 kHz
A=2
A=1
A=0.4
A=0.25
A=0.15
A=0.15
A=0.08 B=0.01
A=0.05 B=0.01
A=0.08
A=0.05
A=0.08
A=0.05
A=0.2
A=0.1
B=2
B=1.5
B=0.2
B=0.1
B=0.05
B=0.02
A=0.15 B=0.01
A=0.08 B=0.01
B=0.01
B=0.005
B=0.02
B=0.01
B=0.03
B=0.02
A=0.4
A=0.25
A=3
A=2
B=0.3
B=0.2
B=2
B=1
10.01 to 100.0 kHz
100.1 k to 1.000 MHz
1.001 to 5 MHz
100 MΩ
10 MΩ
1 MΩ
100 kΩ
10 kΩ
1 kΩ
100
Ω
10
Ω
1Ω
100 mΩ
200 MΩ
10 MΩ
10 MΩ
1 MΩ
1 MΩ
100 kΩ
100 kΩ
10 kΩ
10 kΩ
1 kΩ
1 kΩ
100
Ω
100
Ω
10
Ω
10
Ω
1
Ω
1
Ω
100 mΩ
100 mΩ
10 mΩ
A=1
A=1
A=0.3
A=0.3
B=0.5
B=0.5
B=0.08
B=0.08
A=3
A=3
A=0.4
A=0.3
B=1
B=0.5
B=0.3
B=0.3
*
A=2
A=0.25 B=0.04
A=0.15 B=0.02
A=0.2 B=0.02
A=0.08 B=0.02
A=0.2 B=0.02
A=0.08 B=0.02
A=0.2 B=0.03
A=0.15 B=0.02
A=2
B=0.5
B=0.3
A=0.35 B=0.01
A=0.25 B=0.005
A=0.35
A=0.25
A=0.4
A=0.3
A=0.7
A=1
A=4
A=2.5
B=0.02
B=0.01
B=0.04
B=0.1
B=0.4
B=0.2
B=4
B=2
A=0.3 B=0.03
A=0.15 B=0.02
A=0.3 B=0.03
A=0.15 B=0.02
A=0.4 B=0.1
A=0.3
A=1
A=0.7
B=0.05
B=1
B=0.5
*
A=1.5 B=0.2
A=1
B=0.2
*
A=1.5 B=0.2
A=1
*
A=2
A=2
B=0.2
B=1
B=0.5
*
1.001 MHz and above
accuracy
×
(f
[MHz]
+3)
4
■
Method of determining accuracy
• The measurement accuracy can be calculated from the impedance of the
sample, the measurement range, the measurement frequency, and the basic
accuracy A and coefficient B from the above tables.
• The expression for calculating accuracy is different in the ranges above 1 kΩ
and below 100
Ω.
• For C and L, find the basic accuracy A and coefficient B either by direct
measurement of the impedance or by approximate calculation as follows.
●Example
calculation
(The value A and B for the 3522-50)
Sample
impedance Zx:
500 Ω (measured)
Measurement conditions:
frequency 10 kHz, signal level 2 V, range 1 kΩ
From table above, basic Z accuracy A = 0.08, coefficient B = 0.001.
Inserting these in the calculation expression yields:
Z accuracy = 0.08 +
0.001×
|
10
×
5
×
10
2
−10
3
|
10
3
=0.084 (±%rdg.)
|
Zx (
Ω
)
|
≅
ωL
(H) (
θ ≅
90
˚)
Similarly for
θ
basic accuracy A = 0.05, coefficient B = 0.001, and thus:
2
3
θ
accuracy = 0.05 + 0.001×
|
10
×
5
×
10
−10
|
10
3
≅
1
ωC
(F)
(
θ ≅
- 90˚)
≅
0˚)
=0.054 (±%rdg.)
≅
R (
Ω
) (
θ
ASM-SENSOR [ ASM GMBH ]
