Emerson E2 operation manual Medium Resolution

Appendix E: Compressed Point Log Sample Limits and Precision Table

	Medium Resolution
Engineering Unit	Low Clip	High Clip	Precision
Temperature
Degrees Centigrade*	-200	1,500	0.0259427
Degrees Fahrenheit	-328	2,732	0.0466969
Differential Temperature
Delta Degrees Centigrade*	-200	200	0.00610417
Delta Degrees Fahrenheit	-360	360	0.0109875
Temperature Change Rate
Degrees Centigrade Per Minute*	-50	50	0.00152604
Degrees Fahrenheit Per Minute	-90	90	0.00274688
Degrees Centigrade Per Hour	-3,000	3,000	0.0915625
Degrees Fahrenheit Per Hour	-5,400	5,400	0.164813
Pressure
Pascals*	-100,000	20,000,000	306.734
Kilopascals	-100	20,000	0.306734
Pounds Per Square Inch	-14.50	2,901	0.0444881
Bars	-1	200	0.00306734
Pascals (low readings)*	-1,250	5,000	0.0953776
Inches of Water	-5.02	20.0732	0.000382906
Centimeters of Water	-12.75	50.9870	0.000972604
Differential Pressure
Delta Pascals	-2,000,000	2,000,000	61.0417
Delta Kilopascals	-2,000	2,000	0.0610417
Delta Pounds Per Square Inch	-290.08	290.076	0.00885336
Delta Bars	-20	20	0.000610417
Delta Pascals (low readings)*	-3,000	3,000	0.0915625
Delta Inches of Water	-12.04	12.0439	0.000367590
Delta Centimeters of Water	-30.59	30.5922	0.000933700
Humidity
Relative Humidity*	0	100	0.00152604
Light Level
Lux*	0	25,000	0.381510
Foot-Candles	0	2,323.5	0.0354576
Electrical Voltage
Volts*	-3,276.8	3,276.1	0.1
Electrical Current
Amps*	0	6,552.90	0.1
Milliamps	0	6,552,900	100
Electrical Resistance
Ohms*	0	655,290	10
Power
Watts*	0	6,552,900	100

	Low Resolution
Low Clip	High Clip	Precision
-40	97.7778	0.555556
-40	208	1
-68.889	68.889	0.555556
-124	124	1
-6.889	6.889	0.055556
-12	12	0.1
-413.333	413.333	3.3333
-744	744	6
-100,000	4,200,000	17339
-100	4,200	17.3387
-14.5038	609.160	2.51477
-1	42	0.173387
-1,250	3,500	19.1532
-5.018	14.0512	0.0768931
-12.7468	35.6909	0.195313
-500,000	500,000	4032.26
-500	500	4.03226
-72.5190	72.5190	0.584831
-5	5	0.0403226
-1,000	1,000	8.06452
-4.01463	4.01463	0.03237606
-10.1974	10.1974	0.08223710
0	100	0.403226
0	10,000	40.3226
0	929.400	3.74758
0	496	2
0	4,960	20
0	4,960,000	20000
0	496,000	2000
0	496,000	2000

Appendix E: Compressed Point Log Sample Limits and Precision Table • E-1