Title: Brochure
1European Network for Business and Industrial
Statistics (ENBIS)
Second Annual Conference on Business and
Industrial Statistics Rimini, Italy, September,
2002
Statistical Efficiency the practical
perspective Ron S. Kenett
and Shirley Coleman
KPA Ltd. ISRU, Newcastle
University ron_at_kpa.co.il
Shirley.Coleman_at_ncl.ac.uk
This paper was supported by funding from the
Growth programme of the European Community and
was prepared in collaboration by member
organisations of the Thematic Network -
Pro-ENBIS- EC contract number G6RT-CT-2001-05059.
2Practical Statistical Efficiency
Background
- Churchill Eisenhart beer and statistics
- Bruce Hoadley vadors
- Blan Godfrey Youden address
- We expand on these ideas adding an additional
component the value of the data actually
collected - We demonstrate the concept of Practical
Statistical Efficiency (PSE) using four case
studies.
3Practical Statistical Efficiency
PSE ER x T I x P I x V PS x P S x V
P x V M x V D
- VD value of the data actually collected
- VM value of the statistical method employed
- VP value of the problem to be solved
- PS probability that the problem actually
gets solved - VPS value of the problem being solved
- PI probability the solution is actually
implemented - TI time the solution stays implemented
- ER expected number of replications
4VD value of the data actually collected
PSE ER x T I x P I x V PS x P S x V
P x V M x V D
Readily accessible data, is like observations
below the lamppost where there is light - not
necessarily where you lost your key or where the
answer to your problem lies
5VM value of the statistical method employed
PSE ER x T I x P I x V PS x P S x V
P x V M x V D
A mathematical definition of statistical
efficiency is given by Relative Efficiency of
Test A versus Test B Ratio of sample size for
test A to sample size for test B, where sample
sizes are determined so that both tests reach a
certain power against the same alternative.
6VP value of the problem to be solved
PSE ER x T I x P I x V PS x P S x V
P x V M x V D
Statisticians too often forget this part of the
equation. We frequently choose problems to be
solved on the basis of their statistical interest
rather than the value of solving them.
7PS probability that the problem actually gets
solved
PSE ER x T I x P I x V PS x P S x V
P x V M x V D
Usually no one method or attempt actually solves
the entire problem, only part of it. So this part
of the equation could be expressed as a fraction
8VPS value of the problem being solved
PSE ER x T I x P I x V PS x P S x V
P x V M x V D
This is both a statistical question and a
management question. Did the method work and lead
to a solution that worked and were the data,
information and resources available to solve the
problem?
9PI probability the solution is actually
implemented
PSE ER x T I x P I x V PS x P S x V
P x V M x V D
Here is the non-statistical part of the equation
that is often the most difficult to evaluate.
Implementing the solution may be far harder than
just coming up with the solution.
10Management Approach
Statistical Method
Designed Experiments and Reliability
Quality by Design
Process Control Process Improvement
Control Charts
Sampling Plans
Inspection
Basic Statistical Thinking
Fire Fighting
11TI time the solution stays implemented
PSE ER x T I x P I x V PS x P S x V
P x V M x V D
Problems have the tendency not to stay solved.
This is why we need to put much emphasis on
holding the gains in any process improvement.
12ER expected number of replications
PSE ER x T I x P I x V PS x P S x V
P x V M x V D
This is the part most often missed in companies.
If the basic idea of the solution could be
replicated in other areas of the company, the
savings could be enormous.
13Practical Statistical Efficiency
PSE ER x T I x P I x V PS x P S x V
P x V M x V D
Four Case Studies
14Four Case Studies
1. Tea packing
- Good commitment to project
- Specific problem to solve
- efficiency equalised between two lines initially
at 54 and 68 - efficiency increased to 80
15Four Case Studies
2. Soft drinks Manufacture
- Introduction of KPIs
- efficiency charts not subtle enough to reflect
the complex business - which is seasonal and highly dependent on product
changes and product mix - casual commitment to project
16Four Case Studies
3. Heavy metal company
- Commitment to cost saving quick fixes
- improvements and process changes not maintained
- run chart shows how effluent increased when water
usage was halved - scatterplot shows relationship between water
usage and mean and variance of effluent - transient commitment to project
17Four Case Studies
3. Heavy metal company
18Four Case Studies
4. Major Utility
- Good commitment to project
- Chart highlights increases in component defects
- Ideas adopted
- Applied widely throughout the business
19Comparison of Case Studies
2
3
4
1
20Comparison of Case Studies
- Longevity and probability components E(R) and
T(I) are generally high - V(PS) generally high otherwise the projects would
not be started - Differences mainly in V(D) and V(M) which reflect
commitment to the project - P(I) and P(S) not quite so important
- V(P) is the six sigma part, unless the value of
the problem is high, the company may lose
interest, however good the rest is!
21Practical Statistical Efficiency
PSE ER x T I x P I x V PS x P S x V
P x V M x V D
- The components should be evaluated before and
after the project - provides an efficient approach to compare
projects - encourages a broad view of the statisticians
work - delegates may like to experiment with PSE for
their next projects - we welcome your feedback and comments
22References
- Chambers, P.R.G, J.L. Piggott and S.Y. Coleman
(2001), SPC a team effort for process
improvement across four area control centers, J.
Appl Stats, 28(3), 307-324. - Coleman, S.Y and D.J. Stewardson (2002) Use of
measurement and charts to inform management
decisions, Managerial Auditing Journal, 17(1),
16-19. - Coleman, S.Y., G. Arunakumar, F. Foldvary and R.
Feltham (2001a), SPC as a tool for creating a
successful business measurement framework, J.
Appl. Stats, 28(3), 325-34. - Coleman, S.Y., A. Gordon and P.R. Chambers
(2001b), SPC making it work for the gas
transportation industry, J. Appl. Stats, 28(3),
343-51. - Hoadley, B. (1986), A Zero Defect Paradigm,
ASQC Quality Congress Transaction, Anaheim. - Godfrey, A. Blanton (1988), "Statistics, Quality
and the Bottom Line," Part 1, ASQC Statistics
Division Newsletter, Vol. 9, No. 2, Winter,
211-13. - Godfrey, A. Blanton (1989), "Statistics, Quality
and the Bottom Line," Part 2, ASQC Statistics
Division Newsletter, Vol. 10, No. 1, Spring,
14-17. - Kenett, R. S. and Zacks, S. (1998), Modern
Industrial Statistics Design and Control of
Quality and Reliability, Duxbury Press. - Kenett, R. S. and Albert, D. (2001), The
International Quality Manager Translating
quality concepts into different cultures requires
knowing what to do, why it should be done and how
to do it, Quality Progress, 34, 7, 45-48.