Table Of ContentCircuits andSystems
Tutorials
IEEEPress
445Hoes Lane, P.O. Box1331
Piscataway, NJ08855-1331
Editorial Board
JohnB.Anderson, EditorinChief
R.S.Blicq S.V. Kartalopoulos R. S.Muller
M.Eden P. Laplante I.Peden
R. Herrick A.J.Laub E. Sanchez-Sinencio
G.F.Hoffnagle I. M.F. Moura D.I. Wells
R.F.Hoyt
Dudley R. Kay, DirectorofBookPublishing
Carrie Briggs, AdministrativeAssistant
Lisa S. Mizrahi, ReviewandPublicityCoordinator
Denise Phillip, BookProductionAssistant
Circuits and Systems
Thtorials
Editor
Chris Toumazou
Imperialｃ ｯ ｬ ｬ ｾ ｧ (cid:103)
London, U.K.
Assistant Editors
Nick Battersby
NortMmｔ ･ ｾ ｣ ｯ (cid:111)
Ontario. CII1JtJiJD
Sonia Porta
OxfordBrookes ｕ ｮ ｩ ｶ ｾ ｮ ｩ ｴ (cid:116)
u.
Oxford, K.
+
IEEE
ｾ PRESS
TheInstituteofElectricalandElectronicsEngineers.Inc.•NewYork
Thisbookmaybepurchasedatadiscountfromthepublisherwhen
orderedinbulkquantities.Formoreinformationcontact:
IEEEPressMarketing
Attn:SpecialSales
445HoesLane,P.O.Box1331
Piscataway,NJ088.5.5-1331
Fax:(908)981-9334
C01996bytheInstituteofElecbicaiandElectronicsEngineers,Inc.
34.5East47thStreet,NewYork,NY10017-2394
OriginallyproducedbyLTPElectronicsLtd.,
OxfordUKonbehalfofIEEEISCAS '94.
Allrightsreserved.Nopart01thisbookmayberrprotlucedinanyform,
normayitbestoredinantrinalsystemortransminedinanyform,
withoutwrinenpermissionfromthepublisher.
ISBN0-7803-1170-1
IEEEOrderNumber: PPS596
Library 01Conaras Cataloalal-ID-PabllcatlonData
Circuitsandsystems tutorialsIeditor,ChrisToumazou :assistant
editors,NickBattersby&:SoniaPorta.
p. em.
"IEEEordernumberPPSS96"-T.p. verso.
Basedontutorialspresented atthe 1994IEEEInternational
SymposiumonCircuitsandSystemsheldinLondon.
Includesbibliographicalreferences andindex.
ISBN0-7803-1170-1(pbt.)
1.Signalprocessing-Congresses. 2. Electroniccircuits
Congresses. 3. Telecommunicationsystem--Congresses. 4. Electric
filters-Congresses. I.Toumazou, C. (Chris) B.Battersby, N.C.
(Nicholase.) ID. Porta,Sonia.
TKSI02.9.C49 1996
Ｖ Ｒ Ｑ Ｎ Ｓ Ｘ Ｒ ｾ ｣ Ｒ (cid:50) 95-42332
CIP
To the late NickBattersby
"Throughyourenthusiastic. IUltUsumingandpositivenatur«,YO"instilledinallofusan
inspirationforexcellencetindfortheloveofUfe...
JJ
Yourfriendsin<>tawa,
Jean-Marc,Vivek,Samina,CindyandDoug
"AYOWlg engineerwithadedicaled, briUianlandinquisitivemind. Agreatlossto
Euctronics...
JJ
ChrisToumazouonbehalfofImperialCollege
Contents
ListofCODtrlbuton •••••••••••••••••••••••••••••••••••••••••••••••••• xxv
Foreword••••••••••••••••••••••••••••••••••••••••••••••••••••••••••• nix
Pl'el'aee••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••• DXi
AekDowledlJlleDti ••••••••••••••••••••••••••••••••••••••••••••••••••• DXiI
IDtJ-oduetion ••••••••••••••••••••••••••••••••••••••••••••••••••••••• DXiU
Tutorial 1
1.0 Introduction to Nonlinear Slenal Proc_ne 1
C. F. N. Cowan, E. J. Co,le, M. GabbouJ, V. J. Mathews,
I. Pitas and G. Sicurann
1.0.1 Introduction 1
1.0.2 Overview.•••..••.....•.•................................................... 1
1.0.3 Orderstatisticsbaedsignalprocessing............•...................3
1.0.4Polynomialsignalprocessingtechniques 3
1.11 Welpted Median Fllterlnl • Striking Analogies to FIR Filters S
M. Gabbouj
Abstract 5
1.11.1 Introduction 5
1.11.2 Medianandweightedmedianfilters 6
1.11.2.1 Median filtering•..............................................6
(i) Deterministicpropertiesofmedianfilters:rootsignals. 6
(ti) Statistical propertiesofmedianfilters 7
1.11.2.2 Weiptedmedianfilters 8
(i) AnalogybetweenWMfiltersandlinearFIRftlters 9
1.11.3Propertiesofweightedmedianfilters 10
1.11.3.1 Rootpropertiesof weightedmedianruters....... 10
1.11.3.2 Statisticalpropertiesofweightedmedianfilters 10
1.11.4 Optimalweightedmedianfdtering..................................... 12
1.11.4.1 ProblemConnulation 12
1.11.4.2 OptimalWMfilteringwithstructuralconstraints......... 13
1.11.5 Applications of weighted median filters 14
1.11.'.1 Speech signal processing.. 14
1.11.S.2 Optimalweightedmedian imagefiltering 16
1.11.6 Summary 17
AcblowleclgelDeilts.............. ........................................... 17
References 17
1.12 Stack Fllten In Sllna. and Imale Processing 22
E. J. Coyle
1.12.1 Twoapproachestosignalandimageprocessing 22
1.12.2 Problemsandperformancemeasuresinimageprocessing 23
1.12.3 Theregularizationapproachandstackfdters.••••.....•.••...........24
1.12.4 The ftlter-class approachand stack filten 2S
1.12.S Notationandprecisestatementofstackfdterproperties 27
viii
1.12.6 Minimum meanabsolute errorstackfiltering 28
1.12.7 Computationalrequirementsofstackfilters 29
1.12.8 Anapplicationofstackftlters:noisereduction 30
1.12.9 Anapplicationofstackfilters:edgedetection...............•.•......30
1.12.10 Edgedetectionandstackfilters.......................•...............33
1.12.11 Thenonlinearprefilteringapproachtoedgedetection.•......•..•.34
1.12.12 Thedifferenceofestimatesapproachtoedgedetection 34
1.12.13 Comparisonswithotherapproaches 35
1.12.14 Conclusionsandfurtherwork 35
References 36
1.13 Multichannel Order Statistical Filtering 40
I. Pitas
1.13.1 Introduction 40
1.13.2 Multivariate data ordering 40
1.13.3 Multichannelfdtersbasedonvectorordering 42
1.13.4 Nonlinearfiltersofdirectionaldata......................•..•..........45
1.13.S Discussion...................•............................................47
References•....•.••••••.•••••••••••••••••••••.•••••.•••••••••••••••••••••••••••••••48
1.21 Theory and Approximation of Polynomial Filters 50
G. L. Sicuranza
Abstract SO
1.21.1 Thecontinuous-timecase SO
1.21.2 Thediscrete-timecase 51
1.21.3 Propertiesofvolterrafilters 52
1.21.3.1 Structural properties of the kernels 52
1.21.3.2 Structuralpropertiesoftheinput-outputrelationship 53
1.21.3.3 Volterraseriesexpansionformultidimensional
systems.............•.............................................S4
1.21.4 Realizationsandapproximationsofpolynomialfilters 5S
1.21.5 Applicationsofpolynomialfilters S6
References 57
1.11 Adaptive Polynomial Filters 59
V.J. Mathews
1.22.1 Introduction...............................•..............................S9
1.22.2 Adaptivevolterrafilters S9
1.22.2.1 Least-mean-square(LMS)quadraticfilters 59
1.22.2.2 Variablestepsizealgorithms.........•.......•.............60
1.22.2.3 Recursiveleast-squares(RLS)quadraticfilters 61
1.22.2.4 Anoverviewofotherapproaches 62
1.22.3 Recursivenonlinearsystems•..•........•..............................62
1.22.3.1 Stability of recursive systems 63
1.22.3.2 Adaptivebilinearfilters 63
References 64
1.23 Application of Adaptive Volterra Fllten to Equalization 6'
C. F. N. Cowan
1.23.1 Introduction 66
ix
1.23.2 Adaptive equalization 66
1.23.3 EqualizationasclassifICation 67
1.23.4 AdaptiveVolterraequalization 69
Referel1<:eS 70
Tutorial 2
2 Deslln and Applications 01AID Multlnte SllDai Processing 71
J. E. Franca and S. K. Mitra
2.1 AreviewofmultirateCOll<:epts•••••••••••••••••••••••••••••••••••••••••••••71
2.1.1 Basiccomj)<)nents.•.•.....••.................•...................71
2.1.2 Polypbueimplementation 73
2.1.3Quadrature-mirrorfilter(QMF) bank 73
2.2 Basicaspectsofanalogmultiratetechniques 74
2.2.1 Introduction 74
2.2.2 Direct-fonnpolyphaseFIRSCdecimatonand
intel'p<)lators•••••.•••.••••••••..•..........•......................7S
(i) Direct-formSCdecimators 7S
(ii) Direct-form SC interpolators 78
2.2.3 Active-dclayedblockpolyphaseFIRSCdecimators 79
2.2.4 IIRSCdecimationandintel'p<)lationbuildingblocks 82
(i) IIRSCdecimators 82
(ii) DRSCinterpolators 86
2.3 Multiratesystemsforhigh-selectivityfiltering 88
2.3.1 Introduction 88
2.3.2 FrequencyttanslationinSCftlters 88
(i) Single-lJathfilters 88
(ii) N-path filten 89
2.3.3 ReviewofSCbandpassfiltersystems•••••••••••.••...•......90
(i) General system architecture 90
(ii) SP systems 9()
(iii) NPsystemsusinglowpasspathfl1ters 91
(iv) NPsystemsusinghighpasspathfilters 92
2.3.4 NPsystemsusingbandpasspathfilters 93
2.3.5 A20kHzｏ Ｎ Ｔ Ｘ (cid:56) bandpassfiltersystem .•...................94
(i) ａ ｲ ｣ ｨ ｩ ｴ ･ ＼ Ｚ (cid:58) ••.•••••••••••••••••.•••...••••••••••.••..••••....94
(ii) Experimentalcharacterization 9S
2.4 Multiratefilteringforhigh-frequencyfront-ends 96
2.4.1 Digitizationofstandardvideo(CCIR6(1) 96
(i) Predominandydigitalvideointerfacesystem 96
(ii) Predominantlyanalogvideointerfacesystem 97
2.4.2 Magnetic-diskreadchannels 98
2.5 Multirate techniquesfor data conversion 99
2.5.1 Generalizeddataconversionarchitecture 99
2.5.2 Oversamplingsigma-delta converters 100
2.5.3QMF-basedAIDconveners 101
2.6 Conclusions 103
References 103
x
Tutorial 3
3.11 MPEG·2. The Main ProOle 107
J. Morris
3.11.1 MPEG-2 -Whatisit? 107
3.11.2 Schedule and method of working 108
3.11.3 Requirements 1()9
3.11.4 Whatisstandardized 1<>9
3.11.5 Compressionmethods 1<>9
3.11.5.1 Colour sampling 110
3.11.5.2 Interlace 110
3.11.5.3 Overviewofthealgorithm............................... III
3.11.5.4 Motioncompensation.............. ....................... 112
(i) Prediction modes 113
(ii) Motionestimation.......................................... 114
(iii) Motionrepresentation..................................... 115
3.11.5.5 Spatial coding 115
(i) ｾ liS
(ii) Quantization liS
(iii) Runlength codingandVLC coding............. 116
(iv)Constantandvariablebit-ratecodingandbuffering 117
3.11.6 Encoding 118
3.11.7 Decoding 119
3.11.8 Conclusion 120
References "................................... 120
3.12 Standardization of Scalable Coding Schemes 121
N. D. Wells and P. N. Tudor
Abstract 121
3.12.1 Introduction...... ......... ...................................... 121
3.12.2 Non-Scalablealgorithm.............................................. 121
3.12.3 Scalableschemes 122
3.12.3.1 Frequencyscalable 122
3.12.3.2 Spatialscalable............................................... 126
3.12.3.3 SNRscalable................................................. 127
3.12.4 Chrominance scalability 128
3.12.5 Standardsconversion '128
3.12.6 Discussion 129
3.12.7 Performance 130
3.12.8 Conclusions 130
Acknowledgments ........ 130
References.......................... ............................................ 130
3.13 MPEG·2 Coding Schemes tor Low Delay Requirements 13I
G. BJ.ntegaard
3.13.1 Introduction.............................................................. 131
3.13.2 Applicationsrequiringlowdelay )31
3.13.3 Twoprincipaltypesofdelay 131
3.13.3.1 Codertodecoderdelay 131
3.13.3.2 Delayfromenteringabitstreamtogettinga
xi
fullqualitysignal 132
3.13.4 IdentificationofdifferentsourcesofdelayinMPEG-2coding 133
3.13.4.1 TotaldelayfordifferentversionsofMPEO-2coding 133
3.13.4.2 Modesthatfulf1l1thelowdelayrequirementofISOms. 134
3.13.4.3Channelboppingdelay 134
(i) Performancelosswithfrequentintraupdate 134
3.13.5 Special tools for use in low delay 135
3.13.5.1 Intrasliceupdate..................... ..................... 135
3.13.5.2 Dual'prediction 136
3.13.6Codingperfonnanceatlowdelaycoding 136
3.13.7 Conclusions 137
3.14 MPEG·2 Systems and the Transport over ATM 138
M. T. Sun
Abstract 138
3.14.1 Introduction 138
3.14.2 MPEG-2systems 139
3.14.2.1 ATM 141
3.14.3 Technical issues 143
3.14.3.1 Timingrecovery.............................................. 143
3.14.3.2 Bit-errorandcell-lossdetection/correction 143
3.14.3.3 MPEG-2streamstoATMcellsmapping 144
3.14.4 Summary 145
Acknowledgment 145
References 145
3.21 VLSI Architectures lor Multimedia and Video Conferendng 147
B. Ackland
3.21.1 Introduction.............................................................. 147
3.21.2 Videocompression 148
3.21.2.1 Chrominancesub-sampling 149
3.21.2.2 Transfonncoding 149
3.21.2.3 Framedifferencing 149
3.21.2.4 Motioncompensation 149
3.21.2.5 Interpolation 150
3.21.2.6 Entropycoding ISO
3.21.3 VLSIarchitectures 152
3.21.3.1 Videosignalprocessors..................................... 153
3.21.3.2 Buildingblock 154
3.21.3.3 Monolithiccodec.....•..•....................•...............154
3.21.4AVP4000multimediacodec 154
3.21.4.1 Videoencoder 15.5
3.21.4.2 System controller 158
3.21.4.3 Videodecoder 16<>
3.21.5 Design challenges 160
3.21.5.1 Algorithmicmodelling 162
3.21.5.2CADtoolsandprocessors 162
3.21.5.3 Powerandpackaging 162
3.21.5.4 Softwaredevelopment. 162
3.21.6 Summary 162
