Signals And Systems (18-396), Image And Video Processing .

3y ago
11 Views
3 Downloads
2.05 MB
40 Pages
Last View : 1m ago
Last Download : 2m ago
Upload by : Maleah Dent
Transcription

Signals and Systems (18-396),Image and Video Processing (18-798),and Life Beyond Prof. Tsuhan Chentsuhan@cmu.edu

Sample Courses in Signal Processing and CommunicationSignals and SystemsApplied Stochastic Proc.Digital Signal Processing IFund. Comm. Sys.Dig. Comm. and Sig. Proc. Syst. DesignImage and Video ProcessingEstimation, Detection and Ident.Multimedia CommunicationError Control CodingOptical Image and Radar Proc.Pattern RecognitionDigital Signal Processing II

Sound

Digital idebandAudioFrequencyBand (Hz)300 3400SamplingRate (kHz)8Bits perSample8Raw Bitrate(kbits/s)6450 700016812810 11000241638410 220004816768– CD: 44.1 kHz 16 bits 2 channels 1.411 Mbits/sTsuhan Chen

MPEG-1 Audio ISO/IEC 11172-3 (1988 1991)– First high quality audio compression standard– Sampling rates: 32, 44.1, 48 kHz– CD quality two-channel audio at 256 kbits/s CD: 44.1 kHz 16 bits 2 1.411 Mbits/s– YES, this is MP3!!! Quality demonstration––––Stereo 44.1 kHz at 64 kbits/sStereo 44.1 kHz at 128 kbits/sStereo 44.1 kHz at 192 kbits/sStereo 44.1 kHz at 256 kbits/sTsuhan Chen

Image

ImagenRGB ColormR 230G 120B 234R 251G 200B 190R 150G 170B 253R 254G 133B 200R 253G 100B 120R 244G 222B 214R 248G 220B 242R 151G 140B 139R 204G 203B 202R 0G 0B 0R 149G 244B 130R 190G 170B 90R 151G 148B 149R 159G 149B 150R 124G 110B 123R 255G 200B 200Tsuhan Chen

Sample ImagesLenaPepperBaboon512 512 3 bytes 768KBWith JPEG, 32KBTsuhan Chen

SamplingSpatial SubsamplingOriginal (256 256)Aliasing!!!(64 64)(32 32)MSE 2058MAE 24CR 16:1MSE 3924MAE 36CR 64:1Tsuhan Chen

SamplingSpatial Subsampling w/AveragingOriginal (256 256)(64 64)(32 32)MSE 1010MAE 18CR 16:1MSE 1643MAE 26CR 64:1Tsuhan Chen

QuantizationOriginal (24bit)(12-bit)MSE 9670MAE 78CR 2:1(6-bit)MSE 10381MAE 82CR 4:1Tsuhan Chen

Video

time .VideoPixel or PelLineSequenceFrame or PictureTsuhan Chen

Video Data VideoPels/lineLinesFrames/s Bytes/pelBit rateVideo Telephony(CIF)352288101.512.2 Mbits/sBroadcast TV(ITU-R 601 4:2:2)720480302166 Mbits/sHDTV 1280 720602885 Mbits/s So, we need MPEG-1 (VCD etc.), MPEG-2 (DVDetc.), MPEG-4 (some camcorders, etc.)Tsuhan Chen

Computer Graphics

Face Animation Wire-frame mesh model with texture mappingTsuhan Chen

Computer Vision

Face TrackingUse color information to segmenttarget vs. non-target pixelsUse deformable template to trackthe target

Lip Tracking Use a Gaussian mixture withthree Gaussians to model thecolor distribution of the mouth Template: two parabolasdefined by λ (a,b,c,d,e)cedabTsuhan Chen

Eye Tracking Find the center of thedarkest region in thesearch windownormalizationthresholdingFinding the centerTsuhan Chen

Tracking in a Car Driver Verification:Security and User PreferenceGesture-ControlledMap BrowsingFace/Eye/Hand TrackingGestureCamAirbag Deployment ControlTsuhan Chen

Higher Dimensions?

7D Plenoptic Functionf (Vx , V y , Vz ,θ ,ψ , λ , t suhan Chen

Image-Based Rendering Plenoptic Function [Adelson’91][McMillan’95] Lumigraph/Lightfield[Gortler/Grzeszczuk’96] [Levoy’96] Concentric Mosaics [Shum99]

“The Matrix”Tsuhan Chen

EyeVisionÆ 4D IBR(incl. time)[Kanade’01]Before CorrectionAfter CorrectionSuper Bowl XXXVTsuhan Chen

Self-Reconfigurable Camera Array[Levoy, Stanford][Zhang and Chen, CMU][McMillan, MIT]Tsuhan Chen

SetupTsuhan Chen

Results Real-time capturing/calibration/rendering– 48 webcams Æ sensor network– 2 step-motors each (translation and pan) Building the next version – More mobile and wirelessTsuhan Chen

Ongoing: Mirror/Lens ArrayThis is lightfield/lumigraph!Tsuhan Chen

Future: “Transparent Material”Camera Array3D DisplayMany applications Tsuhan Chen

Information Retrieval(Pattern Recognition)

Hand-Drawn Sketch RetrievalUser sketches a queryPage stored inDatabaseSimilarSketchQuerySketchTsuhan Chen

Trademark RetrievalRetrieved TrademarksQueryTsuhan Chen

Trademark RetrievalRetrieved TrademarksHand-DrawnQueryTsuhan Chen

3D Object RetrievalTsuhan Chen

Sketched 3D Query too Tsuhan Chen

3D Protein Structures too Tsuhan Chen

Summary Signals and SystemsImage and Video ProcessingComputer VisionComputer GraphicsPattern RecognitionInformation RetrievalTsuhan Chen

Signals and Systems (18-396),Image and Video Processing (18-798),and Life Beyond Prof. Tsuhan Chentsuhan@cmu.edu

Tsuhan Chen MPEG-1 Audio ISO/IEC 11172-3 (1988 1991) – First high quality audio compression standard – Sampling rates: 32, 44.1, 48 kHz – CD quality two-channel audio at 256 kbits/s

Related Documents:

Signals And Systems by Alan V. Oppenheim and Alan S. Willsky with S. Hamid Nawab. John L. Weatherwax January 19, 2006 wax@alum.mit.edu 1. Chapter 1: Signals and Systems Problem Solutions Problem 1.3 (computing P and E for some sample signals)File Size: 203KBPage Count: 39Explore further(PDF) Oppenheim Signals and Systems 2nd Edition Solutions .www.academia.eduOppenheim signals and systems solution manualuploads.strikinglycdn.comAlan V. Oppenheim, Alan S. Willsky, with S. Hamid Signals .www.academia.eduSolved Problems signals and systemshome.npru.ac.thRecommended to you based on what's popular Feedback

Signals and Systems In this chapter we introduce the basic concepts of discrete-time signals and systems. 8.1 Introduction Signals specified over a continuous range of t are continuous-time signals, denoted by the symbols J(t), y(t), etc. Systems whose inputs and outputs are continuous-time signals are continuous-time systems.

1964 Impala, Chevy II 1965 396 High Perf. 1965-67 283, 409 1966-68 327 exc. Powerglide 1967-68 All 396 1969 Corvette 427 High Perf. 1969 396 Exc. High Perf. 1969 Corvette 350 TI 1969-70 302 Camaro 1970 400 4-bbl 1970 396 High Perf. 1970 Corvette 350 High Perf. 1973-74 454 Exc. HEI VC1810 B28 1965 409 High Perf. 3-5 8 @ 5.75-8 1965 327 High Perf.

a more general class of continuous time signals. Fourier Transform is at the heart of modern communication systems We have defined the spectrum for a limited class of signals such as sinusoids and periodic signals. These kind of spectrum are part of Fourier series representation of signals ( ) ( )

Signals & Systems CREC Dept. of ECE Page 10 LECTURE NOTES ON SIGNALS AND SYSTEMS (15A04303) II B.TECH – I SEMESTER ECE PREPARED BY Mr. K. JAYASREE ASSOCIATE PROFESSOR DEPARTMENT OF ELECTRONICS AND COMMUNICATION ENGINEERING . Lathi, “Linear Systems and Signals”, Second Ed

2. Simulate the generation of signals and operations on them. 3. Illustrate Gibbs phenomenon 4. Analyze the signals using Fourier, Laplace and Z transforms. COURSE OUTCOMES 1. Understand the applications of MATLAB and to generate matrices of various dimension 2. Generate the various signals and sequences and perform operations on signals. 3.

tation in Signals and Systems, Oppenheim and Willsky with Nawab, 2nd Edition, Prentice Hall, 1997. 2.1 SIGNALS, SYSTEMS, MODELS, PROPERTIES Throughout this text we will be considering various classes of signals and systems, developing models for them and studying their properties.

Chapter 2 - Signals, Signs and Pavement Markings PA Driver’s Manual - 7-SIGNALS Traffic signals are installed at intersections to control the movement of vehicles and pedestrians. Traffic signals are arranged in either vertical lines or horizontal lines. When they are arranged vertically, red is always on top and green on the bottom.