Signals and Systems (18-396),Image and Video Processing (18-798),and Life Beyond Prof. Tsuhan Chentsuhan@cmu.edu
Sample Courses in Signal Processing and CommunicationSignals and SystemsApplied Stochastic Proc.Digital Signal Processing IFund. Comm. Sys.Dig. Comm. and Sig. Proc. Syst. DesignImage and Video ProcessingEstimation, Detection and Ident.Multimedia CommunicationError Control CodingOptical Image and Radar Proc.Pattern RecognitionDigital Signal Processing II
Sound
Digital idebandAudioFrequencyBand (Hz)300 3400SamplingRate (kHz)8Bits perSample8Raw Bitrate(kbits/s)6450 700016812810 11000241638410 220004816768– CD: 44.1 kHz 16 bits 2 channels 1.411 Mbits/sTsuhan Chen
MPEG-1 Audio ISO/IEC 11172-3 (1988 1991)– First high quality audio compression standard– Sampling rates: 32, 44.1, 48 kHz– CD quality two-channel audio at 256 kbits/s CD: 44.1 kHz 16 bits 2 1.411 Mbits/s– YES, this is MP3!!! Quality demonstration––––Stereo 44.1 kHz at 64 kbits/sStereo 44.1 kHz at 128 kbits/sStereo 44.1 kHz at 192 kbits/sStereo 44.1 kHz at 256 kbits/sTsuhan Chen
Image
ImagenRGB ColormR 230G 120B 234R 251G 200B 190R 150G 170B 253R 254G 133B 200R 253G 100B 120R 244G 222B 214R 248G 220B 242R 151G 140B 139R 204G 203B 202R 0G 0B 0R 149G 244B 130R 190G 170B 90R 151G 148B 149R 159G 149B 150R 124G 110B 123R 255G 200B 200Tsuhan Chen
Sample ImagesLenaPepperBaboon512 512 3 bytes 768KBWith JPEG, 32KBTsuhan Chen
SamplingSpatial SubsamplingOriginal (256 256)Aliasing!!!(64 64)(32 32)MSE 2058MAE 24CR 16:1MSE 3924MAE 36CR 64:1Tsuhan Chen
SamplingSpatial Subsampling w/AveragingOriginal (256 256)(64 64)(32 32)MSE 1010MAE 18CR 16:1MSE 1643MAE 26CR 64:1Tsuhan Chen
QuantizationOriginal (24bit)(12-bit)MSE 9670MAE 78CR 2:1(6-bit)MSE 10381MAE 82CR 4:1Tsuhan Chen
Video
time .VideoPixel or PelLineSequenceFrame or PictureTsuhan Chen
Video Data VideoPels/lineLinesFrames/s Bytes/pelBit rateVideo Telephony(CIF)352288101.512.2 Mbits/sBroadcast TV(ITU-R 601 4:2:2)720480302166 Mbits/sHDTV 1280 720602885 Mbits/s So, we need MPEG-1 (VCD etc.), MPEG-2 (DVDetc.), MPEG-4 (some camcorders, etc.)Tsuhan Chen
Computer Graphics
Face Animation Wire-frame mesh model with texture mappingTsuhan Chen
Computer Vision
Face TrackingUse color information to segmenttarget vs. non-target pixelsUse deformable template to trackthe target
Lip Tracking Use a Gaussian mixture withthree Gaussians to model thecolor distribution of the mouth Template: two parabolasdefined by λ (a,b,c,d,e)cedabTsuhan Chen
Eye Tracking Find the center of thedarkest region in thesearch windownormalizationthresholdingFinding the centerTsuhan Chen
Tracking in a Car Driver Verification:Security and User PreferenceGesture-ControlledMap BrowsingFace/Eye/Hand TrackingGestureCamAirbag Deployment ControlTsuhan Chen
Higher Dimensions?
7D Plenoptic Functionf (Vx , V y , Vz ,θ ,ψ , λ , t suhan Chen
Image-Based Rendering Plenoptic Function [Adelson’91][McMillan’95] Lumigraph/Lightfield[Gortler/Grzeszczuk’96] [Levoy’96] Concentric Mosaics [Shum99]
“The Matrix”Tsuhan Chen
EyeVisionÆ 4D IBR(incl. time)[Kanade’01]Before CorrectionAfter CorrectionSuper Bowl XXXVTsuhan Chen
Self-Reconfigurable Camera Array[Levoy, Stanford][Zhang and Chen, CMU][McMillan, MIT]Tsuhan Chen
SetupTsuhan Chen
Results Real-time capturing/calibration/rendering– 48 webcams Æ sensor network– 2 step-motors each (translation and pan) Building the next version – More mobile and wirelessTsuhan Chen
Ongoing: Mirror/Lens ArrayThis is lightfield/lumigraph!Tsuhan Chen
Future: “Transparent Material”Camera Array3D DisplayMany applications Tsuhan Chen
Information Retrieval(Pattern Recognition)
Hand-Drawn Sketch RetrievalUser sketches a queryPage stored inDatabaseSimilarSketchQuerySketchTsuhan Chen
Trademark RetrievalRetrieved TrademarksQueryTsuhan Chen
Trademark RetrievalRetrieved TrademarksHand-DrawnQueryTsuhan Chen
3D Object RetrievalTsuhan Chen
Sketched 3D Query too Tsuhan Chen
3D Protein Structures too Tsuhan Chen
Summary Signals and SystemsImage and Video ProcessingComputer VisionComputer GraphicsPattern RecognitionInformation RetrievalTsuhan Chen
Signals and Systems (18-396),Image and Video Processing (18-798),and Life Beyond Prof. Tsuhan Chentsuhan@cmu.edu
Tsuhan Chen MPEG-1 Audio ISO/IEC 11172-3 (1988 1991) – First high quality audio compression standard – Sampling rates: 32, 44.1, 48 kHz – CD quality two-channel audio at 256 kbits/s
Signals And Systems by Alan V. Oppenheim and Alan S. Willsky with S. Hamid Nawab. John L. Weatherwax January 19, 2006 wax@alum.mit.edu 1. Chapter 1: Signals and Systems Problem Solutions Problem 1.3 (computing P and E for some sample signals)File Size: 203KBPage Count: 39Explore further(PDF) Oppenheim Signals and Systems 2nd Edition Solutions .www.academia.eduOppenheim signals and systems solution manualuploads.strikinglycdn.comAlan V. Oppenheim, Alan S. Willsky, with S. Hamid Signals .www.academia.eduSolved Problems signals and systemshome.npru.ac.thRecommended to you based on what's popular Feedback
Signals and Systems In this chapter we introduce the basic concepts of discrete-time signals and systems. 8.1 Introduction Signals specified over a continuous range of t are continuous-time signals, denoted by the symbols J(t), y(t), etc. Systems whose inputs and outputs are continuous-time signals are continuous-time systems.
1964 Impala, Chevy II 1965 396 High Perf. 1965-67 283, 409 1966-68 327 exc. Powerglide 1967-68 All 396 1969 Corvette 427 High Perf. 1969 396 Exc. High Perf. 1969 Corvette 350 TI 1969-70 302 Camaro 1970 400 4-bbl 1970 396 High Perf. 1970 Corvette 350 High Perf. 1973-74 454 Exc. HEI VC1810 B28 1965 409 High Perf. 3-5 8 @ 5.75-8 1965 327 High Perf.
a more general class of continuous time signals. Fourier Transform is at the heart of modern communication systems We have defined the spectrum for a limited class of signals such as sinusoids and periodic signals. These kind of spectrum are part of Fourier series representation of signals ( ) ( )
Signals & Systems CREC Dept. of ECE Page 10 LECTURE NOTES ON SIGNALS AND SYSTEMS (15A04303) II B.TECH – I SEMESTER ECE PREPARED BY Mr. K. JAYASREE ASSOCIATE PROFESSOR DEPARTMENT OF ELECTRONICS AND COMMUNICATION ENGINEERING . Lathi, “Linear Systems and Signals”, Second Ed
2. Simulate the generation of signals and operations on them. 3. Illustrate Gibbs phenomenon 4. Analyze the signals using Fourier, Laplace and Z transforms. COURSE OUTCOMES 1. Understand the applications of MATLAB and to generate matrices of various dimension 2. Generate the various signals and sequences and perform operations on signals. 3.
tation in Signals and Systems, Oppenheim and Willsky with Nawab, 2nd Edition, Prentice Hall, 1997. 2.1 SIGNALS, SYSTEMS, MODELS, PROPERTIES Throughout this text we will be considering various classes of signals and systems, developing models for them and studying their properties.
Chapter 2 - Signals, Signs and Pavement Markings PA Driver’s Manual - 7-SIGNALS Traffic signals are installed at intersections to control the movement of vehicles and pedestrians. Traffic signals are arranged in either vertical lines or horizontal lines. When they are arranged vertically, red is always on top and green on the bottom.