Revolutionary displays : the future of view, a view of the future : symposium, 8 April 2003

(1)

Revolutionary displays : the future of view, a view of the future

: symposium, 8 April 2003

Citation for published version (APA):

Institute of Electrical and Electronics Engineers (IEEE). Student Branch Eindhoven (SBE) (2003). Revolutionary displays : the future of view, a view of the future : symposium, 8 April 2003. Technische Universiteit Eindhoven.

Document status and date: Published: 01/01/2003

Document Version:

Publisher’s PDF, also known as Version of Record (includes final page, issue and volume numbers)

Please check the document version of this publication:

• A submitted manuscript is the version of the article upon submission and before peer-review. There can be important differences between the submitted version and the official published version of record. People interested in the research are advised to contact the author for the final version of the publication, or visit the DOI to the publisher's website.

• The final author version and the galley proof are versions of the publication after peer review.

• The final published version features the final layout of the paper including the volume, issue and page numbers.

Link to publication

General rights

Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain

• You may freely distribute the URL identifying the publication in the public portal.

If the publication is distributed under the terms of Article 25fa of the Dutch Copyright Act, indicated by the “Taverne” license above, please follow below link for the End User Agreement:

www.tue.nl/taverne

Take down policy

(2)

SYMPOSIUM

Revolutionary Displays

The future of view, a view of the future

Dinsdag 8 april 2003

(3)

(4)

Voorwoord

The mission of the IEEE Student Branch Eindhoven is to introduce students with

the variousity of the world of electrical and electronic engineering and develop

talents with the independent organization of small and bigger events.

Every year the IEEE Student Branch Eindhoven brings a group of students

together, these students form the Symposium Committee. This year the

committee consists of four students. These students are in their second year of

the study electrical engineering. They have chosen the theme ‘Modern Displays’

for this year’s Symposium.

The title was quickly found:

Revolutionary Displays

The future of view, a view of the future

Displays develop. From the first Cathode Ray Tube monitors till now, a lot has

changed. A book that downloads its contents from the internet. 3d-Displaying to

give the user the maximum experience. Especially the last years new

technologies are being developed. Some already available for customers, some

only in prototype, others yet to be developed.

The committee has faced many ups and downs while organizing the symposium

and they are many experiences richer.

We hope you enjoy the Symposium “Revolutionary Displays” and learn as much

from it as we did!

Charlotte Rugers

(5)

(6)

Programma

09.00u

Ontvangst met koffie en thee

09.25u

Welkomstwoord

Tony Davies

09.30u

Displays, from simple to complex Dr. Gary E. Thomas (Philips)

10.30u

Elektronic Ink Displays, the

Peter Kurstjens (E-Ink/Philips)

future of reading

11.30u

Pauze

12.00u

Flaws in emerging displays and Prof. Dr. Ir. Gerard de Haan

remedial video-processing

(Philips)

13.00u

Lunch

14.00u

Low-cost fabricatoin of complex Peter Briër (OTB Engineering)

‘display’ products

15.00u

We wrote history while creating Frank van Leuvenhaege

the future

(Pioneer)

16.00u

Holograms, a new way of

Chris Velzel en Walter Spierings

displaying

(Dutch Holographic Laboratory)

17.00u

Afsluiting

Tony Davies

(7)

Inhoud

Voorwoord

3

Charlotte Rugers

Programma

5 Inhoud

6 Biografie Dagvoorzitter

8 Displays, from simple to complex

Biografie Dr. Gary E. Thomas (Philips)

10

Lezing Displays, from simple to complex

11 Elektronic Ink Displays, the future of reading

Biografie Peter Kurstjens (Philips)

22

Lezing Elektronic Ink Displays, the future of reading

23 Flaws in emerging displays and remedial video-processing

Biografie Prof. Dr. Ir. Gerard de Haan (Philips)

26

Lezing Flaws in emerging displays and remedial video-processing

27 Low-cost fabrication of complex 'display' products

Biografie Peter Briër (OTB Engineering)

32

Lezing Low-cost fabrication of complex 'display' products

33 We wrote history while creating the future

Biografie Frank van Leuvenhaege (Pioneer)

38

Lezing We wrote history while creating the future

39 Holograms, a new way of displaying

Biografie Walter Spierink (Dutch Holographic Laboratory)

48

(8)

Organisatie

62 Dankwoord

63 Sponsoren

64

(9)

Biografie Dagvoorzitter

Prof. Antony C. Davies,

Emeritus Professor, King’s College, University of London, England and Visiting Professor, Kingston University, Kingston-upon-Thames, England

Tony Davies received the B.Sc(Eng.) in Electrical Engineering with First Class Honours (1963) from Southampton University, the Mphil (1967) from University of London, and the PhD (1970) from City University London. Following two years military service in the Royal Electrical and Mechanical Engineers (1955-1957) he studied at Southampton University and on graduation worked for General Electric Co. in Coventry. He was appointed Lecturer (1963), Reader (1970) and Professor (1982) at City University where he was Director of a Centre for Information Engineering. He moved to the Department of Electronic Engineering at King’s College Londen in 1990. He held visiting appointments at University of British Columbia (1968-1969) and Purdue University (1973-1974) and a Royal Society Visiting Fellowship at British Aerospace (1987-1988). He retired from King’s College from October 1999, and was awarded the title of ‘Emeritus Professor’. Since January 2002 he has also been a Visiting Professor in the School of Computing and Information Systems at Kingston University, where he is principal investigator for a research project related to

distributed and asynchronous computing systems, carried out in collaboration with the University of Newcastle and with British Aerospace, funded by the UK

Engineering and Physical Sciences Research Council. His recent technical interests, teaching and research cover Circuit Theroy, Signal Processing, Digital and Software Systems and Non-linear Dynamics. He is a Chartered Engineer, IEEE Fellow and BCS Member and an IEEE Life Fellow.

Currently he is IEEE Region 8 Director (for a two-year term from January 2003) and a member of the IEEE Board of Directors. He was previously IEEE Region 8 Vice Chair for Technical Activities, and has held many other positions in IEEE, including Vice President for Region 8 of the IEEE Circuits and Systems Society, and Chair of the United Kingdom and Republic of Ireland Section of IEEE.

He was recipient of IEEE Circuits and Systems Society Jubilee medal and the IEEE Millennium medal in 2000.

e-mail address: tonydavies@ieee.org

website: www.tonydavies.org.uk

(10)

(11)

Biografie

Gary E. Thomas

Gary E. Thomas graduated in Physical Chemistry from the University of British Columbia in Vancouver, Canada. He received his Ph.D. on the subject of low-energy electron spectroscopy in the gas phase from the same institution in 1969. After spending a post-doctoral period at the Lawrence Berkeley Laboratory in Berkeley, California, he joined the Philips Research Laboratory in Eindhoven, The Netherlands in 1970.

After a period of fundamental research on ion beam interactions with surfaces, he joined a project group involved in the pioneering work on optical disc systems. He later became Department Head of the Glass Group and the Optics Group at Philips Research. In 1989, he became a Senior Vice President of Philips Research and led the sector of Applied Physics and Mechanics, which included many of the display research activities at Philips. He then became the Chief Technology Officer of the Philips Business Group Flat Display Systems and is currently the CTO for Display Technologies of Philips Components. In this position he deals with all innovations in display technology within the company and is heavily involved in scouting external opportunities within the display industry.

(12)

Flaws in emerging displays and remedial video processing

Dr. Gary E. Thomas

Chief Technology Officer, Display Technologies Philips Components

Abstract

The world of displays used to be a fairly simple place with a few mainstream technologies serving a limited number of applications. This situation has changed drastically to a world in which a stream of new technological developments enable and feed a rapidly growing list of applications. In addition, a number of these technologies are jostling for position in the major traditional markets such as TV displays and computer monitors. The lecture will give an overview of some of the available

technologies and try to give a flavor of the fascinating developments and confrontations in the display marketplace. Finally, the lecture will address some applications which are still waiting for a technological solution.

(13)

1

-Displays, from Simple to Complex

Gary Thomas CTO Display Technologies

Philips Components

2

-Summary

• From simple to complex • Applications and technologies

• Some large-panel technologies and the coming confrontations • Some reflections on small-panel technologies

(14)

13

-Each application has its unique user requirements with respect to picture performance (e.g. display size, resolution, brightness) and other display characteristics (e.g. cost, weight, flatness)

0 500 1000 1500 2000 0 2 5 10 15 20 25 30 35 40 50 60 No. of colour pixels (k) Display size (diag. inch V) Sub- note-book Port. TV/ Video/DVD Rear seat enter-tainment Web pad Navigation Handh. comp. Vehicle mgt. Cellular phone Communicator Medium TV Work-station Large TV Note-book Small TV Mobile multi-media TV Desktop monitor Fixed multimedia TV Jumbo TV (> 30”) Professional applications (> 30”)

Small screen applications (<14”) Monitors (14-25”) Consumer TV (14-30”) Jumbo TV & Professional (>30”)

1. The turbulent Display Business

Displays are used in a wide variety of applications, with different panel sizes and resolution demands

(15)

17

-Some Technologies for Large-screen Applications

21

-Twisted Nematic Effect

(16)

01/04/2003 28 -erasing/priming addressing sustaining 1 2 4 8 16 32 Subframe addressing subframe:

subframes with different weights (64 greyscales):

frame time t→

(17)

(18)

44

-The Display Factbook

45

1414-01A.09

49

(19)

50

1414-01A.09 53 -0 200,000 400,000 600,000 2001 2002 2003 2004 K Units

Technology breakdown in mobile phone

OEL LTPS a-Si color STN mono STN

Market Forecast – rapid penetration of colour

S ource: TS R

57

(20)

(21)

70

-MARKETS

• PUBLIC INFORMATION

– TRANSPORTATION, BANKING, ARENAS • ADVERTISING/MARKETING

– POS, MALLS, “TIMES SQUARE”, BILLBOARDS • COMMERCIAL

– FINANCIAL, CALL CENTERS • HOME THEATER

• ELECTRONIC CINEMA

• INDUSTRIAL/MILITARY

(22)

(23)

Biografie

Peter Kurstjens

Peter is General Manager Electronic Ink Displays within Philips. He is responsible for bringing the electronic ink display technology to market. Working with Philips’ partner E Ink Corporation, he drives all aspects of this initiative, including the commercial, technical and industrial programs.

Peter spent two years in the Silicon Valley where he gained broad experience in developing new business initiatives and building relationships with partner companies in the US and Asia. He also held the role of Project Manager, exploring business opportunities for a new touch display technology and leading several due-diligence processes. Peter started his career in the flat panel display industry as Industrial Engineer for PDP Large Flat TV development. He holds two master degrees, in Mechanical Engineering and in Business Studies, from the University of Twente in The Netherlands.

(24)

P eter Kurstjens, April 2003 4 Visua l media E lectronic Ink Dis pla ys P olymer OLE D Dis pla ys CRT P a per LCD

P eter Kurstjens, April 2003 5

Displa ys for mobile devices

Before:

• Difficult to rea d • Hea vy a nd thick • F ra g ile • P ower-hung ry • Rela tively expensive

Our objective:

• P a per-like rea da bility • Thin a nd lig htweig ht • Rug g ed, flexible • Long ba ttery life • Low cost

(25)

P eter Kurstjens, April 2003 9 Ultra -low power consumption • Ima g e sta ys on displa y when power is

turned off (memory effect) • No a dditiona l lig hting required

P eter Kurstjens, April 2003 13

Implica tions

• Dig ita l content a nywhere, a nytime

• Combines printed content with multimedia experiences • Customiza tion of content

• P hysica l distribution becomes outda ted

Key Ta kea wa ys

• E lectronic Ink dis pla ys will ena ble new ‘rea ding -centric’ devices

• Crea ting new opportunities for dig ita l content a nd e-publishing

(26)

(27)

Biografie

Prof. Dr. Ir. Gerard de Haan

Gerard de Haan received B.Sc., M.Sc., and Ph.D. degrees from Delft University of Technology in 1977, 1979 and 1992 respectively. He joined Philips Research in 1979. He has led research projects in the area of video processing, and participated in European projects. He has coached students from various universities, and teaches since 1988 for the Philips Centre for Technical Training. In 1991/1992, he was a visiting researcher in the Information Theory Group of Delft University. In 1994, he was a Guest Editor for Signal Processing: IMAGE COMMUNICATIONS for a special issue on Video Format Conversion. Currently, he is a Research Fellow in the Video Processing & Visual Perception group of Philips Research Eindhoven, and a part-time full Professor at the Eindhoven University of Technology teaching "Video Processing for Multimedia Systems". He has a particular interest in algorithms for motion estimation, scan rate conversion, and image enhancement. His work in these areas has resulted in several books, about 80 papers, some 50 patents and patent applications, and various commercially available ICs. He was the first place winner in the 1995 ICCE Outstanding Paper Awards program, the second place winner in 1997 and in 1998, and the 1998 recipient of the Gilles Holst Award. In 2002, he received the Chester Sall Award for the second best paper in the IEEE Transactions on Consumer Electronics of the year 2001. The Philips `Natural Motion Television' concept, based on his PhD-study received the European Video Innovation Award of the Year 95 from the European Imaging and Sound Association. In 2001, the

successor of this concept "Digital Natural Motion Television" received a Business Innovation Award from the Wall Street Journal Europe. Gerard de Haan is a Senior Member of the IEEE.

(28)

Flaws in emerging displays and remedial video processing

Gerard de Haan

Philips Research Laboratories, Eindhoven, The Netherlands Eindhoven University of Technology, the Netherlands

E-mail: G.de.Haan@Philips.com

Abstract

New display principles aim at supreme image quality. The temporal aspects of these devices sometimes remain underexposed, and the paper presents an overview of new artifacts and possible remedies with signal processing.

Introduction

Over the years, a large number of new display principles have emerged from the search for flat, high quality, or low cost alternatives for the successful Cathode Ray Tube (CRT). The various properties a good display should have include high static resolution, high peak brightness, high contrast, high lumen efficacy, and favourable dynamic behaviour. Of these, it is the last item which sometimes remains underexposed. Nevertheless, the temporal aspects of a video display determine

important properties like flicker, dynamic resolution and motion portrayal.

In this paper, we shall discuss typical artifacts due to unfavourable properties of emerging television displays. We introduce a processing model that eliminates or at least reduces the various artifacts that result from temporal imperfections of CRTs with alternative scanning, Liquid Crystal Displays (LCDs), tiled displays, Plasma Display Panels (PDPs), and colour sequential type of displays. We shall conclude that knowledge of the motion in the scene, i.e. motion estimation, is essential to at least partially repair the often unfavourable temporal behaviour of these displays.

Such repair is realistic, as these displays have appeared on the market at the moment motion vector estimation has come to maturity for consumer applications [1-4].

Figure 1: Emerging flat television displays, like the ones shown left based on plasma panels and liquid crystal technology enable many new exiting application areas and create new design options. Often, however, the temporal behaviour of these new display devices remains under-exposed. This paper discusses the artefacts resulting from sub-optimal temporal characteristics of emerging display

principles, and introduces the required advanced video processing to remedy these short- comings. Recent

(29)

Figure 2: The perceived effect of scanning mismatches and temporal integration on various imager and display combinations. In all cases the camera pans over the image, such that the image moves from left to right over the screen. From top-left to bottom-right: 1a: tube imager and digital matrix display, 1b: imager tube and CRT colour sequential display, 1c: frame transfer CCD imager and tiled (vidiwall) CRT display, 1d: 25 Hz film on 50 Hz CRT, 1e: frame transfer CCD imager and liquid crystal display (LCD), 1f: frame transfer imager and plasma display panel (PDP).

Temporal artifacts in displays resulting from scanning mismatches

In the early days of television, both the imaging and the display device used an electron beam to scan the scene, and it was only logical that the scanning had the same

parameters, i.e. line time, picture rate and interlace factor. In such a system, the delay between the registration of an input pixel and the display of an output pixel is equivalent for all pixels. Over time, the technologies for imagers and displays diverged, and the delay for every displayed pixel no longer had the same value.

In a first category of displays, the delay variation, resulting from the scanning mismatch can be described as a linear function of the horizontal and vertical position on the screen. Due to motion in the scene, these delay variations are translated into spatial position errors, which are proportional to the local velocity of the objects in the scene. Consequently, for these display and imager combinations, motion results in a

geometrical distortion of the moving object. This distortion varies smoothly as a function of the spatial position, and therefore is considered mild and acceptable at

least for consumer vision applications. Figure 2a illustrates the effect of scanning mismatches in this category, showing a horizontal pan over a scene with a scanning imager tube, e.g. a plumbicon, displayed on a matrix addressed digital display.

In a second category of imager and display combinations, positional errors result as a function of the velocity as described above, but the relation between the position error and the velocity is not constant. This relation may vary per colour (for colour sequential displays, as shown in Figure 2b), per picture portion (for tiled displays like vidiwall screens, see Figure 2c), or may depend on the picture number (for broadcasted film material on any known display, and for video in PCs, see Figure 2d). As this leads to delay variations that do not necessarily vary smoothly, correction gives a clear

(30)

Figure3: The artifacts due to temporal behaviour of displays modelled as a cascade of a filter due to non- stroboscopic rendering and a variable delay due to a mismatch with the scanning of the imaging device. The general remedy includes inverse filtering and delay compensation, i.e. motion compensated interpolation.

Recently, correction algorithms have reached a level of maturity that allowed introduction on the market for consumer video equipment of dedicated ICs [1,2] and software

packages that enable real time correction on digital signal processors (DSPs) [4].

In a third category, positional errors result as a function of the velocity as described above, but the relation between positional error and velocity depends on the displayed data. This is typically the case for displays with an on/off character that realise grey scale representation with pulse-width modulation, e.g. PDPs. The artifacts of this category are even stronger than in the previous display categories, and repair therefore leads to an obvious quality improvement. In a more elaborate paper

dedicated specifically to the artifacts in PDPs [5], we have shown that this improvement, although feasible, is more difficult to achieve.

Temporal artifacts due to integration

The CRT is a .stroboscopic. display device, i.e. the light for an individual pixel is generated as a pulse, which is very short, compared to the picture time. For non-stroboscopic displays like many of the emerging types such as LCDs and PDPs each image is displayed during a display time. For an LCD this display time is constant and equals the picture time, while for a PDP it varies with the brightness of the pixel. When there is motion in the image, the viewer will track the motion, and hence integrate the intensity produced by each image, along the motion trajectory. For a given display time, the integration can be described as a convolution of the original image, and a motion tracking / temporal sample-and-hold function. From a mathematical analysis it follows that the perceived effect, for a constant display time, is a blurring of moving image parts, where the amount of blurring is proportional to the local velocity and to the display time.

Figure 2e and 2f show the perceived artifact for our panning scene on a LCD and on a PDP, respectively. For the PDP the display time is smaller than for an LCD, and the blurring is not the most disturbing artifact. The LCD, as can be seen from the Figure 2, indeed gives more blurring, but the data dependent display time of the PDP gives rise to the more annoying contouring artifacts visible in Figure 2f. The background of this so-called .dynamic contours. effect is discussed in reference [5].

Temporal artifact reduction

From the previous sections, it appears that weaknesses in the temporal behaviour of emerging displays result in impairments of moving image parts. Moreover, the effects are proportional to the velocity of the motion. Knowledge of the motion in the scene can

(31)

As can be seen from Figure 3, the remedy for all described artifacts consists of the cascade of a motion compensated picture interpolation module, i.e. a device that applies motion vectors calculated with a motion estimator to compensate for the delay error introduced by the scanning mismatch, together with an inverse filtering module to counteract the effects of integration of non-stroboscopic displays. The principle of inverse filtering has been suggested by Bitzakidis [6].

An analysis in the Fourier domain shows that this inverse filtering cannot be perfect as the transfer, i.e. the frequency characteristic, resulting from the integration along the motion trajectory has zeroes. In addition to the imperfections of the inverse filter due to the nature of the integration filter, the pulse-width modulation techniques for grey level generation cause data dependencies of the artifacts that can be reduced, but not completely eliminated. This shall be elaborated in a paper planned to appear in August [7].

Conclusion

In this paper, we presented an overview of artifacts resulting from emerging display principles. We modelled these devices and introduced a general approach, consisting of motion compensated picture interpolation and inverse filtering, to repair the image quality with signal processing. We concluded that motion estimation plays an enabling role in the reduction of display artefacts. Based on years of research in the motion estimation area [8], these algorithms have reached a level of maturity that enabled implementation of high quality true-motion estimators in consumer electronics devices. In a full paper [6], we have elaborated the general correction concept for temporal artefacts for the individual display types.

References

[1] G. de Haan, J. Kettenis, and B. Deloore, .IC for motion compensated 100 Hz TV, with a smooth motion movie-mode., IEEE Transaction on Consumer Electronics, vol. 42, May 1996, pp. 165-174.

[2] G. de Haan, “IC for motion compensated de-interlacing, noise reduction and picture rate conversion”, IEEE, Transactions on Consumer Electronics, Aug. 1999, pp 617-624. [3] G. de Haan, .Large-display video format conversion., Journal of the SID, Vol. 8, no. 1, 2000, pp. 79-87.

[4] R.J. Schutten and G. de Haan, .Real-time 2-3 pull-down elimination applying motion estimation / compensation on a programmable device., IEEE Transactions on Consumer

Electronics, Vol. 44, No. 3, Aug. 1998, pp. 930-938.

[5] M.A. Klompenhouwer and G. de Haan, “Optimal reduction of dynamic contours in plasma panel displays”, Digest of the SID’00, May 2000, Long Beach, pp. 388-391. [6] Stefano Bitzakidis, .Matrix video display system and method of operating such

systems., European Patent Application, no. EP657860A2, issued Jun. 14, 1995.

[7] G. de Haan and M.A. Klompenhouwer, `An overview of flaws in emerging television displays and remedial video processing', IEEE Transactions on Consumer Electronics, Aug. 2001, pp. 326-334.

[8] G. de Haan, .Progress in motion estimation for video format conversion., IEEE

Transactions on Consumer Electronics, Vol. 46, No. 3, Aug. 2000, pp. 449-459.

Gerard de Haan is a Research Fellow in the group Video Processing & Visual

Perception of Philips Research Laboratories, and a Professor at the Technical University of Eindhoven. He has a particular interest in algorithms for motion estimation, scan rate conversion, and image enhancement. His work in these areas has resulted in several

(32)

(33)

Biografie

Peter Briër

Peter Briër (Engineering Physics, Technische Hogeschool Rijswijk, department of Photonics) is currently working as a Research Engineer at OTB Engineering b.v., Eindhoven, The Netherlands. OTB is a company that specializes on the development of “inline production equipment” for various products and industries (e.g. solar cell, optical media, medical and semiconductor). OTB is working on machine, product and process development and optimization. This all-encompassing approach enables OTB to deliver high volume, high yield production equipment; sometimes

revolutionizing the way products are manufactured.

Mr. Briër has a broad knowledge of machine design, mechatronics, signal processing, software and optics. Previous projects (at various positions) include: development of specialized laser ablation process and equipment for film and security printing applications (Dutch passport), the development of a high precision electrical injection molding machine and a novel linear motor handling system for vacuum applications.

In his current position, he is working on the design of in-line production equipment for Polymer OLED devices. This novel display technology is ideally suited for fast, automated production, due to its straightforward design. The use of “thin film

encapsulation” in this equipment makes flat, flexible and low cost displays possible. Both the process steps and their implications for machine design are investigated at OTB.

(34)

Low-cost fabrication of complex ‘display’ products

Peter Briër OTB Engineering

(35)

(36)

(37)