You need an account to view media

Sign in to view media

Don't have an account? Please contact us to request an account.

ICME Keynotes
Keynote

Keynote 1: Generative Forms of Multimedia Content - Alan Smeaton

Alan Smeaton

Date & Time

Tue, July 7, 2020

09:30 am – 10:30 am

Location

On Demand

Abstract

Multimedia analysis has recently made spectacular improvements in both quality and in sophistication. Over the last half-decade we have seen extreme progress in tasks like image and video tagging, object detection and activity recognition, generating descriptive captions and more. Some of these have been deployed and are in widespread use in our smartphones and on our social media platforms. We have also seen recent research work, including our own, on computing more abstract features of multimedia, such as person-counting from CCTV, computing visual salience, estimating aesthetics of images and videos, and computing video memorability. The common methodology used across most of these applications is of course machine learning, in all its forms, from convolutional neural networks to simple regression and support vector machines. Much of the research in our field is about wrestling with machine learning to optimise its performance in multimedia analysis tasks and this recent run of extreme progress does not look like ending anytime soon, though it will reach its high water mark. When it does reach the point at which it cannot get any better, what then ? Generative machine learning (ML) is a recent form of media analysis which turns the conventional approach on its head and its methodology is to train a model and then generate new data. Example applications of generative ML deoldify which colourises black and white images and video clips, and Generative Adversarial Networks (GANs) which can generate DNA sequences, 3D models of replacement teeth, impressionist paintings, and of course video clips, some known as deepfakes. Putting aside the more nefarious applications of deepfakes, what is the potential for generative forms of multimedia ? In the short to medium term we can speculate that it would include things like movie augmentation but it how far can it go and could it replicate human creativity ? In this talk I will introduce some of the recent forms of generative multimedia and discuss how far I believe we could go with this exciting new technology.


Presenter

Alan Smeaton

Insight Centre for Data Analytics, Dublin City University
Sign in to join the conversationDon't have an account? Please contact us to request an account.

Presentation Chair

Ebroul Izquierdo

Queen Mary University of London

Date & Time

Tue, July 7, 2020

09:30 am – 10:30 am

Location

On Demand