DYNAIKON

COMPUTER VISION FOR LIVE MEDIA ARTS

NO MORE MOCAP!

ANALYTICAL TOOL

Our solution in computer vision and information retrieval algorithms provide an algorithmic chain capable of: (i) analysing shapes in sequential video-frames, (ii) extracting vision based features used to detect the performers’ gestures and movements.

creative tool

Our solution is a new creative tool for multi-media augmentation of live performance. Once the shape has been described and analysed, the surrounding and the stage with multi-media techniques (projections, interactive audio, responsive lighting, robotics) can be augmented, tightly synced with performers without affecting their freedom of movement.

learning tool

Our solution is a virtual personal tutor to performers: the system produces detailed descriptions of the performer’s shape and movements and, coupled with machine learning techniques, allows the training of the system with the input of a number of expert performers. Colour and textures of the stage or costumes can be added to provide more information and improving accuracy.

what we do

computer science innovation for live media arts
solutions in movement description & gesture recognition for live media arts

We develop novel techniques able to recognise different sequential gestures, to the level where they will describe and compute articulated movements in real time. In the context of live media arts, the research outcomes would change the paradigm of creating, learning, performing, designing for live media arts, by giving feedback on performance after analysing, in real time, the streaming video of the performance.
Our solution allows applying a novel representation of dynamic shapes when undergoing articulated movement. Our method is based on an adaptation of perception-based results including the codon features and medialness hotspots. In every frame of a video sequence (from a single camera) we can reliably obtain a shape representation which expresses in a compact way the highest values of medialness (aka hot spots) and the most descriptive convexities and concavities along contours.

OUR TEAM

We are international experts based in London, UK.

Prof. Frederic Fol Leymarie

Founder, Director
Frederic (PhD, Brown, 2003), a professor of Computing, is developing a mathematical language for shape representation with potential for applications in various domains and industries, from the Arts and Performance areas to Biology, Medicine, CAD, and more.

Prof. STEFAN RÜGER

Founder, Director
Stefan (PhD, Technische Universität Berlin, 1996) is a Professor of Knowledge Media with expertise in visual processing with a view to automated multimedia understanding and has worked as a consultant for data mining and information management projects.

Dr. PRASHANT APARAJEYA

Founder
Prashant Aparajeya (PhD Uni. of London, 2016) is a researcher in computer vision, with a focus on shape understanding, pose and movement computing, information retrieval, machine learning.

Dr. VESNA PETRESIN

Founder
Vesna (PhD, FRSA) is a transdisciplinary artist and thinker. She composes and performs with sound, light, rhythm, space, movement, text and code. She explores embodiment, transformation, manipulation of time and movement.


news and events