Forms
- year
- 2014—2022
- type
- series
- tools
- openFrameworks, OpenCV, Unreal Engine, Max/MSP
- role
- author
- description
- Meta-project: form, contour and sound — from Kandinsky’s Concerning the Spiritual in Art to computer-vision experiments and AV installations.
Series of works on form, contour analysis and sound synthesis. Starting point — Kandinsky’s Concerning the Spiritual in Art. Computer vision is used to recognise objects, extract contours, compare shapes and build images and sound from those data.
Methods: colour palette · shape per colour · form analysis · form interaction · sound synthesis.
Related works
- FormsContours — contour sound (2014)
- FormsInteractions — interaction of forms (2014/2016)
- Quad — square sides as sound (2014)
- PROUN Forms — AV installation, PROUN Continuum (2016)
- «Цикл» — AV performance with Soma (2015)
- FormsFlow CV Rounds
- FormsFlow CV Colors
Experiment 1. Contour sound
2014 · OpenFrameworks · Analog Synth
Playing an image along its contour, the program changes sound with lines, turns and angles — volume, placement and smoothness of the composition.
Experiment 2. Sound of form
2014 · OpenFrameworks
Correlation between the feeling of form and a dynamic soundscape. Input: black-and-white image. Contour analysis turns the shape into parameters that drive sound.
Experiment 3. Bouba/kiki effect
2014 · OpenFrameworks
Köhler’s 1929 correspondence between word sound and geometric shape — a synaesthesia of sound and form. Round → low; angular → high. The AV composition follows the changing shape with sound.
Experiment 4. Square
2014 · OpenFrameworks · Max/MSP · Korg MS-20
Play the sides of a square in sequence. The line is the current rotation angle — the visualisation itself becomes a suprematist composition.
Experiment 5. Interaction of forms
2014 · OpenFrameworks · Max/MSP
Ideal sound changes when forms are set against each other, and again when a form is shifted in the same environment.
Forms (installation)
2016 · AV installation · projectors, grids, depth sensor · PROUN Continuum
AV performance «Cycle»
2015 · with Soma · «Цикл»
Sound and image where the visual feeds the music. Projection drives sound through computer-vision analysis of simple geometric forms.