From “Accompaniment” to “Event”: The Evolution of Conceptual Vocabulary in International Research on Audiovisual Synthesis

Pavel A. Michkov

Abstract


The article presents a historical and theoretical analysis of the evolution of conceptual vocabulary in international research on audiovisual synthesis and multimedia art. The development of approaches to the methodology of music analysis is traced from utilitarian “accompaniment” in early cinema to the interpretation of the musical component as an autonomous, dramaturgically active “event” in contemporary digital installations. The study focuses on the transformation of methodological approaches that developed in parallel with the increasing complexity of artistic practice. Key events in the chronology of the formation of the interdisciplinary language of science are summarised. The origins of the legitimisation of sonic reality in Francesco Balilla Pratella’s Futurist manifesto are examined along with Dziga Vertov’s early montage-based and polyphonic concepts of the “radio-ear.” Particular attention is drawn to Leonid Sabaneev’s first systematic musicological study, which anticipated the foundations of film semiotics through the categories of “aesthetic synchronisation” and the phenomenology of time. Michel Chion’s phenomenological approach is examined, in which the category of the “audiovisual contract” and the concept of “added value” provided a means of studying music not as a passive background, but as an active factor in the production of meaning. The trajectory culminates in Nicholas Cook’s model, which offers a structured musicological method for investigating multimodal perception. Cook systematically demonstrates that sound cannot be isolated from graphics and context, constructing a semantic typology of musical-visual relationships through the categories of conformance, contest and complementation. Emphasising the cognitive and integrative character of contemporary digital multimedia, which is rooted in Wagner’s concept of the Gesamtkunstwerk, the article concludes by advocating for a continual renewal of musicology’s analytical toolkit.

Keywords: multimedia, conceptual and categorical apparatus, audiovisual synthesis, Leonid Sabaneev, Michel Chion, Nicholas Cook, Louise Harris, polymodal perception, interaction between the arts, dramaturgy of sound event


Full Text:

PDF

References


Stravinsky I. Igor Stravinsky on Film Music. Musical Digest. 1946, vol. 28, no. 1, pp. 4–5, 35–36.

Kholopova V.N. The concept of “multimedia” in the music of Igor Kefalidi. Zhurnal Obshchestva teorii muzyki (Journal of the Music Theory Society). 2019, no. 4, pp. 10–17. (In Russ.)

Vertov D. Kinoglaz, radioglaz and the so-called “documentalism.” Proletarskoe kino (Proletarian cinema). 1931, no. 4, pp. 12–15. (In Russ.)

Sabaneev L. Music for the Films: A Handbook for Composers and Conductors. Transl. by S.W. Pring. London: Sir I. Pitman & Sons, 1935. 128 p.

Chion M. Audio-Vision: Sound on Screen. New York: Columbia University Press, 2019. 270 p.

Pinheiro S. Revisiting the Canon of Sound Theory. Iluminace. 2021, vol. 33, no. 1, pp. 141–147. https://doi.org/10.58193/ilu.1699

Poulakis N. Review of Audio-Vision: Sound on Screen (Second Edition). CINEJ Cinema Journal. 2020, vol. 8, no. 2, pp. 488–492. https://doi.org/10.5195/cinej.2020.289

Kon Yu.G. On the methodological foundations of Pierre Schaeffer’s theoretical views. Music Journal of Northern Europe. 2026, vol. 45, no. 1, pp. 1–28. (In Russ.) https://doi.org/10.61908/2413-0486.2026.45.1.1-28

Cook N. Analysing Musical Multimedia. Oxford: Clarendon Press, 1998. 304 p. https://doi.org/10.1093/oso/9780198165897.001.0001

Multimedia: From Wagner to Virtual Reality. Comp. and ed. by R. Packer, K. Jordan; foreword by W. Gibson. New York: W.W. Norton & Company, 2001. 394 p.

Kay A. User Interface: A Personal View. In: Multimedia: From Wagner to Virtual Reality. Ed. by R. Packer, K. Jordan. New York; London: W.W. Norton & Company, 2001, pp. 121–131.

Ascott R. Is There Love in the Telematic Embrace? In: Multimedia: From Wagner to Virtual Reality. Ed. by R. Packer, K. Jordan. New York; London: W.W. Norton & Company, 2001, pp. 305–316.

Harris L. Composing Audiovisually: Perspectives on Audiovisual Practices and Relationships. London: Routledge; New York: Focal Press, 2021. 228 p.




DOI: https://doi.org/10.56620/RM.2026.3.026-037

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.