運用Max／MSP／Jitter程式與Sobel運算並結合影像、聲音、MIDI音樂的互動以創作數位藝術作品

Employing Max/MSP/Jitter and Sobel Operations to Create Digital Art Works Based on the Interaction among Images, Sounds, and MIDI Music

在本論文中，我們展示一項數位藝術作品「幸福晚餐系列」。本作品是運用Max/MSP/Jitter程式與Sobel運算，並結合影像、聲音、MIDI音樂之間的互動以創作完成的。在本論文中，我們首先簡介新媒體藝術、數位藝術、科技藝術等，並簡單回顧在台灣的發展過程。接下來，我們介紹Max/MSP/Jitter這項新穎技術，愈來愈多新媒體藝術家，都開始嘗試運用Max協助他們的作品創作。本作品的製作流程包含下列諸步驟：分貝轉換、追蹤聲音訊號的音量峰值、自動事件偵測、使用聲音事件訊息、邊緣偵測、由聲音產生MIDI音樂、由聲音控制影像變化、自動變換影像RGB亮度等，我們將在論文中簡單介紹。本作品是很小品的互動藝術實驗創作。在這個短短片段中，作者記錄著回宿舍時，沿途期盼老婆準備的晚餐，那種幸福滿滿的感覺。在作品中，作者輸入廚房烹調的忙碌聲音，程式會依此自動產生一段MIDI旋律，畫面也會對應著產生不同節奏。於是，對於幸福晚餐的期待，紛紛化成了音符；而眼前的畫面，也都因此有了節奏。

This article presents a digital art work (The Felicitous Dinner Series). This work is created by using Max/MSP/Jitter and Sobel operations, and based on the interaction among images, sounds, and MIDI music. In this paper, we at first briefly introduce new media arts, digital arts, and technology arts, and review their development in Taiwan. And then, the brand new technology Max/MSP/Jitter is described because more and more new media artists begin to use them in their works. This work presented in this paper is created through the following steps: decibel transformation, tracing of the peak sound, automatic event detection, usage of sound event message, edge detection, generating MIDI music via sound signals, controlling the image processing via sound signals, automatic change of RGB brightness, and so on. These steps will be briefly described in this article.This is an interactive digital art work. In this video work, the author recorded the felicitous feeling of the expectation on the dinner prepared by his wife when he was on the road toward his dormitory. In this work, the author inputted the sound gathered when his wife was busy in the kitchen, and then the program automatically generated some MIDI music, and changed the image of the video so that it got some tempo. Therefore, the expectation on the felicitous dinner became some music notes, and all the sights became rhythmic.