Abstracts of Pythagoras Graduate School

Abstracts

Emergence of Musical Percepts in the Brain
Elvira Brattico

Cognitive Brain Research Unit, Department of Psychology, University of Helsinki
Supervisors: Doc. M. Tervaniemi, Ph.D, & Ac. Prof. R. Näätänen, Cognitive Brain Research Unit, Department of Psychology, University of Helsinki, Finland

Introduction. During the past two decades, studies dealing with physiological responses to music mainly employed paradigms in which the participants were asked to actively listen to some repeated sound sequences and, for example, to evaluate the appropriateness of the ending sounds to the preceding context. These studies show that the attended ending tones with a pitch, rhythm or harmony discrepant from the preceding context elicit larger brain responses than less discrepant ones. However, it is not clear how musical expectations are formed during ongoing listening. This is a crucial question since the ability to encode and integrate sounds over time is what enables us to appreciate music as such. Consequently, it is relevant not to overlook the neural processes that are at the basis of any conscious musical experience: the encoding over time of each sound characterized by its specific pitch, duration, timbre into a brief neural memory trace how its maintenance contributes to Gestalt formation, and, finally, how the percepts of the incoming sounds are modulated by the memory of the previous ones and the implicit knowledge of their structural organization.

Methods. The neural basis of listeners’ ability to perceive sounds as music can be investigated by measuring the event-related potentials (ERPs). In particular, the first cortical brain response to the incoming sounds is the N1, recorded at the vertex of the scalp and occurring at a latency of 100 ms. The N1 may be modulated by the sound context and can thus serve as a tool to study implicit knowledge of the musical structure by the listeners. Furthermore, the mismatch negativity (MMN) is useful to investigate the formation of sensory memory traces for the incoming sounds. The MMN is generated automatically, that is, even when the subject is involved in another task, by neuronal circuits in the primary and associative areas of the auditory cortex. It is typically elicited when in the sound stimulation an invariance (encoded into the neural memory trace) is established, after which the neural mismatch can be generated by the variant sound. This invariance can be simple (such a single sound), complex (a repeated melody), or hypercomplex (transposed melodies with same duration and contour).

Aims. In the present thesis it will be investigated how musical percepts emerge from the combinations of simple sounds: how two simple tones presented simultaneously generate different brain responses according to the frequency ratios of their components, how tone encoding of serially presented tones is affected by familiarity of their intervallic structure, or by melodic familiarity, even when this familiarity has been obtained during the experimental session. Finally, it will be studied how four sounds are automatically maintained into sensory memory as a unique musical motif, and how several motifs can be simultaneously stored giving rise to such complexity characterizing our musical listening experience. Moreover, it will be demonstrated that those processes occur automatically in the brain. In other words, listeners’ brain cannot encode incoming sounds without taking into account the knowledge of the sounds preceding them in the near past and of all the sounds that have been listened attentively or passively since birth.
These results will support the emerging view that musical experience is based on early, largely automatic, functions of the auditory system that dynamically store, in a way that is affected by past experience, separated sounds as integrated regularities of the acoustic environment.

References
Brattico, E., Näätänen, R., Tervaniemi, M. (2001). Context effects on pitch perception in musicians and non-musicians: Evidence from ERP recordings. Music Perception, 19: 1-24.

Brattico, E., Winkler, I., Näätänen, R., Paavilainen, P., Tervaniemi, M. (2002). Simultaneous storage of two complex temporal sound patterns in the human auditory sensory memory. NeuroReport, 13: 1747-1751.

Näätänen, R. & Winkler, I. (1999). The concept of auditory stimulus representation in cognitive neuroscience. Psychological Bulletin, 125: 826-859.

Tervaniemi, M., Huotilainen, M., Brattico, E., Reinikainen, K., Ilmoniemi, R. J., Alho, K. (in press). Event-related potentials to expectancy violation in musical context. Musicae Scientiae.

Twelve-tone rows and group theory: a thesis and a computer application
Tuukka Ilomäki

Sibelius Academy
Supervisors: Prof. M. Castren, Sibelius Academy

My doctoral thesis concerns the utilization of mathematics and group theory in particular in the study of twelve-tone rows and row operations. Past literature will be analyzed and a new approach will be described. Purpose of the study is to create a mathematization of the subject in which the mathematical concepts used reflect the characteristics of the objects under study better than in previous formulations.  The approach used also creates new ways of describing similarity between twelve-tone rows. Metrics, which is a concept borrowed from topology (another mathematical theory), will we applied to the existing concept of similarity measures.
In addition to the thesis, I will develop computer application. The application will encapsulate the theoretical ideas to be a handy tool for exemplifying the results of the theory and for being a test bench for new ideas.  A simple syntax and expression parser will be developed for easy expansibility of the application.

References

Virtual Instruments
Teemu Mäki-Patola

Telecommunications Software and Multimedia Laboratory, Helsinki University of Technology
Supervisors: Prof. Tapio "Tassu" Takala

Physical sound modeling is nowadays an active research area. The sound is produced in real-time, which makes it possible to alter any model parameter while playing. This creates a need for controllers that meet the sound model complexity by input flexibility.

Virtual reality input technology, such as data gloves and location/orientation trackers with gesture analyses, is one possibility to offer several degrees of freedom. My research deals with utilization of virtual reality technology for creating new interfaces for musical instruments, especially in combination with physical sound models.

The research aims to create guidelines for how the new medium (VR) can be used for sound control tasks. The effect of the features of the medium, such as lack of tactile feedback and high latency for music playing are studied through user tests. Other research issues are the feasibility of visual feedback to aid in learning to control an instrument, control parameters mappings and predictive algorithms for compensating the system latency.

Onother goal of the research is to create expressive user interfaces for algoritmic sound generation instruments as case studies. The interfaces utilize virtual reality input technology. Three different user interface methods are studied: gesture recognition (using data gloves and motion trackers), interaction with virtual objects (virtual widgets), conventional MIDI-devices and hybrids of the three. Applicability of artifial intelligence techniques for improving the performers control even further will also be explored. A configurable user interface test platform has already been implemented for a 4 wall, stereo projected virtual room.

Goal of the research is to create original and inspiring new ways for sound generation/playing as well as to create valuable enhanced/extended instruments. Two different target audiences will be considered: professional musicians and amateur entertainment.

References

The emotional functions of music in adolescence
Suvi Saarikallio

Department of Music, University of Jyväskylä, Finland
Supervisors: Prof. J. Louhivuori, Department of Music, University of Jyväskylä, Finland

My research concerns the psychological meanings of music in the everyday life of adolescents. The focus is on the emotion-related functions. The overall emotionality, as well as the need for emotion regulation, increases during the transitional period of adolescence, and music offers a profound way of enhancing emotional processing. Music is an integral part of adolescent life these days. However, the research about the emotional and psychological functions of music in adolescence is quite limited.

The aim of my study is to develop a comprehensive empirically based theory about the emotion-related purposes of engaging in musical activities in adolescence. To take into account the complexity of this phenomenon I will use a combination of qualitative and quantitative approaches by carrying out both interviews and a survey. The purpose is to find out the main emotional goals related to music in adolescence, and to discover how these goals may be supported by musical activities. The focus is on the individuals´ subjective experiences of their everyday musical behaviours.

References

Laiho, Suvi (2004). The Psychological Functions of Music in Adolescence. Nordic Journal of Music Therapy, 13 (1), pp.49-65.

Saarikallio, Suvi (2005). Regulation and Gratification: The Emotional Meanings of Music in Adolescence. Proceedings of the First European Conference on Developmental Psychology of Music, 17-19 November 2005, Jyväskylä, Finland.

The Impact of Musical Aptitude in Foreign Language Acquisition
Riia Milovanov

Department of English, University of Turku, Finland, & Centre for Cognitive Neuroscience, University of Turku, Finland.
Supervisors: Doc. M. Tervaniemi, Ph.D, Cognitive Brain Research Unit, Department of Psychology, University of Helsinki, Finland & Prof. M. Gustafsson, Ph.D, Department of English, University of Turku, Finland

When learning a new language, the differences between the phonetic systems of the target language and the native language often deteriorate performance in pronunciation and discrimination tasks of the target language. Näätänen (2001) suggested that proper neural models formed in the auditory cortex for the phonemes are a necessary prerequisite for the learning of the target language also in terms of pronunciation. Previously, a connection between the accuracy of cortical networks in representing musical sound pattern and the behaviorally determined musical aptitude was proposed (Tervaniemi et al. 1997).

Consequently, the relationship between language skills, musical aptitude, and cortical brain activity is under investigation in the present project. As a model of language skills, the efficacy of Finnish pupils in foreign (English) language acquisition and especially pronunciation is determined in relation to their musical aptitude.

The Finnish speakers with a musical aptitude were found to produce the various phonemes that occur in the English language better than other pupils (Milovanov, 2000). In the next stage of the project, event-related potential recordings in a mismatch negativity (MMN) paradigm will be used to determine whether the cortical networks in the musically talented subjects will represent the important sound features more readily than other pupils. Moreover, music for special needs will be discussed: students with dyslexia seem to benefit from music.

References
Milovanov, R. (2000). The Pronunciation of English by Finnish lower secondary school students: Musical aptitude and English pronunciation. Master’s thesis. Turku: University of Turku.

Näätänen, R. (2001). The perception of speech sounds by the human brain as reflected by the mismatch negativity (MMN) and its magnetic equivalent (MMNm). Psychophysiology, 38, 1-21.

Tervaniemi, M., Ilvonen, T., Karma, K., Alho, K., Näätänen, R. (1997). The musical brain: brain waves reveal the neurophysiological basis of musicality in human subjects. Neuroscience Letters, 226,1-4.

Generalized linear-in-parameter models - Theory and audio signal processing applications
Tuomas Henrik Paatero

Laboratory of Acoustics and Audio Signal Processing, Helsinki University of Technology
Supervisors: Prof. M. Karjalainen & Prof. V. Välimäki, Laboratory of Acoustics and Audio Signal Processing, Helsinki University of Technology

Following is a short description of the PhD thesis content:
II Mathematical means in signal processing - from conventional to somewhat advanced
Mathematical representation of signals, systems and transformations using function space descriptions (lightweight Function theory and Functional analysis)

III The generalized linear-in-parameter model concept
I've understood that you are nothing (in the engineering society) if you don't invent an abbreviation - mine is GLM, a synthetic and general framework for various signal processing tasks

IV Rational orthonormal structures
Rational orthonormal basis functions - a relatively new and unknown concept in signal processing. The revival of Kautz filters, a blast from the early days of network synthesis in the 1950's.

V Kautz filter implementation and design
Maybe the most important contribution of my work is that I've developed some new methods for the choosing of a particular Kautz filter. It can also be seen, more generally, as a new and powerful filter design tool, but this idea still needs some marketing.

VI Audio oriented applications
The Kautz filter has proven to be an effective way to model (or approximate) typical audio responses, such as, instrument body responses, room transfer functions and equalizers of loudspeaker responses - or more generally, any resonant linear time-invariant system.

VII Presentation of the MATLAB tool-box for Kautz filter design

An improved version of the existing site:
http://www.acoustics.hut.fi/software/kautz/kautz.htm

References?

Analysis, modeling and synthesis of plucked string instruments
Henri Penttinen

Laboratory of Acoustics and Audio Signal Processing, Helsinki University of Technology.
Supervisors: Prof. M. Karjalainen & Prof. V. Välimäki, Laboratory of Acoustics and Audio Signal Processing, Helsinki University of Technology

My post-graduate studies and research will concentrate on modeling plucked string instruments, including analysis and synthesis of plucked string instrument sounds. In this context modeling means that the behaviour of an instrument is imitated by mathematical means and implemented with a computer. Analysis here means that recordings and measurement data of a certain instrument is analyzed with a computer and relevant properties and variables are distracted. Synthesis again stands for producing audible signals, by the means of a model that resemble the target instrument as well as possible.

When an instrument is modeled, a rational goal is to mimic its behaviour and not only the waveform it produces. This way the source of the matter is modeled, hence, better control and expandability of the model is obtained, than in a case where only the waveform is coded (as in MP3). Instrument modeling has been an active field of research for a few decades now and the HUT acoustics laboratory where I work has a more than a decade of expertise in the field of plucked string instrument modeling. Regardless of this there are many subjects uncovered in the area of plucked string modeling and synthesis.

My research will concentrate on (I) modeling interactions in plucked string instruments, (II) model parameter estimation, and (III) modeling different string instruments. In practice this means measuring of different instruments, analyzing the data gathered during measurements, developing models for the target instrument, and developing software for automatic analysis. At the moment the instruments in sight are a new design of the Finnish kantele, acoustic guitar, harpsichord(/cembalo), and sitar.

References
Penttinen, H., Acoustic Timbre Enhancement of Guitar Pickup Signal with Digital Filters, Master's Thesis, 2002.

Smith, J. O., Physical Modeling Using Digital Waveguides, Computer Music Journal, 16(4): 74-91, 1992.

Karjalainen, M., Välimäki, V., and Tolonen, T., Plucked-String Models: from the Karplus-Strong Algorithm to Digital Waveguides and Beyond, Computer Music Journal, 22(3):17-32, 1998.


Feedback
Last Modified: 17.01.2006