Vincent Verfaille

Researcher in Music Technology

Address: Music Technology Area Department of Music Research Schulich School of Music − McGill University Strathcona Music Building 555, Sherbrooke Street West Montreal, Quebec, H3A 1E3 Canada E-mail: [email protected] (office) Web: http://www.music.mcgill.ca/musictech/spcl/vincent verfaille updated on: May 28, 2009

Vincent Verfaille

Researcher in Music Technology

Curriculum Vitae General Information Family name Verfaille First name Vincent Date of Birth: August 14, 1974 Place of Birth: Laval, France French nationality, permanent resident of Canada

University diplomas Sept, 2003

July, 2000 July, 1997 July, 1992

PhD in Music Technology (with Honours) − Acoustics, Signal Processing and Computer Science Applied to Music (ATIAM) Aix-Marseilles II University; LMA1 -CNRS2 − Marseilles, France Masters ATIAM (with Honours) Paris VI University − Paris, France Engineer Diploma in Applied Mathematics (with Honours) Institut National des Sciences Appliqu´ ees (INSA) − Toulouse, France Baccalaur´eat in Mathematics and Physics (with Honours) Lyc´ ee d'Avesni` eres − Laval, France

Music education 2000−02 1982−92

Conservatoire National de R´ egion − Marseilles, France Conservatoire National de R´ egion − Laval, France

electroacoustic music (unfinished) flute (unfinished)

National service 1998

Plum − New Caledonia

secouriste en infirmerie

Languages English French Espagnol

fluent mother tongue fluent

Research topics − − − − 1 2

digital audio effects and sound transformations in music applications digital sound synthesis models (additive, substractive) automatic and gestural control, mapping sound content description, psychoacoustic models, sound representation spaces

LMA: Laboratoire de M´ecanique et d'Acoustique CNRS: Centre National de la Recherche Scientifique

2

Vincent Verfaille

Researcher in Music Technology

Professional Experience Scientific research Sept. 2008−May, 2009: research associate (part-time) place: SPCL3 & IDMIL4 / CIRMMT5 , McGill University collaborator: Prof. Marcelo M. Wanderley & Philippe Depalle projects: Consonnes: direct and indirect acquisition of gestures producing harmonic notes on the flute, sonification of musicians' ancillary gestures, physically-controlled synthesis, vibrato models May−Nov. 2008: place: collaborator: projets:

research consultant (180h) LIAM6 / OICCM7 , University of Montreal Prof. Caroline Traube acoustical analyses of timbre modulations produced by phonetic gestures

Nov. 2003−Aug. place: supervisors: projects:

2008: post-doctoral research fellow SPCL & IDMIL / CIRMMT, McGill University Prof. Philippe Depalle & Marcelo Wanderley Ssynth (additive/subtractive synthesis and mapping for gestural control), Consonnes, vibrato models

Sept. 2000−Sept. 2003: PhD student LMA-CNRS, Marseilles, France place: supervisor: Daniel Arfib, Research Director at CNRS projects: adaptive digital audio effects Sept. 1999−Aug. place: supervisors: projects:

2000: DEA student (Masters) Sup'T´el´ecom & Paris VI University, Paris, France Prof. Maurice Charbit & Pierre Duhamel Time-frequency likelihood analysis

Teaching Jan.−April, 2009 title: MUS3322/6322: Organology and musical acoustics (in french) type: 40h research seminar; replacing Prof. Caroline Traube place: Universit´e de Montr´eal (Music Faculty) public: bachelor, master and doctorate students in Musicology, Composition and Performance Sept 30, 2008 title: Digital audio effects and sound transformations (in french) type: 3h lecture; in Cl´eo Palacio-Quintin's MUS3323 seminar place: Universit´e de Montr´eal (Music Faculty) public: bachelor, master and doctorate students in Electroacoustic Composition Sept. 2005−Dec. 15, 2006 title: MUMT605a: Digital Sound Synthesis and Audio Processing (in english) 3

SPCL: Sound and Processing laboratory IDMIL: Input Devices and Musical Interaction Laboratory 5 CIRMMT: Centre for Interdisciplinary Research in Music, Media & Technology 6 LIAM: Laboratoire informatique, acoustique et musique 7 OICCM: Observatoire international de la cr´eation et des cultures musicales 4

3

Vincent Verfaille type: place: public:

Researcher in Music Technology

39h seminar; replacing Prof. Philippe Depalle McGill University (Schulich School of Music) master and PhD students in Music Technology

Nov. 24, 2004; Dec. 1, 2005; March 24, 2008; March 25, 2009 title: Adaptive Digital Audio Effects (in english) type: 3h seminar; in Prof. Philippe Depalle's MUMT605a seminar place: McGill University (Schulich School of Music) public: master and PhD students in Music Technology Dec. 12−22, 2005; Dec 11−19, 2006 title: Digital Audio Effects and Sound Transformations (in french) type: 2006: 16h lecture + 8h computer practice session 2005: 12h lecture + 8h computer practice session place: ENSEIRB8 & Computer Science Master (Multimedia), Bordeaux I University, France public: master and engineer students in Multimedia Dec. 06−17, 2004 title: Digital Audio Effects (in french) type: 5h lecture place: Bordeaux I University, France; Prof. Sylvain Marchand's seminar public: master students in Multimedia March 30, 2004 title: Digital Audio Effects and Control (in french) type: 1h lecture place: Universit´e de Montr´eal (Music Faculty); Caroline Traube's MUS2312 seminar public: bachelor students in Electroacoustic Composition Jan. 06−17, 2003; Dec. 8−19, 2003; Dec. 12−22, 2004 title: Digital Audio Effects and Sound Transformations (in french) type: 14h lecture + 8h computer practical session ENSEIRB, Bordeaux, France place: public: engineer students in Multimedia

Students Co-supervision − students in Licence (equivalent to bachelor) at LMA-CNRS, Marseilles, France, Sept. 2000−Sept. 2003 − masters and PhD students at SPCL & IDMIL, McGill , Nov. 2003−May 2009

Research projects Consonnes: Control of Natural and Synthetic Sounds (Jan. 2006−July 2009) Place Funding Context Supervision Publications 8

SPCL & IDMIL / CIRMMT, McGill University MDEIE PSR-SIIRI (Quebec) & ANR (France) post-doctoral fellowship (April 2006−Aug. 2008), Research Associate since Prof. Marcelo Wanderley and Philippe Depalle [7–9, 11–13, 19, 20, 27–29, 31, 34]

´ ´ ENSEIRB: Ecole Nationale Sup´erieure d'Electronique, d'Informatique et de Radiocommunications de Bordeaux

4

Vincent Verfaille Topics

Researcher in Music Technology − − − −

indirect acquisition of harmonic notes producing gestures on the flute [9, 13] comparison of direct and indirect acquisition of gestures (case of flute) indirect acquisition of vowels used by flutists to change timbre (with Caroline Traube) vibrato study for wind, wood, brass and string instruments (with Catherine Guastavino); development and perceptual evaluation of a high-level signal processing vibrato model, accounting for modulations of amplitude, frequency and spectral envelope [7, 11, 19, 34] − physically-controlled synthesis: combining physical models and additive synthesis to improve sound quality and controlability [8, 12] − sonification of musicians' ancillar gestures [1, 20, 27–29, 31]

Interpolation/extrapolation of musical playing for digital instrument (Nov. 2003−March 2007) Place SPCL & IDMIL / CIRMMT, McGill University Funding FQRNT, FQRSC (Qu´ebec) & NSERC (Canada) Supervision Prof. Philippe Depalle and Marcelo Wanderley Context post-doctoral fellowship Related publications: [22, 23, 38] Topics − study of mappings in the context of digital music instruments and their gestural control − study of additive synthesis and sound transformations in the additive model [22] − study of methods for converting spectral envelope representations (auto-regressive coefficients, cepstral coefficients, autocorrelation fonction, formants) [23, 38] − development of the Ssynth software [23, 38] : additive/substractive synthesizer with gestural control via Open Sound Control (OSC) and advanced morphing functions (C with Python interface to the Pure Data (Pd) and Max/MSP softwares; Matlab prototyping)

A-DAFx: Adaptive Digital Audio Effects (Sept. 2000−Sept. 2003) Place LMA-CNRS, Marseilles, France Funding CNRS, R´egion Provence-Alpes Cˆote d'Azur (France) Supervision Daniel Arfib Context PhD thesis Thesis title ``Adaptive Digital Audio Effects: Theory, Implementation and Use in Music Creation'' Related publications: [21, 26, 32, 33, 35, 37, 39–47] Topics − exhaustive overview of all digital audio effects and their control [21, 33, 37, 42] − definition of adaptiveness of effects: automatic control using sound features [39, 47] − overview of sound features that allow for this adaptive control [43, 47] − study and formalization of the mapping model of adaptive digital audio effects [32, 40, 44] This − study of digital audio effects classifications, from a pedagogical point of view [26] − software development of a new class of sound effects and transformation, with adaptive control [41, 45, 46]; realtime implementation using the AudioUnit format [35] research project was awarded by a PhD Thesis Award (Prix de la Th`ese) from Le Monde de l'´ education in 2004 (see the Awards and [21] in the Publication sections).

5

Vincent Verfaille

Researcher in Music Technology

Quarter-tone time-frequency-likelihood analysis (Feb.−Sept. 2000) Place Image and Signal Processing Department, Sup'T´el´ecom Paris (ex-ENST), France Funding Sup'T´el´ecom Paris (France) Supervision Pierre Duhamel and Maurice Charbit Context DEA (Masters) research internship Thesis title ``Quarter-tone time-frequency-likelihood analysis, in the context of automatic music transcription'' Related publications: [48, 49] Topics − time-frequency-like representation − quarter-tone filterbank selectivity − temporal and frequential detection of partials using likelihood estimation

Publications Book Chapters [21]

Vincent Verfaille. “Les chemins de la d´ecouverte”. In: Paris, France: Nayla Farouki Ed, Presses Universitaires de France, 2006. Chap. Des contrˆoles intelligents pour les effets audionum´eriques adaptatifs, pp. 59–73.

[41]

Anne S´ed`es, Benoˆıt Courribet, Jean-Baptiste Thi´ebaut, and Vincent Verfaille. “Espaces Sonores -- Actes ´ de Recherches”. In: CICM - Editions Musicales Transatlantiques, Paris, 2003. Chap. Visualisation de l'Espace Sonore, vers la Notion de Transduction: une Approche Int´eractive Temps-R´eel, pp. 125–43. ´ Vincent Verfaille. “Espaces Sonores -- Actes de Recherches”. In: CICM - Editions Musicales Transatlantiques, Paris, 2003. Chap. Utilisation d'espaces perceptifs pour la synth`ese et la transformation sonore, pp. 39–54.

[43]

Peer-Reviewed Journal Papers [2] Vincent Verfaille, Philippe Depalle, and Marcelo M. Wanderley. “Indirect acquisition of harmonic note fingerings on the flute using spectral analysis”. In: Journal of the Acoustical Society of America (2009). submitted. [14] [19]

Vincent Verfaille. “A new package for conference proceedings”. In: The PracTeX Journal Issue 4 (2007). ´ Vincent Verfaille, Catherine Guastavino, and Philippe Depalle. “Evaluation de mod`eles de vibrato”. In: Cahiers de la Soci´ et´ e Qu´ eb´ ecoise de Recherche en Musique 9.1/2 (2007). Pp. 49–62.

[32]

Vincent Verfaille, Marcelo M. Wanderley, and Philippe Depalle. “Mapping Strategies for Gestural and Adaptive Control of Digital Audio Effects”. In: Journal of New Music Research 35.1 (2006). Pp. 71–93.

[33]

Vincent Verfaille, Udo Z¨olzer, and Daniel Arfib. “Adaptive Digital Audio Effects (A-DAFx): A New Class of Sound Transformations”. In: IEEE Transactions on Audio, Speech and Language Processing 14.5 (2006). Pp. 1817–1831. ` Xavier Amatriain, Jordi Bonada, Alex Loscos, Josep Lluis Arcos, and Vincent Verfaille. “Content-based Transformations”. In: Journal of New Music Research 32.1 (2003). Pp. 95–114.

[39] [44]

Daniel Arfib, Jean-Michel Couturier, Loic Kessous, and Vincent Verfaille. “Strategies of mapping between gesture parameters and synthesis model parameters using perceptual spaces”. In: Organised Sound 7.2 (2002). Pp. 135–52.

6

Vincent Verfaille

Researcher in Music Technology

Peer-Reviewed Conference Papers [12]

Philippe Guillemain and Vincent Verfaille. “Combining Physical Modeling and Additive Synthesis as a Mapping Strategy for Realtime Control”. In: Proceedings of the International Computer Music Conference (ICMC'07). Vol. I. Copenhagen, Denmark 2007. Pp. 442–9.

[13]

Corey Kereliuk, Bertrand Scherrer, Vincent Verfaille, Philippe Depalle, and Marcelo M. Wanderley. “Indirect Acquisition of Fingerings of Harmonic Notes on The Flute”. In: Proceedings of the International Computer Music Conference (ICMC'07). Vol. I. Copenhagen, Denmark 2007. Pp. 263–6.

[23]

Vincent Verfaille, Julien Boissinot, Philippe Depalle, and Marcelo M. Wanderley. “Ssynth: a Real Time Additive Synthesizer With Flexible Control”. In: Proceedings of the International Computer Music Conference (ICMC'06). New Orleans, US 2006.

[26]

Vincent Verfaille, Catherine Guastavino, and Caroline Traube. “An Interdisciplinary Approach to Audio Effect Classification”. In: Proceedings of the 9th International Conference on Digital Audio Effects (DAFx-06). Montr´eal, Canada: Verfaille, Vincent Ed., 2006. Pp. 107–13.

[28]

Vincent Verfaille, Oswald Quek, and Marcelo M. Wanderley. “Sonification of Musicians' Ancillary Gestures”. In: Proceedings of the Eleventh International Conference on Auditory Display. London, UK 2006. Pp. 194–7.

[34]

Vincent Verfaille, Catherine Guastavino, and Philippe Depalle. “Perceptual Evaluation of Vibrato Models”. In: Colloquium on Interdisciplinary Musicology, Montr´ eal (CIM'05). Montreal (Qc), Canada 2005.

[37]

Vincent Verfaille and Philippe Depalle. “Adaptive Effects Based on STFT, Using a Source-Filter Model”. In: Proceedings of the 7th International Conference on Digital Audio Effects (DAFx-04). Naples, Italy: Gianpaolo Evangelista & Italo Testa Eds., 2004. Pp. 296–301.

[40]

Daniel Arfib and Vincent Verfaille. “Driving Pitch-Shifting and Time-Scaling Algorithms with Adaptive and Gestural Techniques”. In: Proceedings of the 6th International Conference on Digital Audio Effects (DAFx-03). London, England 2003. Pp. 106–11.

[45]

Vincent Verfaille. “R´ealisation d'effets audionum´eriques adaptatifs en temps r´eel et hors temps r´eel”. In: Proceedings of the Journ´ ees d'Informatique Musicale (JIM'02), Marseille. 2002. Pp. 33–9.

[46]

Vincent Verfaille and Daniel Arfib. “Implementation Strategies for Adaptive Digital Audio Effects”. In: Proceedings of the 5th International Conference on Digital Audio Effects (DAFx-02). Hamburg, Germany: Udo Z¨olzer, Udo Ahlvers & Florian Keiler Eds., 2002. Pp. 21–6.

[47]

Vincent Verfaille and Daniel Arfib. “ADAFx: Adaptive Digital Audio Effects”. In: Proceedings of the 4th COST-G6 Workshop on Digital Audio Effects (DAFx-01). Limerick, Ireland: Mikael Fernstr¨om, Eoin Brazil & Mark Marshall Eds., 2001. Pp. 10–4.

[48]

Vincent Verfaille, Maurice Charbit, and Pierre Duhamel. “LiFT: Likelihood-Frequency-Time Analysis for Partial Tracking and Automatic Transcription of Music”. In: Proceedings of the 4th COST-G6 Workshop on Digital Audio Effects (DAFx-01). Limerick, Ireland: Mikael Fernstr¨om, Eoin Brazil & Mark Marshall Eds., 2001. Pp. 82–6.

Conference Abstracts [1]

Florian Grond, Thomas Hermann, and Marcelo M. Verfaille Vincent andWanderley. “Methods for effective ancillary gesture sonification of clarinetists”. In: 8th International Gesture Workshop. 2009.

[7]

Vincent Verfaille, Catherine Guastavino, and Philippe Depalle. “Control parameters of a generalized vibrato model with modulations of harmonics and residual”. In: Journal of the Acoustical Society of America 123.5 (2008). P. 3746.

7

Vincent Verfaille

Researcher in Music Technology

[8] Vincent Verfaille, Arnaud Rebillout, Philippe Guillemain, and Marcelo M. Wanderley. “Refining mapping strategies to improve the sound quality of physically-controlled synthesis”. In: Journal of the Acoustical Society of America 123.5 (2008). P. 3658. [9] Vincent Verfaille, Marcelo M. Wanderley, and Philippe Depalle. “Indirect acquisition of flutist gestures: a case study of harmonic note fingerings”. In: Journal of the Acoustical Society of America 123.5 (2008). P. 3796. [11]

Catherine Guastavino and Vincent Verfaille. “Perceptual Evaluation of Vibrato Features: The Case of Saxophone Sounds”. In: Symposium on Music Perception and Cognition. Montreal (Qc), Canada 2007.

[20]

Louise Campbell, Vincent Verfaille, Marie-Julie Chagnon, Oswald Quek, and Marcelo M. Wanderley. “Different Approaches to the Understanding of Expressive Movements of Clarinetists”. In: Second Int. Conf. on Music and Gesture. Manchester, UK 2006.

[22]

Vincent Verfaille, Julien Boissinot, Philippe Depalle, and Marcelo M. Wanderley. “Ssynth: a Real Time Additive Synthesizer With Flexible Control”. In: ENACTIVE Workshop. Montreal (Qc), Canada 2006.

[27]

Vincent Verfaille, O. Quek, and Marcelo M. Wanderley. “Sonification des Gestes Accompagnateurs des Clarinettistes”. In: Congr` es de l'Association francophone pour le savoir (ACFAS). McGill University, Montreal (Qc), Canada 2006.

[29]

Vincent Verfaille, Oswald Quek, and Marcelo M. Wanderley. “Sonification of Musicians' Ancillary Gestures”. In: ENACTIVE Workshop. Montreal (Qc), Canada 2006.

[31]

Vincent Verfaille and Marcelo M. Wanderley. “Mapping strategies for sound synthesis, digital audio effects and sonification of performer gestures”. In: Acoustical Society of America Meeting. Rhodes Island (NY) 2006.

Theses [42]

Vincent Verfaille. “Effets Audionum´eriques Adaptatifs: Th´eorie, Mise en Œuvre et Usage en Cr´eation Musicale Num´erique”. PhD thesis. Marseille, France: Universit´e Aix-Marseille II, 2003.

[49]

Vincent Verfaille. “DEA ATIAM: Plan Vraisemblance Temps-Fr´equence”. MA thesis. Paris, France: Universit´e Paris VI, 2000.

Technical Reports [15]

Vincent Verfaille. Report on the Making of the DAFx-06 Proceedings. Tech. rep. Montreal (Qc), Canada: SPCL/IDMIL, Schulich School of Music, McGill University, 2007.

[16]

Vincent Verfaille. The Confproc Package. Tech. rep. CTAN, 2007.

[35]

Vincent Verfaille and D. Lebel. AUvolution: Implementation of Adaptive Digital Audio Effects Using the AudioUnit Framework. Tech. rep. Montreal (Qc), Canada: SPCL, McGill University, Faculty of Music, 2005.

[38]

Vincent Verfaille, Philippe Depalle, and Marcelo M. Wanderley. Enactive WP4: Digital Sound Synthesizers. Tech. rep. Montreal (Qc), Canada: SPCL, Faculty of Music, McGill University, 2004.

8

Vincent Verfaille

Researcher in Music Technology

Grants 04/2007 07/2005 2004

09/2002 06/2001 04/2001 07/2000

61.000 CA$ (with Prof. Wanderley), from MDEIE (Quebec), PSR-SIIRI program for participating to the french ANR-funded Consonnes project 4.000 e, Initiatives Post-Doc program: initiating collaborations with French laboratories PhD Thesis Award (Prix de la Th` ese) from Le Monde de l'´ education for the A-DAFx research; publication of a chapter about adaptive digital audio effects [21] edited by the Presses Universitaires de France and Le Monde de l'´education, collection Partage du Savoir) 260 e, Aix-Marseille II University: professional insertion workshop (Doctoriales) for PhD students 400 e, COST-G6 program: participating to the DAFx'01 Workshop in Madrid 900 e,, COST-G6 program: short-term scientific mission at MTG IUA-UPF, Barcelona, Spain 42.000 e, 3 years Doctor-Engineer PhD grant (Bourse Docteur-Ing´enieur) from CNRS and the Provence-Alpes-Cˆote-d'Azur Region

Involvment in the Scientific Community Administrative tasks 09/2008−08/2009 21/02/2008 12/12/2007 09/2005−09/2006 09/2001−10/2003 09/1999−08/2000

co-paper chair and proceedings editor Int. Computer Music Conference (ICMC 2009) McGill University co-organizer of the Wind Instrument Workshop for Consonnes−OICCM−CIRMMT McGill University co-organizer of a Workshop on the transverse flute (in french) for CIRMMT−OICCM University of Montreal co-organizer: secretary, web site, proceedings editor Int. Conference on Digital Audio Effects (DAFx-06) McGill University student representative during the PhD Aix-Marseilles II University, France student representative during the Master Paris VI University, France

Memberships 2003−2008 2005−2008 2006−2007 2001−03, 2008

CIRMMT (student member) ICMA (International Computer Music Association) IEEE (Institute of Electrical and Electronic Engineers) SFA (French Acoustical Society)

Paper reviews revues conferences

IEEE Transactions on Acoustics, Speech and Signal Processing International Conference on Digital Audio Effects (DAFx), International Computer Music Conference (ICMC), International Conference on New Instrument for Musical Expression (NIME),International Conference on Music Information Retrieval (ISMIR)

9

Vincent Verfaille

Researcher in Music Technology

LATEX Tools I provided to the user community, related to scientific publication: 29/01/2008 LATEX workshop for advanced users at CIRMMT McGill University 09/2007 `confproc' package at CTAN, to build conference proceedings [14–16] (based on the DAFx-06 experience) 02/2005 LATEX proceedings style for the Colloquium on Interdisciplinary Musicology (CIM'05)

References RISSET Jean-Claude, Directeur de Recherche CNRS e´m´ erite (B.Sc., M.Sc., Ph.D.) and composer Gold Medal of the CNRS (French National Centre for Scientific Research) in 1999 Ars Electronica 1987, Concours International de Bourges in 1980 and 1998 French grand prix national de la musique in 1990 Laboratoire de M´ecanique et d'Acoustique (LMA−CNRS), Marseille, France [email protected] DEPALLE Philippe, Associate Professor (B.Sc., M.A., D.E.A., Ph.D.) William Dawson Scholar Sound Processing and Control Laboratory Schulich School of Music, McGill University, Montr´eal, Canada [email protected] ¨ ZOLZER Udo, Professor (Univ.-Prof. Dr.-Ing. habil.) Author of Digital Audio Signal Processing, John Wiley & Sons, 1997 Editor and co-autor of DAFx: Digital Audio Effects, John Wiley & Sons, 2002 Dept. of Signal Processing and Communications Helmut Schmidt University University of the Federal Armed Forces Hamburg, Hamburg, Germany [email protected] WANDERLEY Marcelo, Assistant Professor (E.Eng., M.Eng., Ph.D.) FQRNT Strategic Professor-Researcher 2002-2005 Music Technology Area Chair Input Device for Musical Instruments Laboratory Sound Processing and Control Laboratory Schulich School of Music, Music Technology Area, McGill University, Montr´eal, Canada [email protected] DUHAMEL Pierre, Directeur de Recherche CNRS (B.Sc., Ing. INSA, Dr-Ing., Ph.D.) IEEE senior member since 1987, Fellow IEEE since 1998 Co-recipient of the best paper award of the IEEE Transactions on Signal Processing in 1998 Winner of the Grand Prix France T´ el´ ecom of the French ACA$´ emie des Sciences in 2000 Laboratoire Syst` emes et Signaux (L2S , Sup´elec & CNRS) CNRS-LSS, Sup´elec, Gif-sur-Yvette, France [email protected] ARFIB Daniel, Directeur de Recherche CNRS (B. Sc., Ing. ECP, Dr-Ing., Ph.D.) and composer Initiator of the European COST-G6 project about Digital Audio Effects (1998 − 2001) Laboratoire de M´ecanique et d'Acoustique (LMA−CNRS), Marseille, France arfi[email protected]

10