Jerome Urbain holds an electrical Engineering degree from FPMs (2006). He did his master's thesis at Lehigh University (USA) in the field of sleep study.
He is currently pursuing a PhD thesis on emotional speech recognition, and more especially on the acoustics of laughter (modeling, production, recognition), in the framework of the CALLAS project.
Short bio
Jérôme Urbain received the Master degree in Electrical Engineering from
FPMs in 2006. During his studies, he was involved in a Research project
at UPC in Barcelona, aiming at finding prominent words in speech. He
did his Master thesis work at Lehigh University (Pennsylvania, USA) in the sleep processing field and in particular about the discrimination
between sleep and wake using actigraphy. In september 2006 he joined the Circuit Theory and Signal Processing Lab of FPMs, which is now part of the
University of Mons. He first worked on sleep stages classification in the framework of the
DREAMS project. In January 2007, he moved to the
CALLAS project.
The aims of the project are to develop affective new media, with a focus on arts and entertainement. Within the CALLAS project, Jérôme is principally involved
in the integration of a Speech recognition component and is doing research on acoustic laughter processing (classification, recognition, copy-synthesis), which
is the subject of the PhD he is carrying out.
AVLaughterCycle Database:
The AVLaughterCycle database has been recorded in the framework of the eNTERFACE'09 AVLaughterCycle project. Its objective was to build an
audiovisual laughter database, combining audio and accurate facial motion tracking. It is the first laughter database combining these 2 signals.
To obtain a robust facial motion tracking, it was decided to use facial motion tracking techniques using markers placed on the subject's face.
In consequence, subjects knew they were being recorded. An induction method was used to elicit spontaneous laughter.
It consisted in a funny video lasting around 10 minutes. The subjects' reactions while watching the video were recorded.
At the end of the video, the subject was instructed to perform one acted laughter.
The database contains about 1000 laughs of variable shapes (length, acoustic content, etc.).
It also contains other sounds (speech, breath, ...) but in lower quantities.
For the moment, audio recordings as well as the first round of annotation for each file can be downloaded from this page.
Video recordings can be obtained upon request. To get a DVD copy, please contact me.
The data can only be used for reserch purposes. Data may not be redistributed nor publicly broadcasted.
The database can be useful for a broad range of research topics: audio/video laughter recognition, modeling or synthesis;
the synchronization between the 2 modalities; analyses of the differences between spontaneous and acted laughter (even if the number of acted
laughter is much lower than the numpber of spontaneous ones); studies about the succession of laughter during the video; mesuring
diffrences between individuas; etc.
More information can be obtained from the AVLaughterCycle Database README.
The database can be downloaded from this link.
^ Top ^
AVLaughterCycle Database Phonetic annotation:
Added on April 19, 2011.
You can now access the detailed phonetic annotation of the AVLaughterCycle database.
We suggest you first read this README file.
The files can be downloaded with the following links:
Examples of non IPA labels (hum, cackle, groan, snore, vocal fry and grunt).
Database phonetic annotations.
Segmented laughs.
^ Top ^
Groups :
^ Top ^
Publications :
Regular Papers in Journals
2010
   
J. URBAIN, R. NIEWIADOMSKI, E. BEVACQUA, T. DUTOIT, A. MOINET, C. PELACHAUD, B. PICART, J. TILMANNE, J. WAGNER, 2010,
"AVLaughterCycle - Enabling a virtual agent to join in laughing with a conversational partner using a similarity-driven audiovisual laughter animation",
Journal on Multimodal User Interfaces (JMUI),
Volume 4, Number 1, pp. 47-58, DOI: 10.1007/s12193-010-0053-1.
2009
J. TILMANNE, J. URBAIN, M.V. KOTHARE, A. VANDE WOUWER, S.V. KOTHARE, 2009,
"Algorithms for sleep-wake identification using actigraphy: a comparative study and new results",
Journal of Sleep Research,
2009, Volume 18, pp 85-98.
Papers in Conference Proceedings
2011
T. DRUGMAN, J. URBAIN, T. DUTOIT, 2011,
"Assessment of Audio Features for Automatic Cough Detection",
19th European Signal Processing Conference (Eusipco11),
August 29th - September 2nd, Barcelona, Spain.
2010
J. URBAIN, E. BEVACQUA, T. DUTOIT, A. MOINET, R. NIEWIADOMSKI, C. PELACHAUD, B. PICART, J. TILMANNE, J. WAGNER, 2010,
"La base de données AVLaughterCycle",
Actes des 28emes Journées d'Etude sur la Parole (JEP 2010),
pages 61-64, 25-28 mai, 2010, Mons, Belgique.
J. URBAIN, E. BEVACQUA, T. DUTOIT, A. MOINET, R. NIEWIADOMSKI, C. PELACHAUD, B. PICART, J. TILMANNE, J. WAGNER, 2010,
"The AVLaughterCycle Database",
Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10),
pp. 2996-3001, European Language Resources Association (ELRA), May 19-21, Valletta, Malta.
2009
S. DUPONT, T. DUBUISSON, J. URBAIN, R. SEBBE, N. D'ALESSANDRO, C. FRISSON, 2009,
"AudioCycle : Browsing Musical Loop Libraries",
in Proc. of IEEE Content Based Multimedia Indexing Conference (CBMI09),
Chania, Greece, June 2009.
J. URBAIN, T. DUBUISSON, S. DUPONT, C. FRISSON, R. SEBBE, N. D'ALESSANDRO, 2009,
"Audiocycle: a similarity-based visualization of musical libraries",
Proceedings of ICME 2009,
pp. 1847-1848.
J. URBAIN, E. BEVACQUA, T. DUTOIT, A. MOINET, R. NIEWIADOMSKI, C. PELACHAUD, B. PICART, J. TILMANNE, J. WAGNER, 2009,
"AVLaughterCycle: An audiovisual laughing machine",
Proceedings of the 5th International Summer Workshop on Multimodal Interfaces - eNTERFACE'09,
pp. 79-87, July 13th - August 7th.
S. AL MOUBAYEB, M. BAKLOUTI, M. CHETOUANI, T. DUTOIT, A. MAHDHAOUI, J-C MARTIN, S. ONDAS, C. PELACHAUD, M YILMAZ, J. URBAIN, 2009,
"Generating Robot/Agent Backchannels During a Storytelling Experiment",
Proceedings of 2009 IEEE International Conference on Robotics and Automation,
May 12 - 17, 2009, Kobe, Japan.
S.W. GILROY, M. CAVAZZA, M. NIRANEN, E. ANDRE, T. VOGT, J. URBAIN, M. BENAYOUN, H. SEICHTER, M. BILLINGHURST, 2009,
"PAD-based multimodal affective fusion",
In 2009 International Conference on Affective Computing and Intelligent Interaction,
Amsterdam, The Netherlands, September 10-12, IEEE.
J. URBAIN, S. DUPONT, R. NIEWIADOMSKI, T. DUTOIT, C. PELACHAUD, 2009,
"Towards a virtual agent using similarity-based laughter production",
in Proc. of Interdisciplinary Workshop on Laughter and other Interactional Vocalisations in Speech,
Berlin, February 27-28, 2009.
2008
S.W. GILROY, M. CAVAZZA, R. CHAIGNON, S.M. MAKELA, M. NIRANEN, E. ANDRE, T. VOGT, J. URBAIN, H. SEICHTER, M. BILLINGHURST, M. BENAYOUN, 2008,
"An affective model of user experience for interactive art",
In Proceedings of the 2008 international Conference on Advances in Computer Entertainment Technology (ACE'08),
December 3-5, 2008, Yokohama, Japan. vol. 352. ACM, New York, NY, 107-110.
S.W. GILROY, M. CAVAZZA, R. CHAIGNON, S.M. MAKELA, M. NIRANEN, E. ANDRE, T. VOGT, J. URBAIN, M. BILLINGHURST, H. SEICHTER, M. BENAYOUN, 2008,
"E-tree: emotionally driven augmented reality art",
In Proc. ACM Multimedia,
pages 945-948, Vancouver, BC, Canada.
S. AL MOUBAYEB, M. BAKLOUTI, M. CHETOUANI, T. DUTOIT, A. MAHDHAOUI, J-C MARTIN, S. ONDAS, C. PELACHAUD, J. URBAIN, M YILMAZ, 2008,
"Multimodal Feedback from Robots and Agents in a Storytelling Experiment",
Proc. eNTERFACE08,
Paris, pp. 43-55.
2007
J. TILMANNE, J. URBAIN, M.V. KOTHARE, A. VANDE WOUWER, S.V. KOTHARE, 2007,
"Actigraphy as a way of distinguishing sleep from wake",
Proceedings of the 26th Benelux Meeting on Systems and Control,
March 13-15, 2007, Lommel, Belgium, p 61.
F. CHARLES, S. LEMERCIER, T. VOGT, N. BEE, M. MANCINI, J. URBAIN, M. PRICE, E. ANDRE, C. PELACHAUD, M. CAVAZZA, 2007,
"Affective Interactive Narrative in the CALLAS Project",
ICVS2007,
Saint-Malo, France, 5-7 Dec 2007.
J. TILMANNE, J. URBAIN, M.V. KOTHARE, A. VANDE WOUWER, S.V. KOTHARE, 2007,
"Algorithms for sleep-wake identification using actigraphy: a comparative study and new results",
Proceedings of the 21st annual meeting of the associated professional sleep societies,
June 9-14, 2007, Minneapolis, USA.
Technical Reports
2011
S. DUPONT, C. FRISSON, J. URBAIN, S. MAHMOUDI, X. SIEBERT, 2011,
"MediaBlender: Interactive Multimedia Segmentation",
QPSR of the numediart research program,
volume 4, n° 1, pp. 1-6, March 2011.
2009
J. URBAIN, E. BEVACQUA, T. DUTOIT, A. MOINET, R. NIEWIADOMSKI, C. PELACHAUD, B. PICART, J. TILMANNE, J. WAGNER, 2009,
"AVLaughterCycle: An audiovisual laughing machine",
QPSR of the numediart research program,
volume 2, n° 3, pp. 97-104, September 2009.
S. DUPONT, T. DUBUISSON, J.A. MILLS III, A. MOINET, X. SIEBERT, D. TARDIEU, J. URBAIN, 2009,
"LaughterCycle",
QPSR of the numediart research program,
volume 2, n° 2, pp. 23-32, June 2009.
2008
S. DUPONT, N. D'ALESSANDRO, T. DUBUISSON, C. FRISSON, R. SEBBE, J. URBAIN, 2008,
"AudioCycle : Browsing Musical Loops Libraries",
QPSR of the numediart research program,
volume 1, n° 4, December 2008.
S. AL MOUBAYEB, M. BAKLOUTI, M. CHETOUANI, T. DUTOIT, A. MAHDHAOUI, J-C MARTIN, S. ONDAS, C. PELACHAUD, J. URBAIN, M YILMAZ, 2008,
"Project #3.4: MultimodalFeedback from Robots and Agents in a Storytelling Experiment",
QPSR of the numediart research program,
volume 1, n° 3, September 2008.
^ Top ^
|
