Development of midi encoder "auto-f" for creating midi controllable general audio contents

The MIDI interface is originally designed for electronic musical instruments but we consider this music-note based coding concept can be extended for general acoustic signal description. At first we proposed applying the MIDI technology to coding of bio-medical auscultation sound signals such as heart sounds. Then we have tried to extend our encoding target and improve the coding precision based on Generalized Harmonic Analysis in order to apply it to vocal sounds. Currently, we are trying to separate each tone included in popular songs and encode both vocal sounds and several background instrumental sounds into separate MIDI channels. Using a GM-standard MIDI tone generator, we can playback this multi-channel MIDI encoded data including vocal sounds. In this paper, we present an abstract algorithm of our developed MIDI software encoder tool, being used for producing interactive general audio contents controlled by MIDI.

[1]  Toshio Modegi.  Structured description method for general acoustic signals using XML format , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[2]  Ian H. Witten,et al.  Towards the digital music library: tune retrieval from acoustic input , 1996, DL '96.

[3]  Toshio Modegi.  XML Transcription Method for Biomedical Acoustic Signals , 2001, MedInfo.

[4]  Toshio Modegi.  MIDI encoding method based on variable frame-length analysis and its evaluation of coding precision , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[5]  Toshio Modegi.  Multi-track MIDI encoding algorithm based on GHA for synthesizing vocal sounds , 1999 .

[6]  Toshio Modegi.  Very low bit-rate audio coding technique using MIDI representation , 2001, NOSSDAV '01.

[7]  T. Modegi,et al.  Application of MIDI technique for medical audio signal coding , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[8]  Yoichi Muraoka,et al.  A beat tracking system for acoustic signals of music , 1994, MULTIMEDIA '94.

[9]  Toshio Modegi.  High-precision MIDI encoding method including decoder control for synthesizing vocal sounds , 1999, MULTIMEDIA '99.

[10]  T. Modegi,et al.  Proposals of MIDI coding and its application for audio authoring , 1998, Proceedings. IEEE International Conference on Multimedia Computing and Systems (Cat. No.98TB100241).