Abstract
The system presented here shows the feasibility of modeling the knowledge involved in a complex musical activity by integrating sub-symbolic and symbolic processes. This research focuses on the question of whether there is any advantage in integrating a neural network together with a distributed artificial intelligence approach within the music domain. The primary purpose of our work is to design a model that describes the different aspects a user might be interested in considering when involved in a musical activity. The approach we suggest in this work enables the musician to encode his knowledge, intuitions, and aesthetic taste into different modules. The system captures these aspects by computing and applying three distinct functions: rules, fuzzy concepts, and learning. As a case study, we began experimenting with first species two-part counterpoint melodies. We have developed a hybrid system composed of a connectionist module and an agent-based module to combine the sub-symbolic and symbolic levels to achieve this task. The technique presented here to represent musical knowledge constitutes a new approach for composing polyphonic music.
Similar content being viewed by others
References
J. Berger, Who Cares if It Listens: An Essay on Creativity, Expectations, and Computational Modeling of Listening to Music (MIT Press, Cambridge, MA, 1999).
J. Berger and D. Gang, Modeling musical expectations: A neural network model of dynamic changes of expectation in the audition of functional tonal music, in: Proceedings of the 4th International Conference on Music Perception and Cognition, Montreal, Canada (1996).
J. Berger and D. Gang, A neural network model of metric perception and cognition in the audition of functional tonal music, in: Proceedings of the International Computer Music Association, Thessaloniki, Greece (1997).
J.J. Bharucha and P.M. Todd, Modeling the perception of tonal structure with neural nets, in: Music and Connectionism, eds. P.M. Todd and D.G. Loy (MIT Press, Cambridge, MA, 1991).
A.H. Bond and L. Gasser, eds., Readings in Distributed Artificial Intelligence (Morgan Kaufmann, San Mateo, CA, 1988).
A. Camurri, Applications of artificial intelligence methodologies and tools for music description and processing, in: Music Processing, ed. G. Haus (A-R Editions, Inc., 1993) pp. 233-266.
A. Camurri, A. Catorcini, C. Innocenti and A. Massari, Music and multimedia knowledge representation and reasoning: the harp system, Computer Music Journal 19(2) (1995) 34-58.
D. Cope, Computers and Musical Styles (A-R editions, Inc., 1991).
D. Cope, Experiments in Musical Intelligence (A-R editions, Inc., 1996).
K.S. Decker and V.R. Lesser, Generalizing the partial global planning algorithm, International Journal of Intelligent Cooperative Information Systems 1(2) (1992) 319-346.
E.H. Durfee, Coordination of Distributed Problem Solvers (Kluwer Academic, Boston, 1988).
K. Ebcioglu, An expert system for harmonizing chorales in the style of J.S. Bach, in: Understanding Music with AI, eds. M. Balaban, K. Ebcioglu and O. Laske (AAAI Press/ MIT Press, 1992) pp. 294-333.
E. Ephrati and J.S. Rosenschein, The Clarke Tax as a consensus mechanism among automated agents, in: Proceedings of the 9th National Conference on Artificial Intelligence, Anaheim, California (July 1991) pp. 173-178.
D. Gang and J. Berger, Modeling the degree of realized expectation in functional tonal music: A study of perceptual and cognitive modeling using neural networks, in: Proceedings of the International Computer Music Conference, Hong Kong (1996).
D. Gang, D. Lehmann and N. Wagner, Tuning a neural network for harmonizing melodies in real time, in: Proceedings of the International Computer Music Conference, Ann Arbor, MI (1998).
C.V. Goldman and J.S. Rosenschein, Emergent coordination through the use of cooperative state-changing rules, in: Proceedings of the 12th National Conference on Artificial Intelligence, Seattle, Washington (1994) pp. 408-413.
C.V. Goldman and J.S. Rosenschein, Mutually supervised learning in multiagent systems, Adaptation and Learning in Multi-Agent Systems, Lecture Notes in Artificial Intelligence, Vol. 1042 (1996) pp. 85-96.
C.V. Goldman and J.S. Rosenschein, Multiagent learning systems and expert agents, in: Working Notes of the AAAI Fall Symposium Series on Socially Intelligent Agents, Tang Center at MIT in Cambridge, MA (1997).
C.V. Goldman and J.S. Rosenschein, Mutual adaptation enhanced by social laws, Technical Report CS98-5, The Hebrew University (1998).
B. Grosz and S. Kraus, Collaborative plans for group activities, in: Proceedings of the 13th International Joint Conference on Artificial Intelligence, Montreal, Canada (1993) pp. 367-373.
M. Hilario, An overview of strategies for neurosymbolic integration, in: Workshop on Connectionist-Symbolic Integration: From Unified to Hybrid Approaches at the 14th International Joint Conference on Artificial Intelligence, Montreal, Quebec (1995).
R. Jackendoff, Musical parsing and musical affect, Music Perception 9(2) (1991) 199-229.
K. Jeppesen, Counterpoint the Polyphonic Vocal Style of the Sixteenth Century (Dover, New York, 1992).
M.I. Jordan, Attractor dynamics and parallelism in a connectionist sequential machine, in: Proceedings of the 8th Annual Conference of the Cognitive Science Society, Hillsdale, NJ (1986).
S. Kraus, Agents contracting tasks in non-collaborative environments, in: Proceedings of the 11th National Conference on Artificial Intelligence, Washington, DC (1993) pp. 243-248.
S. Kraus and J. Wilkenfeld, Negotiations over time in a multi agent environment: Preliminary report, in: Proceedings of the 12th International Joint Conference on Artificial Intelligence, Sydney, Australia (August 1991) pp. 56-61.
F. Lerdahl and R. Jackendoff, A Generative Theory of Tonal Music (MIT Press, Cambridge, MA, 1983).
C. Lischka, Understanding Music Cognition: A Connectionist View (MIT Press, 1991) pp. 417-445.
T. Malone, R. Fikes and M. Howard, Enterprise: A market-like task scheduler for distributed computing environments, in: The Ecology of Computation, ed. B.A. Huberman (North-Holland, Amsterdam, 1988) pp. 177-205.
Y. Miyata, A User's Guide to PlaNet Version 5.6, Computer Science Department, University of Colorado, Boulder (1991).
T.A. Montgomery, J. Lee, D.J. Musliner, E.H. Durfee, D. Damouth and Y. So, MICE Users Guide, Artificial Intelligence Laboratory, Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI (February 1992).
D.M. Randel, ed., The New Harvard Dictionary of Music (Belknap Press of Harvard University Press, 1996).
J.S. Rosenschein and G. Zlotkin, Rules of Encounter (MIT Press, Cambridge, MA, 1994).
D.E. Rumelhart, G.E. Hinton and R.J. Williams, Learning internal representations by error propagation, in: Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1, eds. D.E. Rumelhart and J.L. McClelland (MIT Press, 1986).
H. Schenker, Five Graphic Analyses (Dover, New York, 1969). Edited by F. Salzer.
H. Schenker, Free Composition (Der Freie Satz) (Longman, 1979). Edited by E. Oster.
Y. Shoham and M. Tennenholtz, Emergent conventions in multi-agent systems: initial experimental results and observations (preliminary report), in: Principles of Knowledge Representation and Reasoning: Proceedings of the 3rd International Conference (KR92), Cambridge, MA (October 1992).
R.G. Smith, A framework for problem solving in a distributed processing environment, Ph.D. thesis, Stanford University (1978).
M. Tennenholtz and Y. Moses, On cooperation in a multi-entity model, in: Proceedings of the 11th International Joint Conference on Artificial Intelligence, Detroit, MI (August 1989) pp. 918-923.
P.M. Todd, A connectionist approach to algorithmic composition, in: Music and Connectionism, eds. P.M. Todd and D.G. Loy (MIT Press, 1991).
M.P. Wellman, A general-equilibrium approach to distributed transportation planning, in: Proceedings of the 10th National Conference on Artificial Intelligence, San Jose, CA (July 1992).
M. Wooldridge and J.P. Mueller, eds., Intelligent Agents, Lecture Notes in Artificial Intelligence, Vol. 890 (Springer-Verlag, Berlin, 1995).
M. Wooldridge, J.P. Mueller and M. Tambe, eds., Intelligent Agents II, Lecture Notes in Artificial Intelligence, Vol. 1037 (Springer-Verlag, Berlin, 1996).
G. Zlotkin and J.S. Rosenschein, A domain theory for task oriented negotiation, in: Proceedings of the 13th International Joint Conference on Artificial Intelligence, Chambery, France (1993) pp. 416-422.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Goldman, C.V., Gang, D., Rosenschein, J.S. et al. NetNeg: A connectionist-agent integrated system for representing musical knowledge. Annals of Mathematics and Artificial Intelligence 25, 69–90 (1999). https://doi.org/10.1023/A:1018965602910
Issue Date:
DOI: https://doi.org/10.1023/A:1018965602910