October 15–16, KTH, Stockholm Sweden

The Swedish Workshop on Data Science (SweDS) is a national event aiming to maintain and develop data science research and its application in Sweden by fostering the exchange of ideas and promoting collaboration within and across disciplines. SweDS brings together researchers and practitioners working in a variety of academic, commercial or other sectors, and in the past has included presentations from a variety of domains, e.g., computer science, linguistics, economics, archaeology, environmental science, education, journalism, medicine, healthcare, biology, sociology, psychology, history, physics, chemistry, geography, forestry, design, and music.

SweDS19 is organised by the School of Electrical Engineering and Computer Science, KTH.


SweDS focuses on theoretical and applied aspects of data science in many disciplines, e.g., Computer Science, Linguistics, Economics, Education, Medicine, Healthcare, Biology, Sociology, Psychology, Physics, Chemistry, Geography, Forestry, Art and Music, Design, etc. Topics include, but are not limited to:
• Text & Web Mining
• Classification, Clustering, and Regression
• Probabilistic & Statistical Methods
• Graphical Models
• Spatial & Temporal Mining
• Data Stream Mining
• Feature Extraction, Selection and Dimension Reduction
• Data Cleaning, Transformation & Preprocessing
• Multi-Task, Multi-label, and Multi-output Learning
• Big Data, Scalable & High-Performance Computing Techniques
• Mining Semi-Structured or Unstructured Data
• Data privacy

Invited Speakers

• Professor Virginia Dignum (Department of Computing Science, Umeå University)
• Professor Michael Höhle (Department of Mathematics, Stockholm University)
• Professor Sven Ahlbäck (Kungliga Musikhögskolan, CEO på Doremir Music Research AB)
• Anders Arpteg (Principal Data Scientist, peltarion.com)
• Dr. Josephine Sullivan (Division of robotics, perception and learning, KTH)
• Dr. Margaret Schedel (Stony Brook University, NY, USA)

Submission Guidelines

We invite academic researchers as well as industrial researchers and practitioners to present their work either by giving a talk or poster/demo track. 1) Contributed talk (15-20 minutes incl. questions/discussion): submit abstract (400-500 words) in one of the following categories: original research, new/relevant challenge, or status report of ongoing work; 2) poster/demo track: submit short abstracts (200-300 words), and mark “submit for poster” or “submit for demo” in abstract. Abstracts will be screened and selected based on relevance and quality.

Submissions should be made here: https://easychair.org/conferences/?conf=sweds19

Important Dates:

• SEPTEMBER 15 2019: Submission deadline
• SEPTEMBER 20 2019: Notification
• OCTOBER 4 2019: Registration deadline (https://www.eventbrite.com/e/2019-swedish-workshop-on-data-science-tickets-63426090143)
• OCTOBER 15-16 2019: Workshop!

Organizing committee

• Dr. Bob L. Sturm, workshop chair (Division of Speech, Music and Hearing, KTH)
• Ronald Cumbal Guerron, registration (Division of Speech, Music and Hearing)
• others TBD

Program Committee

• Professor Hedvig Kjellström (Division of robotics, perception and learning, KTH)
• Professor Danica Kragic Jensfelt (Division of robotics, perception and learning, KTH)
• Professor Sten Ternstrom (Division of Speech, Music and Hearing, KTH)
• Dr. Hossein Azizpour (Division of robotics, perception and learning, KTH)
• Dr. André Holzapfel (Division of media technology and interaction design, KTH)
• others TBA


Speech, Music and Hearing division, EECS, KTH


All questions about submissions should be emailed to bobs@kth.se

DT2470 Music Informatics @ KTH

I’m pleased to advertise my new master’s level course (7.5 credits) called, “Music Informatics”, which will be offered by Electrical Engineering and Computer Science at KTH this fall (Sep–Oct 2019). This course presents a thorough introduction to the research domain of music informatics. This has many commercial and public applications, from music streaming and recommendation, to archiving and music creation.

After passing the course, the student should be able to

  • explain how music can be represented in the computer
  • account for how feature extraction works and explain why it is needed
  • summarize and explain features that can be extracted from a music signal, based on time, frequency and time-frequency
  • use existing software libraries for feature extraction and interpret features that have been extracted from a music signal
  • recommend methods for comparing and modelling of music data
  • design and implement new methods for modelling of music data
  • evaluate a given method for modelling of music data and explain its limitations, in order to
    • describe how information on different abstraction levels can be extracted from music data (acoustic as well as symbolic) and be used in many applications (e g search, retrieval, synthesis)
    • design algorithms for handling and modelling of music data as well as evaluate their performance

The course will consist of several lectures, three laboratories, and a project. The course text will be Müller’s Fundamentals of Music Processing.

FDT3303 Critical Perspectives on Data Science and Machine Learning @ KTH

I’m pleased to advertise my new PhD course (7.5 credits) called, “Critical Perspectives on Data Science and Machine Learning”, which will be offered by Electrical Engineering and Computer Science at KTH this winter (Nov–Dec 2019). This course prepares students for critical reflection upon developments in the disciplines of data science and machine learning, within both the commercial and academic spheres. The course can be taken by PhD students with sufficient experience in statistics, data science, and/or machine learning and artificial intelligence.

Upon successful completion of this course, the student will be able to:

  • describe and explain problems and pitfalls when interpreting standard experiments performed in these disciplines
  • interpret existing work based on fundamental principles (e.g., no free lunch, bias-variance tradeoff, information theory, etc.)
  • identify weaknesses and limitations of an existing work, and assess the claims made from the evidence presented
  • analyse the reproducibility and replicability of an existing work, and propose improvements
  • think broadly about the ethical implications of specific applications of machine learning and data science.

The main content of the course is through the presentation of a series of articles (new and “classic”) that reflect upon research in data science and machine learning, and related disciplines, e.g., applied statistics. Student groups will select and present papers, and help lead discussion about the topic.

The scheduled topics are roughly the following, with several example articles:

  1. Introduction, e.g., a review of the aims and fundamental theory of machine learning (generalisation, supervised/unsupervised, etc.) and data science (inferring patterns, etc.). Required reading: Chapters 1 and 2 in: T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer-Verlag, 2 ed., 2009; D. Donoho, “50 years of data science,” in Keynote of John W. Tukey 100th Birthday Celebration at Princeton University, 2015.
  2. Questions of Ethics, e.g., what is good and bad, and how do we know, etc.? Key point: These technologies are not ethically neutral. Readings: A. Holzapfel, B. L. Sturm, and M. Coeckelbergh, “Ethical dimensions of music information retrieval technology,” Trans. Int. Soc. Music Information Retrieval, vol. 1, no. 1, pp. 44–55, 2018; J. Bryson and A. Winfield, “Standardizing ethical design for artificial intelligence and autonomous systems,” Computer, vol. 50, pp. 116–119, May 2017; D. J. Hand, “Aspects of data ethics in a changing world: Where are we now?,” Big Data, vol. 6, no. 3, pp. 176–190, 2018.
  3. Questions of Performance, e.g., how does one measure success, learning, etc.? Key point: These measures may not be as objective, relevant, reliable, or meaningful as they first appear. Readings: F. Provost, T. Fawcett, and R. Kohavi, “The case against accuracy estimation for comparing induction algorithms,” in Proc. Int. Conf. Machine Learning, pp. 43–48, 1998; E. Law, “The problem of accuracy as an evaluation criterion,” in Proc. Int. Conf. Machine Learning: Workshop on Evaluation Methods for Machine Learning, 2008; B. L. Sturm, “Classification accuracy is not enough: On the evaluation of music genre recognition systems,” J. Intell. Info. Systems, vol. 41, no. 3, pp. 371–406, 2013; F. M.-Plumed, R. B. C. Prudˆencio, A. M.-Us ́o, and J. H.-Orallo, “Making sense of item response theory in machine learning,” in Proc. ECAI, 2016.
  4. Questions of Learning, e.g., what is it learning? When is that important? Key point: “Learning” is a suitcase word that must be unpacked. Readings: O. Pfungst, Clever Hans (The horse of Mr. Von Osten): A contribution to experimental animal and human psychology. New York: Henry Holt, 1911; D. J. Hand, “Classifier technology and the illusion of progress,” Statistical Science, vol. 21, no. 1, pp. 1–15, 2006; R. Holte, “Very simple classification rules perform well on most commonly used datasets,” Machine Learning, vol. 11, pp. 63–91, 1993; E. Keogh and J. Lin, “Clustering of time series subsequences is meaningless: Implications for past and future research,” in Knowledge and Information Systems, Springer-Verlag, 2004; E. R. Dougherty and L. A. Dalton, “Scientific knowledge is possible with small-sample classification,” EURASIP J. Bioinformatics and Systems Biology, vol. 2013:10, 2013.
  5. Questions of Data, e.g., what problems can arise, bias, how to collect data, etc.? Key point: Data collection has major impacts that limit conclusions. Readings: S. Tolan, “Fair and unbiased algorithmic decision making: Current state and future challenges,” JRC Technical Reports, JRC Digital Economy Working Paper 2018-10, vol. arxiv:1901.04730, 2018; T. Bolukbasi, K.-W. Chang, J. Zou, V. Saligrama, and A. Kalai, “Man is to computer programmer as woman is to homemaker? debiasing word embeddings,” in NeurIPS, pp. 4356–4364, 2016; B. L. Sturm, “The state of the art ten years after a state of the art: Future research in music information retrieval,” J. New Music Research, vol. 43, no. 2, pp. 147–172, 2014; M. J. Eugster, F. Leisch, and C. Strobl, “(Psycho-)analysis of benchmark experiments: A formal frame- work for investigating the relationship between data sets and learning algorithms,” Computational Statistics & Data Analysis, vol. 71, no. 0, pp. 986 – 1000, 2014.
  6. Questions of Statistics, e.g., there’s a zoo of statistical tests we can use. Key point: Do not reach for something because it is convenient. Readings: A. W. Kimball, “Errors of the third kind in statistical consulting,” J. American Statistical Assoc., vol. 52, pp. 133–142, June 1957; D. J. Hand, “Deconstructing statistical questions,” J. Royal Statist. Soc. A (Statistics in Society), vol. 157, no. 3, pp. 317–356, 1994; C. Drummond and N. Japkowicz, “Warning: Statistical benchmarking is addictive. kicking the habit in machine learning,” J. Experimental Theoretical Artificial Intell., vol. 22, pp. 67–80, 2010; S. Goodman, “A dirty dozen: Twelve p-value misconceptions,” Seminars in Hematology, vol. 45, pp. 135– 140, 2008.
  7. Questions of Experimental Design, e.g., looking at the design of machine learning experiments. Key point: The design is an essential component for making valid conclusions, and it takes a lot of thought and effort to do it well. Readings: E. Alpaydin, Introduction to Machine Learning, ch. Design and Analysis of Machine Learning Experi- ments, pp. 475–515. MIT Press, 2010; A. Chase, “Music discriminations by carp “Cyprinus carpio”,” Animal Learning & Behavior, vol. 29, no. 4, pp. 336–353, 2001; C. Dwork, V. Feldman, M. Hardt, T. Pitassi, O. Reingold, and A. Roth, “The reusable holdout: Preserving validity in adaptive data analysis,” Science, vol. 349, no. 6248, pp. 636–638, 2015; T. Hothorn, F. Leisch, A. Zeileis, and K. Hornik, “The design and analysis of benchmark experiments,” Journal of Computational and Graphical Statistics, vol. 14, no. 3, pp. 675–699, 2005.
  8. Questions of Sanity, e.g., unreasonable sensitivity to irrelevant changes to an input. Key point: Do not be persuaded that good performance means sane models. Readings: C. Szegedy, W. Zaremba, I. Sutskever, J. Bruna, D. Erhan, I. Goodfellow, and R. Fergus, “Intriguing properties of neural networks,” in Proc. ICLR, 2014; B. L. Sturm, “A simple method to determine if a music information retrieval system is a “horse”,” IEEE Trans. Multimedia, vol. 16, no. 6, pp. 1636–1644, 2014; I. J. Goodfellow, J. Shlens, and C. Szegedy, “Explaining and harnessing adversarial examples,” in Proc. ICLR, 2015; A. Nguyen, J. Yosinski, and J. Clune, “Deep neural networks are easily fooled: High confidence predictions for unrecognizable images,” in Proc. CVPR, pp. 427–436, 2015.
  9. Questions of Sabotage, e.g., how machine learning research can eat itself, dirty data activism. Key point: Your carefully constructed algorithms present opportunities for unintended uses, exploitation, etc. Readings: N. Collins, “Composing to subvert content retrieval engines,” ARRAY ICMA Online Journal, 2007; N. Dalvi, P. Domingos, Mausam, S. Sanghai, and D. Verma, “Adversarial classification,” KDD, pp. 99– 108, 2004; J. Su, D. V. Vargas, and K. Sakurai, “One pixel attack for fooling deep neural networks,” arXiv, vol. 1710.08864, 2017; T. B. Brown, D. Man ́e, A. Roy, M. Abadi, and J. Gilmer, “Adversarial patch,” arXiv, vol. 1712.09665, 2017.
  10. Questions of Interpretability, e.g., how do we understand why a system behaves the way it does, etc.? Key point: Drawing a line from cause and effect in these models can be extremely difficult, but is important/necessary in many applications. Readings: B. Kim, R. Khanna, and O. O. Koyejo, “Examples are not enough, learn to criticize! criticism for interpretability,” in Proc. NIPS, 2016; Z. Lipton, “The mythos of model interpretability,” in Proc. ICML Workshop on Human Interpretability in Machine Learning, 2016; M. T. Ribeiro, S. Singh, and C. Guestrin, “”Why should I trust you?”: Explaining the predictions of any classifier,” in Proc. ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining, 2016; L. H. Gilpin, D. Bau, B. Z. Yuan, A. Bajwa, M. Specter, and L. Kagal, “Explaining Explanations: An Approach to Evaluating Interpretability of Machine Learning,” ArXiv e-prints, May 2018; B. L. Sturm, “What do these 5,599,881 parameters mean? an analysis of a specific lstm music tran- scription model, starting with the 70,281 parameters of its softmax layer,” in Proc. Music Metacreation workshop of ICCC, 2018.
  11. Questions of Methodology, e.g., how do we do this kind of research., etc.? Key point: The health of the discipline is the responsibility of its researchers. Readings: E. R. Dougherty, “On the epistemological crisis in genomics,” Current Genomics, vol. 9, no. 2, pp. 69–79, 2008; C. Drummond, “Making evaluation robust but robust to what?,” tech. rep., AAAI Press Technical Report WS-07-05, 2007; C. Drummond, “Finding a balance between anarchy and orthodoxy,” in Proc. Int. Conf. Machine Learn- ing: Workshop on Evaluation Methods for Machine Learning III, 2008; Z. C. Lipton and J. Steinhardt, “Troubling trends in machine learning scholarship,” in Proc. ICML, 2018; N. Lavesson and P. Davidsson, “Approve: Application-oriented validation and evaluation of supervised learners,” in Intelligent Systems (IS), 2010 5th IEEE International Conference, pp. 150–155, July 2010; J. Lin and E. Keogh, “Finding or not finding rules in time series,” in Applications of Artificial Intelligence in Finance and Economics (T. B. Fomby and R. C. Hill, eds.), vol. 19 of Advances in Econometrics, pp. 175–201, Emerald Group Publishing Limited, 2004;
  12. Questions of Application, e.g., (mis)applications of data science and machine learning. Key point: Beware the hype, beware the dangers. Readings: M. Fern ́andez-Delgado, E. Cernadas, S. Barro, and D. Amorim, “Do we need hundreds of classifiers to solve real world classification problems?,” Journal of Machine Learning Research, vol. 15, pp. 3133–3181, 2014; B. L. Sturm, O. Ben-Tal, U. Monaghan, N. Collins, D. Herremans, E. Chew, G. Hadjeres, E. Deruty, and F. Pachet, “Machine learning research that matters for music creation: A case study,” J. New Music Research, vol. 48, no. 1, pp. 36–55, 2018; Z. Wallmark, “Big data and musicology: New methods, new questions,” tech. rep., American Musicolog- ical Society National Meeting, Pittsburgh, PA, Nov. 2013; K. L. Wagstaff, “Machine learning that matters,” in Proc. Int. Conf. Machine Learning, pp. 529–536, 2012.


Extended Deadline for 2019 International Workshop on Musical Metacreation


((( MUME 2019 )))
The 7th International Workshop on Musical Metacreation
June 17-18, 2019, Charlotte, North Carolina

MUME 2019 is to be held at the University of North Carolina Charlotte in conjunction with the 10th International Conference on Computational Creativity, ICCC 2019 (http://computationalcreativity.net/iccc2019).

=== Important Dates ===
EXTENDED Workshop submission deadline: March 24, 2019
Notification date: April 28, 2019
Camera-ready version: May 19, 2019
Workshop dates: June 17-18, 2019

Metacreation applies tools and techniques from artificial intelligence, artificial life, and machine learning, themselves often inspired by cognitive and natural science, for creative tasks. Musical Metacreation studies the design and use of these generative tools and theories for music making: discovery and exploration of novel musical styles and content, collaboration between human performers and creative software “partners”, and design of systems in gaming and entertainment that dynamically generate or modify music.

MUME intends to bring together artists, practitioners, and researchers interested in developing systems that autonomously (or interactively) recognize, learn, represent, compose, generate, complete, accompany, or interpret music. As such, we welcome contributions to the theory or practice of generative music systems and their applications in new media, digital art, and entertainment at large.

We encourage paper and demo submissions on MUME-related topics, including the following:
— Models, Representation and Algorithms for MUME
—- Novel representations of musical information
—- Advances or applications of AI, machine learning, and statistical techniques for generative music
—- Advances of A-Life, evolutionary computing or agent and multi-agent based systems for generative music
—- Computational models of human musical creativity
— Systems and Applications of MUME
—- Systems for autonomous or interactive music composition
—- Systems for automatic generation of expressive musical interpretation
—- Systems for learning or modeling music style and structure
—- Systems for intelligently remixing or recombining musical material
—- Online musical systems (i.e. systems with a real-time element)
—- Adaptive and generative music in video games
—- Generative systems in sound synthesis, or automatic synthesizer design
—- Techniques and systems for supporting human musical creativity
—- Emerging musical styles and approaches to music production and performance involving the use of AI systems
—- Applications of musical metacreation for digital entertainment: sound design, soundtracks, interactive art, etc.
— Evaluation of MUME
—- Methodologies for qualitative or quantitative evaluation of MUME systems
—- Studies reporting on the evaluation of MUME
—- Socio-economical Impact of MUME
—- Philosophical implication of MUME
—- Authorship and legal implications of MUME

Submission Format and Requirements
Please make submissions via the EasyChair system at:

The workshop is a day and a half event that includes:
-Presentations of FULL TECHNICAL PAPERS (8 pages maximum)
-Presentations of POSITION PAPERS and WORK-IN-PROGRESS PAPERS (5 pages maximum)
-Presentations of DEMONSTRATIONS (3 pages maximum) which present outputs of systems (working live or offline).

All papers should be submitted as complete works. Demo systems should be tested and working by the time of submission, rather than be speculative. We encourage audio and video material to accompany and illustrate the papers (especially for demos). We ask that authors arrange for their web hosting of audio and video files, and give URL links to all such files within the text of the submitted paper.

Submissions do not have to be anonymized, as we use single-blind reviewing. Each submission will be reviewed by at least three program committee members.

Workshop papers will be published as MUME 2019 Proceedings and will be archived with an ISBN number. Please use the updated MuMe paper template to format your paper. Also please feel free to edit the licence entry (at the bottom left of the first page of the new template). We created a new MUME 2019 template based on AAAI template. The MUME 2019 latex and Word template is available at:


Submission should be uploaded using MUME 2019 EasyChair portal:

For complete details on attendance, submissions and formatting, please visit the workshop website: http://musicalmetacreation.org

Presentation and Multimedia Equipment:
We will provide a video projection system as well as a stereo audio system for use by presenters at the venue. Additional equipment required for presentations and demonstrations should be supplied by the presenters. Contact the Workshop Chair to discuss any special equipment and setup needs/concerns.

It is expected that at least one author of each accepted submission will attend the workshop to present their contribution. We also welcome those who would like to attend the workshop without presenting. Workshop registration will be available through the ICCC 2019 conference system.
MUME 2019 builds on the enthusiastic response and participation we received for the past occurrences of MUME series:
MUME 2012 (held in conjunction with AIIDE 2012 at Stanford):
MUME 2013 (held in conjunction with AIIDE 2013 at NorthEastern):
MUME 2014 (held in conjunction with AIIDE 2014 at North Carolina):
MUME 2016 (held in conjunction with ICCC 2016 at Université Pierre et Marie Curie):
MUME 2017 (held in conjunction with ICCC 2017 at Georgia Institute of Technology):
MUME 2018 (held in conjunction with ICCC 2018 at Salamanca University):

Questions & Requests
Please direct any inquiries/suggestions/special requests to one of the Workshop Chairs, Bob (keller@cs.hmc.edu) or Bob (bobs@kth.se).

Workshop Organizers

Program Co-Chair
Robert M. Keller, Professor
Computer Science Department
Harvey Mudd College
301 Platt Blvd
Claremont, CA 91711 USA

Program Co-Chair
Bob L. Sturm, Associate Professor
Tal, Musik och Hörsel (Speech, Music and Hearing)
Lindstedtsvägen 24
School of Electronic Engineering and Computer Science
Royal Institute of Technology KTH, Sweden

Concert Chair
Gus Xia, Assistant Professor
Computer Science
NYU Shanghai

Publicity Chair
Dr. Oliver Bown
Senior Lecturer
Faculty of Art & Design, The University of New South Wales
Room AG12, Cnr Oxford St & Greens Rd,
Paddington, NSW, 2021, Australia



MUME Steering Committee

Andrew Brown, Griffith University, Australia
Michael Casey, Dartmouth College, US
Arne Eigenfeldt, Simon Fraser University, Canada
Anna Jordanous, University of Kent, UK
Bob Keller, Harvey Mudd College, US
Róisín Loughran, University College Dublin, Ireland
Philippe Pasquier, Simon Fraser University, Canada
Benjamin Smith, Purdue University Indianapolis, USA

CFP International Conference on Computational Creativity

International Conference on Computational Creativity 2019
17-21 June 2019 – Charlotte, North Carolina, USA

Submit your papers/workshops/demo proposals for the International Conference on Computational Creativity 2019 to be held 17-21 June 2019 in Charlotte, NC!

(Alternatively, submit to the MuMe 2019 workshop!)

Computational creativity is the art, science, philosophy and engineering of computational systems which, by taking on particular responsibilities, exhibit behaviours that unbiased observers would deem to be creative. As a field of research, this area is thriving, with progress in formalising what it means for software to be creative, along with many exciting and valuable applications of creative software in the sciences, design, the arts, literature, gaming and elsewhere. The ICCC conference series organized by the Association for Computational Creativity since 2010 is the only scientific conference that focuses on computational creativity alone and also covers all aspects of it.

The conference programme will include paper presentations, workshops, poster sessions, doctoral consortium and an art/demo exhibition, along with prominent keynote speakers. All submitted papers will be reviewed by experts in the field based on the criteria of originality, significance, quality and clarity.

Important Dates:
Paper and Workshop proposal Submissions Due: 18 February 2019
Doctoral Consortium Submissions Due: 18 March 2019
Art/Demo Submissions Due: 17 May 2019
Acceptance Notification : 29 April 2019
Camera Ready Submission : 17 May 2019
Conference Dates : 17-21 June 2019

Complete details are available on the conference website http://computationalcreativity.net/iccc2019/