Fabrizio Ferrari - Tips & Insights from the Music Room expert

• Tips & Insights from the Music Room

AI Systems for Musicians

An overview of AI applied to music

In this new video, Virtual Sheet Music's CEO, Fabrizio Ferrari, talks about AI applied to music. What systems are out there? What can you use as a musician?

Released on April 10, 2024

Post a Comment   |   Video problems? Contact Us!
DISCLAIMER: The views and the opinions expressed in this video are those of the author and do not necessarily reflect the views of Virtual Sheet Music and its employees.

Video Transcription

Hello and welcome to a new episode of Tips and Insights from the Music Room.

Today we're going to talk about a very hot topic of our time, AI.

Alright, so what is AI? As many of you probably know already, AI stands for Artificial Intelligence.

And those are special computer programs created in a different way from the traditional way computer programs are created, where the computer programmer just put down a list of distractions and the computer follows them one by one in order to accomplish a specific task. AI -based systems, instead, are built on the concept of having a software -based neural network, simulating the neural network we have in our brains in such a way that it gets trained to learn from its mistakes. And this training phase can take hours, days, weeks or even months for very complex systems.

And at the end of the process you have a system that can predict things and create stuff, which makes everything very magical and uncanny.

So today I'm going to focus, of course, on AI applied to music, so I'm going to give you an overview of what's available out there for us musicians.

And so let's get started.

In recent years, AI has made significant strides in the field of music, revolutionizing the way music is created, produced and consumed.

So let me give you some of the latest developments in AI applied to music that, in my opinion, can be summarized in seven different categories, according to their application.

The first category is music personalization.

AI algorithms can analyze the user's listening habits and preferences to create personalized playlists and recommendations.

As I mentioned earlier, this is not much different from what Netflix is doing to suggest the next movie or Amazon to suggest your next favorite book.

We have seen the same in music applications such as Pandora, one of the earliest adopters of such systems, or Spotify, iTunes or even YouTube.

The second category is music production and mixing.

In this realm, AI tools can assist musicians and producers in the music production process by automating various tasks, such as equalization, compression and mastering.

This not only saves time, but also allows for more experimentation and creativity in the production process.

If you are a music creator and use professional tools like Logic Pro, Pro Tools or similar softwares, you'll be amazed to know how many new plugins are coming out pretty much every week to help with music production.

The third category is instrument emulation.

AI can now accurately emulate the sounds of various musical instruments, which can be used in both live performances and studio recordings.

This technology allows musicians to explore different sounds and textures without the need for expensive or rare instruments.

And not only on the instrumental side, check out these incredible voices created by AI, by EclipseSounds .com.

It really sounds like a real voice, but it's just AI based.

Again, you can find hundreds of new instruments AI based to be used in music production programs with incredible realistic sounds.

The fourth category is music education.

AI powered tools can help students learn to play musical instruments by providing real -time feedback and guidance.

This can make music education more accessible and engaging for learners of all ages and skill levels.

For example, ChatGPT can help with that, with tips on how to practice, tune an instrument or even putting down programs for music students.

I'll make a specific video on ChatGPT later on.

The fifth category is music transcription and extraction.

With AI you can automatically transcribe audio recordings into sheet music nowadays, making it easier for musicians to learn and perform new pieces.

There are also systems that extract lyrics from songs. And if you want to try one of those, try with Datascrub .com, which is a system we have created to help with the transcription of our video files.

That system has not been designed for that purpose, but it does a pretty good job on that side as well.

The sixth category is music notation optical recognition systems.

Well, that's very interesting because we are working on that right now and will be one of the next features for our newly created playground. But there are already systems out there, probably going back to 20 years ago, that are still working pretty good. Nothing is really 100 % perfect yet, but eventually it'll become perfect. And it's very, very convenient to transcribe music from PDF files or images into music XML so that you can import such files into any notational program for further editing.

And the last and seventh category is AI generated music, which is, in my opinion, the most interesting one, where AI can now compose original music in various genres, ranging from classical to pop.

These compositions can be based on specific inputs, such as mood or style, or be entirely generated by AI itself.

Listen to this music just generated for you.

This is really, really, really impressive. And I'm sure this is just the beginning. So if you know any other AI-based tools applied to music worth discussing, please post it in the comments below or send an email to tipsinsights at virtualcimich .com. I'll be happy to make a video on that.

So this is it for today, and I'll see you in the next one.

-------------------

Resources, websites, and tools showcased in this video:

Google Instrument Playground:
https://artsandculture.google.com/experiment/8QFo2oQr2uT3pg

Suno.ai (to create music songs and compositions):
https://www.suno.ai/

Sundraw music generator:
https://soundraw.io/

Spotify:
https://open.spotify.com/

Logic Pro:
https://www.apple.com/logic-pro/

Pro Tools:
https://www.avid.com/pro-tools

Neutron 4 mixing tool:
https://www.izotope.com/en/products/neutron/

AI-based vocals:
https://eclipsedsounds.com/

AI-based instruments:
https://www.spitfireaudio.com/instruments

Simply piano:
https://www.hellosimply.com/

ChatGPT:
https://chat.openai.com/

Melody Scanner:
https://melodyscanner.com/

DaDaScribe:
https://www.dadascribe.com/

Virtual Sheet Music Playground:
https://www.virtualsheetmusic.com/playground/

Neuratron Photoscore:
https://www.neuratron.com/photoscore.htm

Scanscore:
https://scan-score.com/en/

Sheet Music Scanner:
https://sheetmusicscanner.com/
Automatic video-to-text transcription by DaDaScribe.com
Post a comment, question or special request:
You may: Login  or  
Otherwise, fill out the form below to post your comment:
Add your name below:


Add your email below: (to receive replies, will not be displayed or shared)


For verification purposes, please enter the word MUSIC in the field below





Comments, Questions, Requests:

Halina * VSM MEMBER * on April 10, 2024 @8:43 am PST
My congratulations for your latest video! Without question, this is an amazing and interesting theme to be studied, and deserves all of our attention. Thank you!
reply
Fabrizio Ferrari - host, on April 10, 2024 @9:04 am PST
Thank you Halina for your kind words! I really appreciate it.

I'll make sure to cover this very interesting topic in more videos coming up. Stay ready!

And, of course, if you have any suggestions or particular topics you'd like me to discuss, please let me know.

Enjoy your day!

All the best,
Questions? Problems? Contact Us.
Norton Shopping Guarantee Seal