Technical Name Applying AI in automatic composition of music and lyrics and personalized medical healthcare
Project Operator Engineering &Technology Promotion Center
Project Host
Summary
Automated lyrics and song integrated technology, can generate consistent situated song at the same time. AI lyrics generator uses big data analysis, to evolve and generate with the consistent song segment situation. Algorithmic Music Composition uses note event parameters to calculate and generate song segment with the same situation, and integrate a song with lyrics in the consistent situation.
We also conduct gait analysis and peak detection analysis to assess the disease condition of patients with Parkinson’s disease in terms of music assisted therapy. It can automatically suggest the tempo of given music in tune with patient’s response in rehabilitation.
Scientific Breakthrough
1.We develop AI technologies in order to recommend music to interact with patients under treatment of various mental and physical diseases. In particular, we apply deep learning model to learn music features and emotion that will be used to compose music and lyrics at the same time. We extract patterns from previous lyrics and used to construct a template to be filled words with similar meanings under the theme. 
2.It’s the integrated technique for both automated lyrics generation and algorithmic music composition, to show the result with the real singers and performers.
3.Using the song segment consistent situation to generate lyrics and song is a practical way for popular song composition.
4.AI lyrics generation technique uses big data analysis for lyrics data box, evolves and generates the lyrics and song with the same situation. For a popular song composition with lyrics, we need the people including a professional composer to compose a song with melody (pitch and rhythm), and chord progression, with musical instrumentation arrangement.
5.And for the lyrics author needs to understand the literature background to write the situation consistent lyrics. Both music and lyrics composition needs artistic background and knowledge with inspiration, therefore it is very difficult. The artificial intelligent technology for lyrics and song generation can save huge of time and funding to generate a popular song.
6.The technique for automated song and lyrics generation is much more complicated, due to its genre and culture characteristics, which needs the cross-disciplinary research in music and technology.
7.The typical popular music form structure including introduction, verse 1, chorus, verse 2, bridge, chorus, verse 3, chorus 3, coda, etc., can be analyzed and segmented first, and then use the algorithmic calculation with the MIDI note events to generate the brain new song segment, to combine every segment in total eventually.
8.This is the demo for integrated AI lyrics and algorithmic song generation technique, with optimized analysis, integration technique, for Taiwan popular song commercial production development.
9.The cross-disciplinary research includes music, technology, and lyrics, therefore the related technique needs more expertise from both art and technology to integrate it.
10.We also apply music to intervention of therapy in rehabilitation. In particular, we analyze the gate analysis that align with music features to diagnose the rehabilitation state of patients with Parkinson’s disease. We integrate beat detection analysis on piece of music and will able to tell if patients are walking in tune with music tempo and therefore can recommend the change of music automatically.
Industrial Applicability
機器學習, 自動譜曲, 自動填詞, 音樂介入治療, 音樂推薦與互動, 音樂與身心健康促進, 長照互動
Keyword
Notes
  • Contact
other people also saw