A neural network's composition of video game music (song 4)
Details
| Title | A neural network's composition of video game music (song 4) |
| Author | Darin Straus |
| Duration | 0:47 |
| File Format | MP3 / MP4 |
| Original URL | https://youtube.com/watch?v=WyFU5bP8zDk |
Description
The neural network is a 12 layer transformer model with feedforward layers of 2048, 12 heads and a vector input of 768, batch size of 512. It was trained for a little under a month and achieved a negative log prob of 0.672 after ~9000 batch updates. Sampling was done using a temperature of ~0.9-0.925.
