Random machine learning experiments related to the classic Yamaha DX7
Dexed is a linux open source DX7 emulator and was used heavily in the testing of this project
DX7 and it's similar instruments are programmable bt
format found here under sysexformat.txt
Big thanks to Bobby Blues for collecting these DX7 patches. This was the only data source
If you've found your way here through thisdx7cartdoesnotexist.com then this section will give an overview of how that site generates patches.
The model itself is defined under NeuralDX7/models/dx7_vae.py, it is a simple VAE with triangular sylvester flows implemented with attention layers over the parameters of the DX7.
The training code can be found in NeuralDX7/solvers/dx7_vae.py and is a fairly standard VAE+Flow optimisation setup
Finally the training script itself, as well as various other scripts used to perform various functions with the trained model can be found under projects/dx7_vae. The scripts in here do the following:
duplicate_test.py - samples randomly from the prior and calculates the number of identical patches. This was found to be around 99.9% unique
evaluate.py - was a script designed to create a single cartridge and was used during development to ensure the model was outputting valid parameter configurations.
experiment.py - contains the code to run the experiment. If you want to train your own version then start here.
features.py - simple feature extractor for the dataset, used to calculate the model posterior.
interpolate.py - takes two samples from the dataset and produces a cartridge that moves between the two in latent space over 32 steps
live.py - uses jackd to provide a realtime interface to the model. This is really fun to play with as it lets you hook up a midi controller to control the latent variables of the model and update the parameters of your FM Synthesizer in real time.
To use it you will need jackd installed, add both your controller and FM synthsizer to the jack graph, update the names of the controller and fm synth in the live.py script and then run. Each of the first 8 midi cc controls recieved will be mapped to a latent dimension of the model.