- 期刊
- OpenAccess
VAE+NN: Interpolation Composition by Direct Estimation of Encoded Vectors Against Linear Sampling of Latent Space
摘要
In this paper, we introduce a machine learning technique to estimate the vector encoded by a Variational Autoencoder (VAE) model, without the need of explicitly sampling the vector from the VAE's latent space. The feasibility of our approach is evaluated in the field of music interpolation composition, by means of the Hsinchu Interpolation MIDI Dataset that was created. A novel dual architecture of VAE plus an additional neural network (VAE+NN) is proposed to generate a polyphonic harmonic bridge between two given songs, smoothly changing the pitches and dynamics of the interpolation. The interpolations generated by the VAE+NN model surpass a Random data baseline, a bidirectional LSTM model and the state-of-the-art interpolation approach in automatic music composition (VAE model with linear sampling of the latent space), in terms of reconstruction MSE loss. Furthermore, a subjective evaluation was done in order to ensure the validity of the metric-based results.
延伸閱讀
- Yang, X. G., & Li, J. T. (2013). Upper Semicontinuous Property of Uniform Attractors for the 2D Nonautonomous Navier-Stokes Equations with Damping. Abstract and Applied Analysis, 2013(), 931-942-1194. https://doi.org/10.1155/2013/861292
- Shen, Z. X., & Zhao, K. (2014). Dynamic Neural Network Identification and Decoupling Control Approach for MIMO Time-Varying Nonlinear Systems. Abstract and Applied Analysis, 2014(), 152-161-419. https://doi.org/10.1155/2014/316206
- Lu, Y., Gao, Q., Sun, D., Zhang, D., Xia, Y., & Wang, H. (2015). A Novel Directionlet-Based Image Denoising Method Using MMSE Estimator and Laplacian Mixture Distribution. Journal of Electrical and Computer Engineering, 2015(), 327-338. https://doi.org/10.1155/2015/459285
- Chang, R. J., & Lin, S. J. (1997). Entropy Linearization Method for Response Prediction of Nonlinear Stochastic Dynamic Systems. In 中華民國振動與噪音工程學會 (Ed.), 中華民國振動與噪音工程學會論文集 (pp. 395-404). 中華民國振動與噪音工程學會. https://doi.org/10.30028/CSSVANNUAL.199705.0395
- Chung, C. H. (2007). A De-interlacing Algorithm Using Spatial-Temporal Correlation Assisted Motion Estimation [master's thesis, National Taiwan University]. Airiti Library. https://doi.org/10.6342/NTU.2007.01597