.. DO NOT EDIT. .. THIS FILE WAS AUTOMATICALLY GENERATED BY SPHINX-GALLERY. .. TO MAKE CHANGES, EDIT THE SOURCE PYTHON FILE: .. "examples/08_mocap6/plot-05-topic_model_gaussian_likelihood.py" .. LINE NUMBERS ARE GIVEN BELOW. .. only:: html .. note:: :class: sphx-glr-download-link-note Click :ref:`here ` to download the full example code .. rst-class:: sphx-glr-example-title .. _sphx_glr_examples_08_mocap6_plot-05-topic_model_gaussian_likelihood.py: ====================================== Topic models with Gaussian likelihoods ====================================== Quick demonstration that you can easily use bnpy to perform mixed membership modeling of grouped data with *any* likelihood. The basic idea is that we use the same Gaussian mixture model for each group of data, but the *appearance probabilities* are allowed to be learned in a customized way for each group. Here, we'll analyze motion capture data from 6 different sequences of an individual actor peforming different exercises. Although this data is inherently sequential in nature and it is smart to use a model that accounts for time, we'll ignore that for now and focus on the dataset's *grouped* nature. That is, we can compare the following two models: * Baseline: Gaussian mixture model that pools all observations from all sequences * Smarter alternative: Latent Dirichlet Allocation with a Gaussian likelihood That is, we treat each sequence as a separate collection of data examples, modeled by *group* specific appearance probabilities but *shared* cluster means and covariances. .. GENERATED FROM PYTHON SOURCE LINES 31-46 .. code-block:: default # sphinx_gallery_thumbnail_number = 1 import bnpy import numpy as np import os from matplotlib import pylab import seaborn as sns FIG_SIZE = (5, 5) LANDSCAPE_FIG_SIZE = (15, 5) pylab.rcParams['figure.figsize'] = FIG_SIZE np.set_printoptions(precision=3, suppress=1, linewidth=200) .. GENERATED FROM PYTHON SOURCE LINES 47-48 Load dataset from file .. GENERATED FROM PYTHON SOURCE LINES 49-54 .. code-block:: default dataset_path = os.path.join(bnpy.DATASET_PATH, 'mocap6') dataset = bnpy.data.GroupXData.read_npz( os.path.join(dataset_path, 'dataset.npz')) .. GENERATED FROM PYTHON SOURCE LINES 55-57 Setup: Function to make a simple plot of the raw data ----------------------------------------------------- .. GENERATED FROM PYTHON SOURCE LINES 58-70 .. code-block:: default def show_single_sequence(seq_id): start = dataset.doc_range[seq_id] stop = dataset.doc_range[seq_id + 1] pylab.figure(figsize=LANDSCAPE_FIG_SIZE) for dim in range(12): X_seq = dataset.X[start:stop] pylab.plot(X_seq[:, dim], '.-') pylab.xlabel('time') pylab.ylabel('angle') pylab.tight_layout() .. GENERATED FROM PYTHON SOURCE LINES 71-73 Visualization of the first sequence ----------------------------------- .. GENERATED FROM PYTHON SOURCE LINES 74-78 .. code-block:: default show_single_sequence(0) .. image-sg:: /examples/08_mocap6/images/sphx_glr_plot-05-topic_model_gaussian_likelihood_001.png :alt: plot 05 topic model gaussian likelihood :srcset: /examples/08_mocap6/images/sphx_glr_plot-05-topic_model_gaussian_likelihood_001.png :class: sphx-glr-single-img .. GENERATED FROM PYTHON SOURCE LINES 79-81 Setup: hyperparameters ---------------------------------------------------------- .. GENERATED FROM PYTHON SOURCE LINES 82-94 .. code-block:: default K = 10 # Number of clusters/states alpha = 0.25 # group-level Dirichlet concentration parameter gamma = 5.0 # top-level Dirichlet concentration parameter (used by HDP only) sF = 1.0 # Set observation model prior so E[covariance] = identity ECovMat = 'eye' nLap = 200 .. GENERATED FROM PYTHON SOURCE LINES 95-99 Baseline: Mixture model with *DiagGauss* observation model ---------------------------------------------------------- We'll take the best of 3 independent inits ('tasks') .. GENERATED FROM PYTHON SOURCE LINES 100-112 .. code-block:: default mix_model, mix_info_dict = bnpy.run( dataset, 'FiniteMixtureModel', 'DiagGauss', 'memoVB', output_path='/tmp/mocap6/test-model=FiniteMixtureModel+DiagGauss-ECovMat=1*eye/', nLap=nLap, nTask=3, nBatch=1, convergeThr=0.0001, gamma=1.0, sF=sF, ECovMat=ECovMat, K=K, initname='randexamples', ) .. rst-class:: sphx-glr-script-out .. code-block:: none Dataset Summary: GroupXData total size: 6 units batch size: 6 units num. batches: 1 Allocation Model: Finite mixture model. Dir prior param 1.00 Obs. Data Model: Gaussian with diagonal covariance. Obs. Data Prior: independent Gauss-Wishart prior on each dimension Wishart params nu = 14 ... beta = [ 12 12] ... Expectations E[ mean[k]] = [ 0 0] ... E[ covar[k]] = [[1. 0.] [0. 1.]] ... Initialization: initname = randexamples K = 10 (number of clusters) seed = 1607680 elapsed_time: 0.0 sec Learn Alg: memoVB | task 1/3 | alg. seed: 1607680 | data order seed: 8541952 task_output_path: /tmp/mocap6/test-model=FiniteMixtureModel+DiagGauss-ECovMat=1*eye/1 1.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.892221921e+00 | 2.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.793128859e+00 | Ndiff 70.741 3.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.744872834e+00 | Ndiff 54.945 4.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.728928355e+00 | Ndiff 36.565 5.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.723943088e+00 | Ndiff 21.439 6.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.720839494e+00 | Ndiff 19.301 7.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.716886499e+00 | Ndiff 27.316 8.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.712988461e+00 | Ndiff 29.509 9.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.710101014e+00 | Ndiff 26.563 10.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.708338808e+00 | Ndiff 20.288 11.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.707223572e+00 | Ndiff 14.712 12.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.706484641e+00 | Ndiff 11.584 13.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.706034786e+00 | Ndiff 9.396 14.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.705729766e+00 | Ndiff 7.152 15.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.705504466e+00 | Ndiff 6.297 16.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.705319760e+00 | Ndiff 6.572 17.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.705112506e+00 | Ndiff 6.841 18.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.704838851e+00 | Ndiff 7.164 19.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.704355597e+00 | Ndiff 7.952 20.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.703328946e+00 | Ndiff 8.251 21.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.702259036e+00 | Ndiff 8.680 22.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.700921542e+00 | Ndiff 13.756 23.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.699599200e+00 | Ndiff 14.619 24.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.699098383e+00 | Ndiff 7.905 25.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698964052e+00 | Ndiff 3.030 26.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698910375e+00 | Ndiff 2.941 27.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698876899e+00 | Ndiff 2.963 28.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698850387e+00 | Ndiff 2.877 29.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698826486e+00 | Ndiff 2.796 30.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698803026e+00 | Ndiff 2.754 31.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698778550e+00 | Ndiff 2.758 32.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698751763e+00 | Ndiff 2.809 33.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698721045e+00 | Ndiff 2.904 34.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698683416e+00 | Ndiff 3.044 35.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698630921e+00 | Ndiff 3.241 36.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698535167e+00 | Ndiff 3.532 37.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698290137e+00 | Ndiff 4.008 38.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.697335718e+00 | Ndiff 4.769 39.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.693949604e+00 | Ndiff 10.713 40.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.688868616e+00 | Ndiff 14.061 41.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.686366624e+00 | Ndiff 10.183 42.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.685490235e+00 | Ndiff 13.059 43.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.685007421e+00 | Ndiff 11.536 44.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684710512e+00 | Ndiff 9.055 45.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684531557e+00 | Ndiff 6.729 46.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684420406e+00 | Ndiff 4.868 47.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684341666e+00 | Ndiff 3.509 48.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684275038e+00 | Ndiff 2.569 49.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684212748e+00 | Ndiff 1.945 50.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684158998e+00 | Ndiff 1.549 51.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684123182e+00 | Ndiff 1.296 52.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684105203e+00 | Ndiff 1.087 53.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684097308e+00 | Ndiff 0.854 54.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684093801e+00 | Ndiff 0.627 55.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684092161e+00 | Ndiff 0.442 56.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684091364e+00 | Ndiff 0.307 57.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684090968e+00 | Ndiff 0.212 58.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684090769e+00 | Ndiff 0.146 59.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684090668e+00 | Ndiff 0.101 60.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684090616e+00 | Ndiff 0.070 61.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684090590e+00 | Ndiff 0.050 62.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684090577e+00 | Ndiff 0.035 63.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684090570e+00 | Ndiff 0.025 64.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684090566e+00 | Ndiff 0.018 65.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684090565e+00 | Ndiff 0.013 66.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.684090564e+00 | Ndiff 0.009 67.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.684090563e+00 | Ndiff 0.006 68.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.684090563e+00 | Ndiff 0.005 69.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.684090563e+00 | Ndiff 0.003 70.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.684090563e+00 | Ndiff 0.002 71.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.684090563e+00 | Ndiff 0.002 72.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.684090563e+00 | Ndiff 0.001 73.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.684090563e+00 | Ndiff 0.001 74.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.684090563e+00 | Ndiff 0.001 75.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.684090563e+00 | Ndiff 0.000 76.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.684090563e+00 | Ndiff 0.000 77.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.684090563e+00 | Ndiff 0.000 78.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.684090563e+00 | Ndiff 0.000 79.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.684090563e+00 | Ndiff 0.000 80.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.684090563e+00 | Ndiff 0.000 ... done. converged. Learn Alg: memoVB | task 2/3 | alg. seed: 6454144 | data order seed: 7673856 task_output_path: /tmp/mocap6/test-model=FiniteMixtureModel+DiagGauss-ECovMat=1*eye/2 1.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.890179326e+00 | 2.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.777472898e+00 | Ndiff 83.721 3.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.750123362e+00 | Ndiff 62.267 4.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.739479839e+00 | Ndiff 46.042 5.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.734531114e+00 | Ndiff 29.583 6.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.731782967e+00 | Ndiff 22.825 7.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.729979871e+00 | Ndiff 16.224 8.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.726701094e+00 | Ndiff 10.764 9.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.721833333e+00 | Ndiff 16.579 10.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.717508780e+00 | Ndiff 13.991 11.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.716224141e+00 | Ndiff 8.496 12.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.715641630e+00 | Ndiff 6.731 13.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.715114046e+00 | Ndiff 5.898 14.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.714301987e+00 | Ndiff 6.464 15.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.712860954e+00 | Ndiff 7.549 16.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.710737689e+00 | Ndiff 7.573 17.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.709692612e+00 | Ndiff 4.068 18.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.709106222e+00 | Ndiff 5.517 19.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.708533753e+00 | Ndiff 5.528 20.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.708164056e+00 | Ndiff 3.957 21.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.707928604e+00 | Ndiff 3.853 22.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.707742936e+00 | Ndiff 3.867 23.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.707572126e+00 | Ndiff 3.949 24.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.707399838e+00 | Ndiff 3.946 25.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.707176718e+00 | Ndiff 3.756 26.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.704947156e+00 | Ndiff 4.259 27.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.704241353e+00 | Ndiff 1.604 28.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.704199743e+00 | Ndiff 1.453 29.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.704176703e+00 | Ndiff 1.288 30.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.704160219e+00 | Ndiff 1.204 31.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.704146780e+00 | Ndiff 1.202 32.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.704132083e+00 | Ndiff 1.323 33.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.704108733e+00 | Ndiff 1.659 34.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.704053332e+00 | Ndiff 2.452 35.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.703855509e+00 | Ndiff 4.290 36.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.703143515e+00 | Ndiff 6.954 37.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702653296e+00 | Ndiff 4.719 38.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702596961e+00 | Ndiff 2.246 39.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702571836e+00 | Ndiff 1.407 40.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702548145e+00 | Ndiff 1.043 41.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702521927e+00 | Ndiff 0.933 42.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702490805e+00 | Ndiff 1.049 43.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702453433e+00 | Ndiff 1.150 44.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702412811e+00 | Ndiff 1.160 45.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702377473e+00 | Ndiff 1.018 46.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702353326e+00 | Ndiff 0.789 47.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702338656e+00 | Ndiff 0.582 48.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702329491e+00 | Ndiff 0.434 49.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702323164e+00 | Ndiff 0.340 50.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702318273e+00 | Ndiff 0.294 51.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702314076e+00 | Ndiff 0.253 52.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702310122e+00 | Ndiff 0.228 53.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702306074e+00 | Ndiff 0.228 54.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702301602e+00 | Ndiff 0.249 55.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702296308e+00 | Ndiff 0.276 56.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702289629e+00 | Ndiff 0.309 57.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702280711e+00 | Ndiff 0.381 58.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702268184e+00 | Ndiff 0.495 59.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702249651e+00 | Ndiff 0.671 60.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702220312e+00 | Ndiff 0.931 61.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702170394e+00 | Ndiff 1.268 62.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.702088046e+00 | Ndiff 1.563 63.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.701990059e+00 | Ndiff 1.515 64.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.701911970e+00 | Ndiff 1.232 65.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.701866413e+00 | Ndiff 0.818 66.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.701852977e+00 | Ndiff 0.441 67.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.701848551e+00 | Ndiff 0.363 68.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.701846075e+00 | Ndiff 0.295 69.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.701843968e+00 | Ndiff 0.245 70.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.701841372e+00 | Ndiff 0.211 71.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.701836909e+00 | Ndiff 0.230 72.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.701826998e+00 | Ndiff 0.332 73.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.701804250e+00 | Ndiff 0.472 74.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.701763834e+00 | Ndiff 0.580 75.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.701649829e+00 | Ndiff 0.930 76.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.700624233e+00 | Ndiff 1.904 77.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.700330724e+00 | Ndiff 1.003 78.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.700173463e+00 | Ndiff 1.655 79.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699967301e+00 | Ndiff 1.518 80.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699888944e+00 | Ndiff 0.732 81.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699879203e+00 | Ndiff 0.227 82.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699877616e+00 | Ndiff 0.127 83.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699876877e+00 | Ndiff 0.112 84.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699876444e+00 | Ndiff 0.098 85.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699876158e+00 | Ndiff 0.085 86.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699875952e+00 | Ndiff 0.075 87.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699875790e+00 | Ndiff 0.067 88.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699875657e+00 | Ndiff 0.062 89.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699875539e+00 | Ndiff 0.058 90.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699875431e+00 | Ndiff 0.055 91.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699875327e+00 | Ndiff 0.053 92.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699875223e+00 | Ndiff 0.054 93.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699875119e+00 | Ndiff 0.055 94.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699875010e+00 | Ndiff 0.057 95.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699874895e+00 | Ndiff 0.059 96.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699874772e+00 | Ndiff 0.061 97.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699874638e+00 | Ndiff 0.064 98.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699874491e+00 | Ndiff 0.067 99.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699874329e+00 | Ndiff 0.071 100.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699874147e+00 | Ndiff 0.076 101.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699873943e+00 | Ndiff 0.081 102.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699873713e+00 | Ndiff 0.086 103.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699873453e+00 | Ndiff 0.092 104.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699873158e+00 | Ndiff 0.099 105.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699872826e+00 | Ndiff 0.105 106.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699872453e+00 | Ndiff 0.112 107.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699872037e+00 | Ndiff 0.119 108.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.699871581e+00 | Ndiff 0.125 109.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699871088e+00 | Ndiff 0.131 110.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699870566e+00 | Ndiff 0.134 111.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699870026e+00 | Ndiff 0.137 112.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699869484e+00 | Ndiff 0.137 113.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699868955e+00 | Ndiff 0.134 114.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699868454e+00 | Ndiff 0.130 115.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699867995e+00 | Ndiff 0.123 116.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699867586e+00 | Ndiff 0.114 117.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699867230e+00 | Ndiff 0.104 118.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699866929e+00 | Ndiff 0.098 119.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699866679e+00 | Ndiff 0.091 120.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699866474e+00 | Ndiff 0.084 121.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699866308e+00 | Ndiff 0.077 122.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699866176e+00 | Ndiff 0.070 123.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699866071e+00 | Ndiff 0.065 124.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865987e+00 | Ndiff 0.061 125.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865922e+00 | Ndiff 0.057 126.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865870e+00 | Ndiff 0.053 127.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865830e+00 | Ndiff 0.049 128.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865799e+00 | Ndiff 0.045 129.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865775e+00 | Ndiff 0.041 130.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865756e+00 | Ndiff 0.037 131.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865741e+00 | Ndiff 0.034 132.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865730e+00 | Ndiff 0.031 133.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865721e+00 | Ndiff 0.027 134.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865715e+00 | Ndiff 0.025 135.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865709e+00 | Ndiff 0.022 136.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865706e+00 | Ndiff 0.020 137.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865703e+00 | Ndiff 0.017 138.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865700e+00 | Ndiff 0.015 139.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865699e+00 | Ndiff 0.014 140.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865697e+00 | Ndiff 0.012 141.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865696e+00 | Ndiff 0.011 142.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865696e+00 | Ndiff 0.009 143.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865695e+00 | Ndiff 0.008 144.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865695e+00 | Ndiff 0.007 145.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865694e+00 | Ndiff 0.006 146.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865694e+00 | Ndiff 0.005 147.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865694e+00 | Ndiff 0.005 148.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865694e+00 | Ndiff 0.004 149.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865694e+00 | Ndiff 0.004 150.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865694e+00 | Ndiff 0.003 151.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865694e+00 | Ndiff 0.003 152.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.699865694e+00 | Ndiff 0.002 153.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865694e+00 | Ndiff 0.002 154.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865694e+00 | Ndiff 0.002 155.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865694e+00 | Ndiff 0.002 156.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865694e+00 | Ndiff 0.001 157.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865694e+00 | Ndiff 0.001 158.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.001 159.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.001 160.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.001 161.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.001 162.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.001 163.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.001 164.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.000 165.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.000 166.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.000 167.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.000 168.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.000 169.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.000 170.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.000 171.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.000 172.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.000 173.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.000 174.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.000 175.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.699865693e+00 | Ndiff 0.000 ... done. converged. Learn Alg: memoVB | task 3/3 | alg. seed: 6168832 | data order seed: 7360256 task_output_path: /tmp/mocap6/test-model=FiniteMixtureModel+DiagGauss-ECovMat=1*eye/3 1.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.967149643e+00 | 2.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.828051356e+00 | Ndiff 79.117 3.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.796678874e+00 | Ndiff 51.355 4.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.782958585e+00 | Ndiff 34.942 5.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.772865919e+00 | Ndiff 33.222 6.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.768379291e+00 | Ndiff 18.402 7.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.765922644e+00 | Ndiff 9.243 8.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.763522049e+00 | Ndiff 12.443 9.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.759687240e+00 | Ndiff 18.742 10.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.758329562e+00 | Ndiff 15.307 11.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.757284595e+00 | Ndiff 14.151 12.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.755332671e+00 | Ndiff 16.539 13.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.751936044e+00 | Ndiff 19.374 14.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.749232109e+00 | Ndiff 18.939 15.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.745412591e+00 | Ndiff 18.269 16.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.741711477e+00 | Ndiff 20.402 17.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.739209544e+00 | Ndiff 18.430 18.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.737744024e+00 | Ndiff 13.082 19.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.737042157e+00 | Ndiff 10.524 20.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.736410038e+00 | Ndiff 8.500 21.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.735755836e+00 | Ndiff 6.634 22.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.734903519e+00 | Ndiff 5.964 23.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.733948260e+00 | Ndiff 5.787 24.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.732926027e+00 | Ndiff 5.839 25.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.731979439e+00 | Ndiff 5.735 26.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.731382239e+00 | Ndiff 5.591 27.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.731262368e+00 | Ndiff 5.144 28.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.731165872e+00 | Ndiff 4.593 29.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.731086681e+00 | Ndiff 4.064 30.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.731027897e+00 | Ndiff 3.407 31.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730989046e+00 | Ndiff 2.691 32.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730964762e+00 | Ndiff 2.058 33.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730949343e+00 | Ndiff 1.571 34.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730938956e+00 | Ndiff 1.216 35.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730931280e+00 | Ndiff 0.956 36.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730924798e+00 | Ndiff 0.760 37.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730918563e+00 | Ndiff 0.606 38.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730912654e+00 | Ndiff 0.476 39.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730908305e+00 | Ndiff 0.360 40.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730905994e+00 | Ndiff 0.260 41.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730904916e+00 | Ndiff 0.181 42.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730904381e+00 | Ndiff 0.122 43.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730904090e+00 | Ndiff 0.080 44.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903919e+00 | Ndiff 0.057 45.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903813e+00 | Ndiff 0.050 46.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903744e+00 | Ndiff 0.044 47.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903698e+00 | Ndiff 0.038 48.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903665e+00 | Ndiff 0.033 49.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903641e+00 | Ndiff 0.029 50.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903623e+00 | Ndiff 0.025 51.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903609e+00 | Ndiff 0.022 52.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903598e+00 | Ndiff 0.019 53.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903589e+00 | Ndiff 0.016 54.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903582e+00 | Ndiff 0.014 55.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903575e+00 | Ndiff 0.012 56.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903570e+00 | Ndiff 0.011 57.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903565e+00 | Ndiff 0.010 58.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903561e+00 | Ndiff 0.009 59.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903557e+00 | Ndiff 0.008 60.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903554e+00 | Ndiff 0.008 61.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903550e+00 | Ndiff 0.007 62.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903547e+00 | Ndiff 0.007 63.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903544e+00 | Ndiff 0.007 64.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.730903541e+00 | Ndiff 0.006 65.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903538e+00 | Ndiff 0.006 66.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903535e+00 | Ndiff 0.006 67.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903532e+00 | Ndiff 0.006 68.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903528e+00 | Ndiff 0.006 69.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903525e+00 | Ndiff 0.006 70.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903521e+00 | Ndiff 0.006 71.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903517e+00 | Ndiff 0.007 72.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903513e+00 | Ndiff 0.007 73.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903508e+00 | Ndiff 0.007 74.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903502e+00 | Ndiff 0.008 75.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903495e+00 | Ndiff 0.009 76.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903488e+00 | Ndiff 0.009 77.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903478e+00 | Ndiff 0.010 78.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903466e+00 | Ndiff 0.011 79.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903451e+00 | Ndiff 0.013 80.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903431e+00 | Ndiff 0.015 81.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903405e+00 | Ndiff 0.017 82.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903367e+00 | Ndiff 0.020 83.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903312e+00 | Ndiff 0.025 84.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903227e+00 | Ndiff 0.030 85.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730903088e+00 | Ndiff 0.039 86.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730902847e+00 | Ndiff 0.051 87.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730902397e+00 | Ndiff 0.068 88.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730901499e+00 | Ndiff 0.096 89.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730899644e+00 | Ndiff 0.136 90.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730896100e+00 | Ndiff 0.185 91.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730891244e+00 | Ndiff 0.217 92.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730887713e+00 | Ndiff 0.198 93.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730886264e+00 | Ndiff 0.145 94.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730885689e+00 | Ndiff 0.098 95.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730885409e+00 | Ndiff 0.086 96.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730885256e+00 | Ndiff 0.074 97.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730885166e+00 | Ndiff 0.064 98.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730885111e+00 | Ndiff 0.054 99.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730885076e+00 | Ndiff 0.045 100.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730885053e+00 | Ndiff 0.038 101.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730885038e+00 | Ndiff 0.031 102.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730885028e+00 | Ndiff 0.026 103.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730885022e+00 | Ndiff 0.022 104.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730885017e+00 | Ndiff 0.018 105.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730885014e+00 | Ndiff 0.015 106.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730885012e+00 | Ndiff 0.012 107.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.730885010e+00 | Ndiff 0.010 108.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885009e+00 | Ndiff 0.008 109.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885008e+00 | Ndiff 0.007 110.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885007e+00 | Ndiff 0.006 111.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885007e+00 | Ndiff 0.005 112.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885007e+00 | Ndiff 0.004 113.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885007e+00 | Ndiff 0.003 114.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.003 115.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.002 116.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.002 117.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.002 118.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.001 119.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.001 120.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.001 121.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.001 122.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.001 123.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.001 124.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.000 125.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.000 126.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.000 127.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.000 128.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.000 129.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.000 130.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.000 131.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.000 132.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.000 133.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.730885006e+00 | Ndiff 0.000 ... done. converged. .. GENERATED FROM PYTHON SOURCE LINES 113-117 FiniteTopicModel with *DiagGauss* observation model --------------------------------------------------- We'll take the best of 3 independent inits ('tasks') .. GENERATED FROM PYTHON SOURCE LINES 118-129 .. code-block:: default finite_model, finite_info_dict = bnpy.run( dataset, 'FiniteTopicModel', 'DiagGauss', 'memoVB', output_path='/tmp/mocap6/test-model=FiniteTopicModel+DiagGauss-ECovMat=1*eye/', nLap=nLap, nTask=3, nBatch=1, convergeThr=0.0001, alpha=alpha, sF=sF, ECovMat=ECovMat, K=K, initname='randexamples', ) .. rst-class:: sphx-glr-script-out .. code-block:: none Dataset Summary: GroupXData total size: 6 units batch size: 6 units num. batches: 1 Allocation Model: Finite LDA model with K=0 comps. alpha=0.25 Obs. Data Model: Gaussian with diagonal covariance. Obs. Data Prior: independent Gauss-Wishart prior on each dimension Wishart params nu = 14 ... beta = [ 12 12] ... Expectations E[ mean[k]] = [ 0 0] ... E[ covar[k]] = [[1. 0.] [0. 1.]] ... Initialization: initname = randexamples K = 10 (number of clusters) seed = 1607680 elapsed_time: 0.0 sec Learn Alg: memoVB | task 1/3 | alg. seed: 1607680 | data order seed: 8541952 task_output_path: /tmp/mocap6/test-model=FiniteTopicModel+DiagGauss-ECovMat=1*eye/1 1.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.891536742e+00 | 2.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.786835062e+00 | Ndiff 100.168 3.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.737768323e+00 | Ndiff 54.412 4.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.727530929e+00 | Ndiff 36.160 5.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.723599603e+00 | Ndiff 26.974 6.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.720184656e+00 | Ndiff 22.499 7.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.716998422e+00 | Ndiff 22.206 8.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.715387533e+00 | Ndiff 16.806 9.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.714440630e+00 | Ndiff 10.356 10.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.713941267e+00 | Ndiff 3.672 11.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.713490672e+00 | Ndiff 3.962 12.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.712721251e+00 | Ndiff 8.406 13.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.709656117e+00 | Ndiff 18.434 14.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.707579347e+00 | Ndiff 18.312 15.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.705009393e+00 | Ndiff 31.500 16.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.701748620e+00 | Ndiff 35.950 17.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.699449456e+00 | Ndiff 27.531 18.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698201416e+00 | Ndiff 19.346 19.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.697699814e+00 | Ndiff 12.325 20.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.697477890e+00 | Ndiff 7.456 21.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.697313612e+00 | Ndiff 5.183 22.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.696877399e+00 | Ndiff 6.362 23.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.696505373e+00 | Ndiff 5.676 24.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.696307102e+00 | Ndiff 6.036 25.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.696102448e+00 | Ndiff 6.737 26.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.695679447e+00 | Ndiff 9.203 27.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.694597144e+00 | Ndiff 14.376 28.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.685041402e+00 | Ndiff 30.853 29.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.677597746e+00 | Ndiff 12.311 30.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.677178999e+00 | Ndiff 3.866 31.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.677035862e+00 | Ndiff 3.125 32.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676949548e+00 | Ndiff 2.439 33.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676894316e+00 | Ndiff 1.982 34.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676858843e+00 | Ndiff 1.695 35.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676835687e+00 | Ndiff 1.532 36.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676819789e+00 | Ndiff 1.462 37.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676806623e+00 | Ndiff 1.466 38.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676792922e+00 | Ndiff 1.542 39.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676775557e+00 | Ndiff 1.710 40.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676748564e+00 | Ndiff 2.025 41.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676693004e+00 | Ndiff 2.634 42.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676524660e+00 | Ndiff 3.860 43.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676128557e+00 | Ndiff 4.531 44.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675947549e+00 | Ndiff 2.672 45.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675701308e+00 | Ndiff 4.027 46.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.674381849e+00 | Ndiff 9.925 47.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.672209170e+00 | Ndiff 9.991 48.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671381562e+00 | Ndiff 5.094 49.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671175512e+00 | Ndiff 2.531 50.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671118852e+00 | Ndiff 1.391 51.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671088115e+00 | Ndiff 1.059 52.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671063566e+00 | Ndiff 0.862 53.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671040587e+00 | Ndiff 0.964 54.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671015918e+00 | Ndiff 1.079 55.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.670984376e+00 | Ndiff 1.257 56.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.670928558e+00 | Ndiff 1.644 57.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.670576140e+00 | Ndiff 3.828 58.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.669803526e+00 | Ndiff 3.982 59.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667628451e+00 | Ndiff 10.333 60.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.662580979e+00 | Ndiff 19.256 61.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.659597910e+00 | Ndiff 12.581 62.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.659084894e+00 | Ndiff 4.864 63.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658994520e+00 | Ndiff 3.645 64.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658962219e+00 | Ndiff 3.068 65.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658943558e+00 | Ndiff 2.439 66.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658932421e+00 | Ndiff 1.960 67.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658926018e+00 | Ndiff 1.629 68.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658921743e+00 | Ndiff 1.393 69.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658918574e+00 | Ndiff 1.207 70.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658916156e+00 | Ndiff 1.053 71.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658914300e+00 | Ndiff 0.920 72.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658912874e+00 | Ndiff 0.805 73.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658911779e+00 | Ndiff 0.705 74.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658910936e+00 | Ndiff 0.618 75.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658910286e+00 | Ndiff 0.542 76.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658909782e+00 | Ndiff 0.475 77.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658909391e+00 | Ndiff 0.418 78.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658909085e+00 | Ndiff 0.368 79.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.658908845e+00 | Ndiff 0.324 80.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658908656e+00 | Ndiff 0.287 81.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658908506e+00 | Ndiff 0.254 82.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658908388e+00 | Ndiff 0.225 83.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658908293e+00 | Ndiff 0.200 84.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658908217e+00 | Ndiff 0.178 85.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658908157e+00 | Ndiff 0.158 86.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658908108e+00 | Ndiff 0.141 87.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658908069e+00 | Ndiff 0.126 88.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658908037e+00 | Ndiff 0.113 89.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658908011e+00 | Ndiff 0.101 90.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907990e+00 | Ndiff 0.091 91.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907973e+00 | Ndiff 0.081 92.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907959e+00 | Ndiff 0.073 93.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907948e+00 | Ndiff 0.066 94.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907939e+00 | Ndiff 0.059 95.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907931e+00 | Ndiff 0.053 96.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907925e+00 | Ndiff 0.048 97.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907920e+00 | Ndiff 0.043 98.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907916e+00 | Ndiff 0.039 99.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907912e+00 | Ndiff 0.035 100.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907910e+00 | Ndiff 0.032 101.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907907e+00 | Ndiff 0.029 102.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907905e+00 | Ndiff 0.026 103.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907904e+00 | Ndiff 0.023 104.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907902e+00 | Ndiff 0.021 105.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907901e+00 | Ndiff 0.019 106.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907900e+00 | Ndiff 0.017 107.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907899e+00 | Ndiff 0.016 108.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907899e+00 | Ndiff 0.014 109.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907898e+00 | Ndiff 0.013 110.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.658907898e+00 | Ndiff 0.012 111.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907897e+00 | Ndiff 0.011 112.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907897e+00 | Ndiff 0.010 113.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907897e+00 | Ndiff 0.009 114.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907897e+00 | Ndiff 0.008 115.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907896e+00 | Ndiff 0.007 116.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907896e+00 | Ndiff 0.006 117.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907896e+00 | Ndiff 0.006 118.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907896e+00 | Ndiff 0.005 119.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907896e+00 | Ndiff 0.005 120.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907896e+00 | Ndiff 0.004 121.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907896e+00 | Ndiff 0.004 122.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907896e+00 | Ndiff 0.004 123.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907896e+00 | Ndiff 0.003 124.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.003 125.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.003 126.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.002 127.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.002 128.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.002 129.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.002 130.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.002 131.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.002 132.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.001 133.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.001 134.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.001 135.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.001 136.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.001 137.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.001 138.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.001 139.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.001 140.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.001 141.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.001 142.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.001 143.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.001 144.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.001 145.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 146.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 147.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 148.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 149.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 150.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 151.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 152.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 153.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 154.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 155.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 156.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 157.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 158.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 159.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 160.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 161.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 162.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 163.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 164.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 165.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 166.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 167.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 168.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 169.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 170.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 171.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 172.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 173.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.658907895e+00 | Ndiff 0.000 ... done. converged. Learn Alg: memoVB | task 2/3 | alg. seed: 6454144 | data order seed: 7673856 task_output_path: /tmp/mocap6/test-model=FiniteTopicModel+DiagGauss-ECovMat=1*eye/2 1.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.880184431e+00 | 2.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.764859066e+00 | Ndiff 112.442 3.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.738339717e+00 | Ndiff 72.461 4.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.727102696e+00 | Ndiff 34.021 5.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.723290640e+00 | Ndiff 18.413 6.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.721257524e+00 | Ndiff 12.878 7.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.719665840e+00 | Ndiff 9.414 8.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.716901295e+00 | Ndiff 8.670 9.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.711708303e+00 | Ndiff 17.965 10.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.708128748e+00 | Ndiff 11.378 11.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.704997434e+00 | Ndiff 18.098 12.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.700673297e+00 | Ndiff 17.565 13.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.698778197e+00 | Ndiff 7.903 14.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.697412782e+00 | Ndiff 7.157 15.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.694910478e+00 | Ndiff 10.513 16.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.693728597e+00 | Ndiff 6.605 17.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.693077000e+00 | Ndiff 7.869 18.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.692532523e+00 | Ndiff 6.844 19.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.692143422e+00 | Ndiff 5.583 20.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.691998288e+00 | Ndiff 6.167 21.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.691834302e+00 | Ndiff 5.504 22.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.691304074e+00 | Ndiff 5.165 23.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.690058738e+00 | Ndiff 7.024 24.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.689077116e+00 | Ndiff 5.213 25.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.687879680e+00 | Ndiff 6.973 26.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.686665382e+00 | Ndiff 8.328 27.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.685935307e+00 | Ndiff 6.335 28.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684127183e+00 | Ndiff 3.752 29.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676324926e+00 | Ndiff 8.834 30.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675711143e+00 | Ndiff 5.643 31.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675544855e+00 | Ndiff 3.459 32.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675461158e+00 | Ndiff 2.651 33.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675417130e+00 | Ndiff 2.102 34.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675392533e+00 | Ndiff 1.717 35.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675377646e+00 | Ndiff 1.453 36.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675367888e+00 | Ndiff 1.274 37.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675361010e+00 | Ndiff 1.156 38.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675355822e+00 | Ndiff 1.082 39.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675351632e+00 | Ndiff 1.044 40.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675347996e+00 | Ndiff 1.035 41.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675344596e+00 | Ndiff 1.056 42.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675341159e+00 | Ndiff 1.106 43.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675337420e+00 | Ndiff 1.188 44.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675333028e+00 | Ndiff 1.317 45.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675327477e+00 | Ndiff 1.506 46.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675319930e+00 | Ndiff 1.782 47.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675308859e+00 | Ndiff 2.188 48.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675291266e+00 | Ndiff 2.801 49.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675260893e+00 | Ndiff 3.749 50.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675204290e+00 | Ndiff 5.243 51.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675093495e+00 | Ndiff 7.577 52.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.674877831e+00 | Ndiff 11.020 53.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.674494204e+00 | Ndiff 15.319 54.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.674002187e+00 | Ndiff 18.736 55.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.673459444e+00 | Ndiff 20.095 56.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.672940405e+00 | Ndiff 18.174 57.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.672466743e+00 | Ndiff 15.318 58.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671825477e+00 | Ndiff 14.597 59.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671050065e+00 | Ndiff 13.869 60.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.670432981e+00 | Ndiff 12.032 61.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.669861634e+00 | Ndiff 10.912 62.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.669261301e+00 | Ndiff 10.844 63.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667301180e+00 | Ndiff 11.473 64.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667137918e+00 | Ndiff 3.900 65.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667105076e+00 | Ndiff 2.261 66.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667096981e+00 | Ndiff 1.481 67.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667094652e+00 | Ndiff 1.299 68.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667093899e+00 | Ndiff 1.140 69.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667093665e+00 | Ndiff 0.996 70.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667093628e+00 | Ndiff 0.868 71.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667093673e+00 | Ndiff 0.756 72.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667093757e+00 | Ndiff 0.658 73.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667093860e+00 | Ndiff 0.573 74.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667093971e+00 | Ndiff 0.499 75.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667094084e+00 | Ndiff 0.436 76.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667094196e+00 | Ndiff 0.381 77.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667094304e+00 | Ndiff 0.333 78.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667094408e+00 | Ndiff 0.291 79.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667094505e+00 | Ndiff 0.255 80.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667094596e+00 | Ndiff 0.224 81.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667094680e+00 | Ndiff 0.197 82.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667094757e+00 | Ndiff 0.173 83.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667094829e+00 | Ndiff 0.152 84.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667094894e+00 | Ndiff 0.134 85.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667094953e+00 | Ndiff 0.118 86.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095007e+00 | Ndiff 0.104 87.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095056e+00 | Ndiff 0.091 88.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095100e+00 | Ndiff 0.081 89.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095140e+00 | Ndiff 0.071 90.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095176e+00 | Ndiff 0.063 91.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095209e+00 | Ndiff 0.056 92.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095238e+00 | Ndiff 0.049 93.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095264e+00 | Ndiff 0.043 94.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095287e+00 | Ndiff 0.038 95.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095309e+00 | Ndiff 0.034 96.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095327e+00 | Ndiff 0.030 97.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095344e+00 | Ndiff 0.026 98.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095359e+00 | Ndiff 0.023 99.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095373e+00 | Ndiff 0.021 100.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095385e+00 | Ndiff 0.018 101.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095396e+00 | Ndiff 0.016 102.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095406e+00 | Ndiff 0.014 103.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095414e+00 | Ndiff 0.013 104.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095422e+00 | Ndiff 0.011 105.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095429e+00 | Ndiff 0.010 106.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095435e+00 | Ndiff 0.009 107.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095440e+00 | Ndiff 0.008 108.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095445e+00 | Ndiff 0.007 109.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095449e+00 | Ndiff 0.006 110.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667095453e+00 | Ndiff 0.005 111.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095457e+00 | Ndiff 0.005 112.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095460e+00 | Ndiff 0.004 113.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095463e+00 | Ndiff 0.004 114.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095465e+00 | Ndiff 0.003 115.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095467e+00 | Ndiff 0.003 116.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095469e+00 | Ndiff 0.003 117.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095471e+00 | Ndiff 0.002 118.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095472e+00 | Ndiff 0.002 119.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095474e+00 | Ndiff 0.002 120.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095475e+00 | Ndiff 0.002 121.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095476e+00 | Ndiff 0.001 122.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095477e+00 | Ndiff 0.001 123.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095478e+00 | Ndiff 0.001 124.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095479e+00 | Ndiff 0.001 125.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095479e+00 | Ndiff 0.001 126.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095480e+00 | Ndiff 0.001 127.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095480e+00 | Ndiff 0.001 128.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095481e+00 | Ndiff 0.001 129.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095481e+00 | Ndiff 0.001 130.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095482e+00 | Ndiff 0.000 131.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095482e+00 | Ndiff 0.000 132.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095482e+00 | Ndiff 0.000 133.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095482e+00 | Ndiff 0.000 134.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095483e+00 | Ndiff 0.000 135.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095483e+00 | Ndiff 0.000 136.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095483e+00 | Ndiff 0.000 137.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095483e+00 | Ndiff 0.000 138.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095483e+00 | Ndiff 0.000 139.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095484e+00 | Ndiff 0.000 140.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095484e+00 | Ndiff 0.000 141.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095484e+00 | Ndiff 0.000 142.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095484e+00 | Ndiff 0.000 143.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667095484e+00 | Ndiff 0.000 ... done. converged. Learn Alg: memoVB | task 3/3 | alg. seed: 6168832 | data order seed: 7360256 task_output_path: /tmp/mocap6/test-model=FiniteTopicModel+DiagGauss-ECovMat=1*eye/3 1.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.960889382e+00 | 2.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.812954811e+00 | Ndiff 106.901 3.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.775678774e+00 | Ndiff 68.748 4.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.760183281e+00 | Ndiff 29.861 5.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.752879371e+00 | Ndiff 25.952 6.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.749282461e+00 | Ndiff 24.923 7.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.741353570e+00 | Ndiff 30.374 8.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.734628562e+00 | Ndiff 12.783 9.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.733089112e+00 | Ndiff 9.680 10.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.729618996e+00 | Ndiff 11.796 11.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.728491286e+00 | Ndiff 3.954 12.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.728005826e+00 | Ndiff 4.496 13.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.727627474e+00 | Ndiff 2.491 14.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.727448628e+00 | Ndiff 1.857 15.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.727142224e+00 | Ndiff 2.028 16.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.726427129e+00 | Ndiff 5.899 17.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.724227916e+00 | Ndiff 9.490 18.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.723804571e+00 | Ndiff 3.002 19.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.723565436e+00 | Ndiff 2.800 20.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.723446675e+00 | Ndiff 2.095 21.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.723273245e+00 | Ndiff 2.483 22.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.722684880e+00 | Ndiff 3.864 23.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721978561e+00 | Ndiff 2.712 24.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721938966e+00 | Ndiff 0.670 25.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721935848e+00 | Ndiff 0.248 26.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721934654e+00 | Ndiff 0.148 27.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721933859e+00 | Ndiff 0.112 28.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721932594e+00 | Ndiff 0.086 29.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721925386e+00 | Ndiff 0.125 30.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721787282e+00 | Ndiff 0.511 31.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721646191e+00 | Ndiff 0.232 32.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721534458e+00 | Ndiff 0.503 33.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721204789e+00 | Ndiff 0.529 34.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721199428e+00 | Ndiff 0.232 35.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721197505e+00 | Ndiff 0.160 36.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721196629e+00 | Ndiff 0.113 37.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721196193e+00 | Ndiff 0.092 38.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721195962e+00 | Ndiff 0.076 39.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721195834e+00 | Ndiff 0.064 40.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721195760e+00 | Ndiff 0.053 41.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721195715e+00 | Ndiff 0.045 42.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721195687e+00 | Ndiff 0.038 43.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721195668e+00 | Ndiff 0.032 44.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721195656e+00 | Ndiff 0.028 45.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721195648e+00 | Ndiff 0.026 46.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721195643e+00 | Ndiff 0.023 47.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721195639e+00 | Ndiff 0.020 48.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721195636e+00 | Ndiff 0.018 49.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721195634e+00 | Ndiff 0.016 50.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721195632e+00 | Ndiff 0.014 51.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195631e+00 | Ndiff 0.012 52.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195631e+00 | Ndiff 0.011 53.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195630e+00 | Ndiff 0.009 54.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195630e+00 | Ndiff 0.008 55.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195629e+00 | Ndiff 0.007 56.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195629e+00 | Ndiff 0.006 57.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195629e+00 | Ndiff 0.005 58.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195629e+00 | Ndiff 0.005 59.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195629e+00 | Ndiff 0.004 60.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195629e+00 | Ndiff 0.003 61.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195629e+00 | Ndiff 0.003 62.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.003 63.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.002 64.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.002 65.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.002 66.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.001 67.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.001 68.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.001 69.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.001 70.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.001 71.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.001 72.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.001 73.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.001 74.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.000 75.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.000 76.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.000 77.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.000 78.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.000 79.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.000 80.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.000 81.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.000 82.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.000 83.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.000 84.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.000 85.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721195628e+00 | Ndiff 0.000 ... done. converged. .. GENERATED FROM PYTHON SOURCE LINES 130-135 HDP-HMM with *DiagGauss* observation model ------------------------------------------- We'll take the best of 3 independent inits ('tasks') .. GENERATED FROM PYTHON SOURCE LINES 136-147 .. code-block:: default hdp_topic_model, hdp_info_dict = bnpy.run( dataset, 'HDPTopicModel', 'DiagGauss', 'memoVB', output_path='/tmp/mocap6/test-model=HDPTopicModel+DiagGauss-ECovMat=1*eye/', nLap=nLap, nTask=3, nBatch=1, convergeThr=0.0001, gamma=gamma, alpha=alpha, sF=sF, ECovMat=ECovMat, K=K, initname='randexamples', moves='shuffle', ) .. rst-class:: sphx-glr-script-out .. code-block:: none Dataset Summary: GroupXData total size: 6 units batch size: 6 units num. batches: 1 Allocation Model: HDP model with K=0 active comps. gamma=5.00. alpha=0.25 Obs. Data Model: Gaussian with diagonal covariance. Obs. Data Prior: independent Gauss-Wishart prior on each dimension Wishart params nu = 14 ... beta = [ 12 12] ... Expectations E[ mean[k]] = [ 0 0] ... E[ covar[k]] = [[1. 0.] [0. 1.]] ... Initialization: initname = randexamples K = 10 (number of clusters) seed = 1607680 elapsed_time: 0.0 sec Learn Alg: memoVB | task 1/3 | alg. seed: 1607680 | data order seed: 8541952 task_output_path: /tmp/mocap6/test-model=HDPTopicModel+DiagGauss-ECovMat=1*eye/1 1.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.892295970e+00 | 2.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.787474069e+00 | Ndiff 167.893 3.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.738420912e+00 | Ndiff 108.155 4.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.728232794e+00 | Ndiff 36.020 5.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.724249654e+00 | Ndiff 78.033 6.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.721009176e+00 | Ndiff 87.093 7.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.717815642e+00 | Ndiff 110.105 8.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.716133498e+00 | Ndiff 17.207 9.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.715152039e+00 | Ndiff 108.292 10.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.714666091e+00 | Ndiff 3.784 11.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.714242891e+00 | Ndiff 3.528 12.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.713537978e+00 | Ndiff 8.000 13.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.710603627e+00 | Ndiff 35.132 14.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.708700954e+00 | Ndiff 16.257 15.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.706776744e+00 | Ndiff 75.015 16.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.703666205e+00 | Ndiff 42.738 17.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.700832620e+00 | Ndiff 27.477 18.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.699218948e+00 | Ndiff 23.414 19.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698514238e+00 | Ndiff 52.198 20.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698213092e+00 | Ndiff 9.303 21.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.698031745e+00 | Ndiff 6.076 22.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.697593507e+00 | Ndiff 6.353 23.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.697312701e+00 | Ndiff 5.777 24.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.697000999e+00 | Ndiff 5.781 25.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.696799733e+00 | Ndiff 6.540 26.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.696450679e+00 | Ndiff 8.455 27.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.695590334e+00 | Ndiff 12.813 28.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.690354289e+00 | Ndiff 25.794 29.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.678496849e+00 | Ndiff 20.770 30.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.677870894e+00 | Ndiff 4.266 31.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.677699846e+00 | Ndiff 3.254 32.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.677604942e+00 | Ndiff 2.568 33.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.677544330e+00 | Ndiff 2.070 34.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.677505748e+00 | Ndiff 1.750 35.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.677480640e+00 | Ndiff 1.561 36.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.677463781e+00 | Ndiff 1.472 37.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.677450456e+00 | Ndiff 1.459 38.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.677437218e+00 | Ndiff 1.516 39.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.677421149e+00 | Ndiff 1.659 40.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.677397455e+00 | Ndiff 1.929 41.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.677352400e+00 | Ndiff 2.442 42.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.677228102e+00 | Ndiff 3.488 43.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.676860040e+00 | Ndiff 44.712 44.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.676621743e+00 | Ndiff 2.927 45.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.676434834e+00 | Ndiff 3.269 46.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675565207e+00 | Ndiff 8.094 47.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.673280429e+00 | Ndiff 11.293 48.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.672136550e+00 | Ndiff 6.062 49.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671844779e+00 | Ndiff 3.071 50.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671769618e+00 | Ndiff 1.512 51.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671735696e+00 | Ndiff 1.142 52.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671710158e+00 | Ndiff 0.876 53.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671687061e+00 | Ndiff 0.939 54.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671663107e+00 | Ndiff 1.047 55.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671633942e+00 | Ndiff 1.205 56.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671587402e+00 | Ndiff 1.514 57.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671425597e+00 | Ndiff 64.143 58.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.670559079e+00 | Ndiff 4.216 59.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.669226819e+00 | Ndiff 8.370 60.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.664809723e+00 | Ndiff 127.493 61.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.660628433e+00 | Ndiff 74.491 62.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.659730940e+00 | Ndiff 5.971 63.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.659588723e+00 | Ndiff 3.721 64.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659548008e+00 | Ndiff 3.247 65.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659526731e+00 | Ndiff 2.593 66.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659513884e+00 | Ndiff 2.070 67.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659506608e+00 | Ndiff 1.704 68.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659501945e+00 | Ndiff 1.447 69.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659498546e+00 | Ndiff 1.251 70.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659495962e+00 | Ndiff 1.089 71.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659493979e+00 | Ndiff 0.951 72.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659492457e+00 | Ndiff 0.832 73.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659491287e+00 | Ndiff 0.728 74.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659490387e+00 | Ndiff 0.638 75.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659489693e+00 | Ndiff 0.560 76.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659489156e+00 | Ndiff 0.491 77.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659488739e+00 | Ndiff 0.431 78.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659488414e+00 | Ndiff 0.380 79.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659488159e+00 | Ndiff 0.335 80.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659487958e+00 | Ndiff 0.295 81.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659487800e+00 | Ndiff 0.261 82.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659487674e+00 | Ndiff 0.232 83.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659487574e+00 | Ndiff 0.206 84.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659487493e+00 | Ndiff 0.183 85.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659487429e+00 | Ndiff 0.163 86.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659487378e+00 | Ndiff 0.145 87.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659487336e+00 | Ndiff 0.130 88.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659487303e+00 | Ndiff 0.116 89.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659487275e+00 | Ndiff 0.104 90.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659487253e+00 | Ndiff 0.093 91.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.659487235e+00 | Ndiff 0.083 92.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487221e+00 | Ndiff 0.075 93.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487209e+00 | Ndiff 0.067 94.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487199e+00 | Ndiff 0.061 95.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487191e+00 | Ndiff 0.054 96.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487185e+00 | Ndiff 0.049 97.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487179e+00 | Ndiff 0.044 98.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487175e+00 | Ndiff 0.040 99.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487171e+00 | Ndiff 0.036 100.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487168e+00 | Ndiff 0.032 101.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487166e+00 | Ndiff 0.029 102.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487164e+00 | Ndiff 0.026 103.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487162e+00 | Ndiff 0.024 104.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487160e+00 | Ndiff 0.022 105.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487159e+00 | Ndiff 0.020 106.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487158e+00 | Ndiff 0.018 107.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487157e+00 | Ndiff 0.016 108.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487157e+00 | Ndiff 0.014 109.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487156e+00 | Ndiff 0.013 110.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487156e+00 | Ndiff 0.012 111.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487155e+00 | Ndiff 0.011 112.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487155e+00 | Ndiff 0.010 113.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487155e+00 | Ndiff 0.009 114.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487154e+00 | Ndiff 0.008 115.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487154e+00 | Ndiff 0.007 116.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487154e+00 | Ndiff 0.007 117.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487154e+00 | Ndiff 0.006 118.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487154e+00 | Ndiff 0.005 119.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487154e+00 | Ndiff 0.005 120.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.004 121.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.004 122.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.004 123.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.003 124.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.003 125.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.003 126.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.003 127.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.002 128.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.002 129.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.002 130.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.002 131.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.002 132.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.001 133.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.001 134.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.001 135.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.001 136.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.001 137.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.001 138.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.001 139.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.001 140.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.001 141.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.001 142.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.001 143.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.001 144.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.001 145.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.001 146.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 147.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 148.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 149.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 150.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 151.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 152.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 153.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 154.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 155.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 156.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 157.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 158.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 159.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 160.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 161.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 162.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 163.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 164.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 165.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 166.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 167.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 168.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 169.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 170.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 171.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 172.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 173.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 174.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 175.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 176.000/200 after 6 sec. | 229.7 MiB | K 10 | loss 3.659487153e+00 | Ndiff 0.000 ... done. converged. Learn Alg: memoVB | task 2/3 | alg. seed: 6454144 | data order seed: 7673856 task_output_path: /tmp/mocap6/test-model=HDPTopicModel+DiagGauss-ECovMat=1*eye/2 1.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.880920404e+00 | 2.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.765501345e+00 | Ndiff 123.452 3.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.738970900e+00 | Ndiff 119.974 4.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.727728639e+00 | Ndiff 116.491 5.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.723915199e+00 | Ndiff 59.064 6.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.721881825e+00 | Ndiff 12.880 7.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.720290033e+00 | Ndiff 9.415 8.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.717525181e+00 | Ndiff 8.680 9.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.712323678e+00 | Ndiff 69.447 10.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.708723715e+00 | Ndiff 60.944 11.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.705600983e+00 | Ndiff 18.052 12.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.701263654e+00 | Ndiff 17.612 13.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.699354401e+00 | Ndiff 7.916 14.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.697988632e+00 | Ndiff 7.228 15.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.695500616e+00 | Ndiff 10.513 16.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.694332852e+00 | Ndiff 6.532 17.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.693682853e+00 | Ndiff 83.782 18.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.693140427e+00 | Ndiff 6.884 19.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.692745178e+00 | Ndiff 5.615 20.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.692598586e+00 | Ndiff 84.628 21.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.692435018e+00 | Ndiff 5.514 22.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.691909025e+00 | Ndiff 5.148 23.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.690663839e+00 | Ndiff 7.039 24.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.689681584e+00 | Ndiff 5.217 25.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.688485649e+00 | Ndiff 6.961 26.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.687269748e+00 | Ndiff 8.328 27.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.686538275e+00 | Ndiff 6.367 28.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.684738467e+00 | Ndiff 3.738 29.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676905434e+00 | Ndiff 67.558 30.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676275839e+00 | Ndiff 83.442 31.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676106766e+00 | Ndiff 3.455 32.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.676022777e+00 | Ndiff 2.647 33.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675978705e+00 | Ndiff 2.098 34.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675954102e+00 | Ndiff 1.713 35.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675939216e+00 | Ndiff 1.450 36.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.675929461e+00 | Ndiff 1.271 37.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675922588e+00 | Ndiff 1.153 38.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675917407e+00 | Ndiff 1.079 39.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675913228e+00 | Ndiff 1.040 40.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675909608e+00 | Ndiff 1.031 41.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675906229e+00 | Ndiff 1.050 42.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675902821e+00 | Ndiff 1.100 43.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675899122e+00 | Ndiff 1.180 44.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675894786e+00 | Ndiff 1.308 45.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675889322e+00 | Ndiff 1.494 46.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675881912e+00 | Ndiff 1.765 47.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675871075e+00 | Ndiff 2.163 48.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675853912e+00 | Ndiff 2.764 49.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675824388e+00 | Ndiff 3.693 50.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675769526e+00 | Ndiff 5.155 51.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675662256e+00 | Ndiff 7.443 52.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675453045e+00 | Ndiff 10.832 53.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.675078263e+00 | Ndiff 15.117 54.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.674543392e+00 | Ndiff 18.541 55.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.674065124e+00 | Ndiff 19.929 56.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.673544290e+00 | Ndiff 18.310 57.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.673072186e+00 | Ndiff 15.454 58.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.672443191e+00 | Ndiff 14.628 59.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671651106e+00 | Ndiff 79.779 60.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.671009589e+00 | Ndiff 178.885 61.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.670458735e+00 | Ndiff 10.925 62.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.669877299e+00 | Ndiff 10.826 63.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.667858640e+00 | Ndiff 59.079 64.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667683358e+00 | Ndiff 3.970 65.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667648769e+00 | Ndiff 2.299 66.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667640942e+00 | Ndiff 1.492 67.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667639384e+00 | Ndiff 1.308 68.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667639407e+00 | Ndiff 1.149 69.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667639812e+00 | Ndiff 1.005 70.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667640267e+00 | Ndiff 0.876 71.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667640685e+00 | Ndiff 0.763 72.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667641052e+00 | Ndiff 0.665 73.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667641372e+00 | Ndiff 0.579 74.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667641652e+00 | Ndiff 0.505 75.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667641898e+00 | Ndiff 0.441 76.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667642118e+00 | Ndiff 0.385 77.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667642313e+00 | Ndiff 0.337 78.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667642488e+00 | Ndiff 0.295 79.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667642644e+00 | Ndiff 0.259 80.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667642785e+00 | Ndiff 0.227 81.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667642911e+00 | Ndiff 0.199 82.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667643024e+00 | Ndiff 0.175 83.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667643126e+00 | Ndiff 0.154 84.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667643218e+00 | Ndiff 0.136 85.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667643300e+00 | Ndiff 0.119 86.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667643374e+00 | Ndiff 313.637 87.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667643527e+00 | Ndiff 0.101 88.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667643638e+00 | Ndiff 284.695 89.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667643784e+00 | Ndiff 0.082 90.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.667643880e+00 | Ndiff 0.071 91.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667643942e+00 | Ndiff 0.061 92.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667643990e+00 | Ndiff 0.054 93.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644030e+00 | Ndiff 0.047 94.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644064e+00 | Ndiff 0.042 95.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644095e+00 | Ndiff 0.037 96.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644121e+00 | Ndiff 0.033 97.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644145e+00 | Ndiff 0.029 98.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644166e+00 | Ndiff 0.025 99.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644184e+00 | Ndiff 0.023 100.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644201e+00 | Ndiff 0.020 101.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644215e+00 | Ndiff 0.018 102.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644228e+00 | Ndiff 0.016 103.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644240e+00 | Ndiff 0.014 104.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644250e+00 | Ndiff 0.012 105.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644259e+00 | Ndiff 0.011 106.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644267e+00 | Ndiff 0.010 107.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644274e+00 | Ndiff 0.009 108.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644281e+00 | Ndiff 0.008 109.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644286e+00 | Ndiff 0.007 110.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644292e+00 | Ndiff 0.006 111.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644296e+00 | Ndiff 0.005 112.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644300e+00 | Ndiff 0.005 113.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644304e+00 | Ndiff 0.004 114.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644307e+00 | Ndiff 0.004 115.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644310e+00 | Ndiff 0.003 116.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644312e+00 | Ndiff 0.003 117.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644314e+00 | Ndiff 0.003 118.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644316e+00 | Ndiff 0.002 119.000/200 after 4 sec. | 229.7 MiB | K 10 | loss 3.667644318e+00 | Ndiff 0.002 120.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644320e+00 | Ndiff 0.002 121.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644321e+00 | Ndiff 0.002 122.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644322e+00 | Ndiff 0.001 123.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644323e+00 | Ndiff 0.001 124.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644324e+00 | Ndiff 0.001 125.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644325e+00 | Ndiff 0.001 126.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644326e+00 | Ndiff 0.001 127.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644327e+00 | Ndiff 0.001 128.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644327e+00 | Ndiff 0.001 129.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644328e+00 | Ndiff 0.001 130.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644328e+00 | Ndiff 0.001 131.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644329e+00 | Ndiff 0.000 132.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644329e+00 | Ndiff 0.000 133.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644330e+00 | Ndiff 0.000 134.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644330e+00 | Ndiff 0.000 135.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644330e+00 | Ndiff 0.000 136.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644330e+00 | Ndiff 0.000 137.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644331e+00 | Ndiff 0.000 138.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644331e+00 | Ndiff 0.000 139.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644331e+00 | Ndiff 0.000 140.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644331e+00 | Ndiff 0.000 141.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644331e+00 | Ndiff 0.000 142.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644331e+00 | Ndiff 0.000 143.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644331e+00 | Ndiff 0.000 144.000/200 after 5 sec. | 229.7 MiB | K 10 | loss 3.667644331e+00 | Ndiff 0.000 ... done. converged. Learn Alg: memoVB | task 3/3 | alg. seed: 6168832 | data order seed: 7360256 task_output_path: /tmp/mocap6/test-model=HDPTopicModel+DiagGauss-ECovMat=1*eye/3 1.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.961512682e+00 | 2.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.813561471e+00 | Ndiff 163.068 3.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.776258956e+00 | Ndiff 240.881 4.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.760790644e+00 | Ndiff 282.557 5.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.753457390e+00 | Ndiff 25.948 6.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.749857849e+00 | Ndiff 24.919 7.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.741928990e+00 | Ndiff 30.360 8.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.735207406e+00 | Ndiff 12.788 9.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.733663979e+00 | Ndiff 9.696 10.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.730193088e+00 | Ndiff 14.819 11.000/200 after 0 sec. | 229.7 MiB | K 10 | loss 3.729061704e+00 | Ndiff 3.956 12.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.728573893e+00 | Ndiff 4.488 13.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.728201595e+00 | Ndiff 2.416 14.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.728022593e+00 | Ndiff 1.867 15.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.727711958e+00 | Ndiff 2.028 16.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.726978910e+00 | Ndiff 6.024 17.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.724785894e+00 | Ndiff 13.289 18.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.724377310e+00 | Ndiff 2.981 19.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.724107513e+00 | Ndiff 103.930 20.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.723983831e+00 | Ndiff 2.098 21.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.723805772e+00 | Ndiff 2.504 22.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.723203621e+00 | Ndiff 3.888 23.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.722513644e+00 | Ndiff 2.643 24.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.722476542e+00 | Ndiff 0.654 25.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.722473498e+00 | Ndiff 0.245 26.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.722472317e+00 | Ndiff 0.147 27.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.722471519e+00 | Ndiff 0.111 28.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.722470216e+00 | Ndiff 0.086 29.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.722462530e+00 | Ndiff 0.129 30.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.722315355e+00 | Ndiff 0.523 31.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.722183071e+00 | Ndiff 0.218 32.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.722065842e+00 | Ndiff 0.515 33.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721742168e+00 | Ndiff 0.515 34.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721736951e+00 | Ndiff 0.230 35.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721735062e+00 | Ndiff 0.159 36.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721734200e+00 | Ndiff 0.112 37.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721733770e+00 | Ndiff 0.091 38.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721733543e+00 | Ndiff 0.076 39.000/200 after 1 sec. | 229.7 MiB | K 10 | loss 3.721733417e+00 | Ndiff 0.063 40.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733344e+00 | Ndiff 0.053 41.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733299e+00 | Ndiff 0.044 42.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733271e+00 | Ndiff 0.037 43.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733253e+00 | Ndiff 0.031 44.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733242e+00 | Ndiff 0.028 45.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733233e+00 | Ndiff 0.025 46.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733228e+00 | Ndiff 0.023 47.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733224e+00 | Ndiff 0.020 48.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733221e+00 | Ndiff 0.018 49.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733219e+00 | Ndiff 0.016 50.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733218e+00 | Ndiff 0.014 51.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733217e+00 | Ndiff 0.012 52.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733216e+00 | Ndiff 0.010 53.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733215e+00 | Ndiff 0.009 54.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733215e+00 | Ndiff 0.008 55.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733215e+00 | Ndiff 0.007 56.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733215e+00 | Ndiff 0.006 57.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.005 58.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.005 59.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.004 60.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.003 61.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.003 62.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.003 63.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.002 64.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.002 65.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.002 66.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.001 67.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.001 68.000/200 after 2 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.001 69.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.001 70.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.001 71.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.001 72.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.001 73.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.001 74.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.000 75.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.000 76.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.000 77.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.000 78.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.000 79.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.000 80.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.000 81.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.000 82.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.000 83.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.000 84.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.000 85.000/200 after 3 sec. | 229.7 MiB | K 10 | loss 3.721733214e+00 | Ndiff 0.000 ... done. converged. .. GENERATED FROM PYTHON SOURCE LINES 148-154 Compare loss function traces for all methods -------------------------------------------- We'll notice that the simple mixture performs noticeably worse than the more flexible models that allow group-specific cluster weights .. GENERATED FROM PYTHON SOURCE LINES 155-177 .. code-block:: default pylab.figure() pylab.plot( mix_info_dict['lap_history'], mix_info_dict['loss_history'], 'k--', label='mix + diag gauss') pylab.plot( finite_info_dict['lap_history'], finite_info_dict['loss_history'], 'm.-', label='LDA + diag gauss') pylab.plot( hdp_info_dict['lap_history'], hdp_info_dict['loss_history'], 'r.-', label='HDP + diag gauss') pylab.legend(loc='upper right') pylab.xlabel('num. laps') pylab.ylabel('loss') pylab.xlim([0, 200]) # avoid early iterations pylab.ylim([3.5, 3.7]) # handpicked pylab.draw() pylab.tight_layout() .. image-sg:: /examples/08_mocap6/images/sphx_glr_plot-05-topic_model_gaussian_likelihood_002.png :alt: plot 05 topic model gaussian likelihood :srcset: /examples/08_mocap6/images/sphx_glr_plot-05-topic_model_gaussian_likelihood_002.png :class: sphx-glr-single-img .. GENERATED FROM PYTHON SOURCE LINES 178-181 Show the baseline per-sequence appearances ----------------------------------------------- .. GENERATED FROM PYTHON SOURCE LINES 182-206 .. code-block:: default np.set_printoptions(precision=3, suppress=1, linewidth=200) ## Compute approx. posterior parameter 'resp' for each example # resp : 2D array, n_examples x n_clusters # resp[n] defines Discrete probability of using clusters to explain each example LP = mix_model.calc_local_params(dataset) resp_NK = LP['resp'] ## Compute the per-sequence average usage. avg_resp_DK = np.zeros((dataset.nDoc, K)) for d in range(dataset.nDoc): start = dataset.doc_range[d] stop = dataset.doc_range[d+1] avg_resp_DK[d] = np.mean(resp_NK[start:stop], axis=0) print("Baseline mixture model: per-sequence average cluster usage") print(avg_resp_DK) nnz = np.sum(avg_resp_DK < 0.001) print("Sparsity level: %d/%d entries close-to-zero" % ( nnz, avg_resp_DK.size)) print("") .. rst-class:: sphx-glr-script-out .. code-block:: none Baseline mixture model: per-sequence average cluster usage [[0.045 0.14 0.193 0.086 0.097 0.088 0.085 0.057 0.14 0.07 ] [0.014 0.245 0.081 0.114 0.098 0.169 0. 0.035 0.166 0.077] [0.085 0.125 0.232 0.071 0. 0.143 0.037 0.056 0.149 0.103] [0.065 0.053 0.045 0.085 0.051 0.102 0.123 0.109 0.316 0.052] [0.097 0.001 0.283 0.094 0.07 0.125 0.088 0.049 0.133 0.06 ] [0.211 0.004 0.216 0.069 0. 0.068 0.034 0.048 0.234 0.115]] Sparsity level: 4/60 entries close-to-zero .. GENERATED FROM PYTHON SOURCE LINES 207-210 Show the learned group-specific mixture weights ----------------------------------------------- .. GENERATED FROM PYTHON SOURCE LINES 211-240 .. code-block:: default # Compute approx. posterior parameter 'theta' for each document LP = finite_model.calc_local_params(dataset) resp_NK = LP['resp'] avg_resp_DK = np.zeros((dataset.nDoc, K)) for d in range(dataset.nDoc): start = dataset.doc_range[d] stop = dataset.doc_range[d+1] avg_resp_DK[d] = np.mean(resp_NK[start:stop], axis=0) print("LDA mixed membership model: per-sequence average cluster usage") print(avg_resp_DK) nnz = np.sum(avg_resp_DK < 0.001) print("Sparsity level: %d/%d entries close-to-zero" % ( nnz, avg_resp_DK.size)) print("") # theta : 2D array, n_docs x n_clusters # theta[d] defines Dirichlet parameters for d-th document theta_DK = LP['theta'] # Compute expected probabilities E_pi_DK = theta_DK / np.sum(theta_DK, axis=1)[:,np.newaxis] print("LDA mixed membership model: per-sequence cluster probabilities") print(E_pi_DK) .. rst-class:: sphx-glr-script-out .. code-block:: none LDA mixed membership model: per-sequence average cluster usage [[0.126 0.168 0.181 0.085 0.106 0.083 0.05 0.048 0. 0.154] [0.063 0.296 0.057 0.111 0.117 0.158 0. 0.024 0. 0.174] [0.161 0.144 0.224 0.063 0.008 0.123 0. 0.036 0. 0.241] [0. 0.043 0.027 0.081 0.058 0.101 0.068 0.043 0.502 0.078] [0. 0. 0.283 0.091 0.077 0.124 0.077 0.045 0.201 0.103] [0.175 0. 0.206 0.067 0. 0.067 0. 0.041 0.22 0.223]] Sparsity level: 11/60 entries close-to-zero LDA mixed membership model: per-sequence cluster probabilities [[0.126 0.168 0.181 0.085 0.106 0.083 0.05 0.048 0. 0.154] [0.063 0.296 0.057 0.111 0.117 0.158 0. 0.024 0. 0.174] [0.161 0.144 0.224 0.063 0.008 0.123 0. 0.036 0. 0.241] [0. 0.043 0.027 0.081 0.058 0.101 0.068 0.043 0.502 0.078] [0. 0. 0.282 0.091 0.077 0.124 0.077 0.045 0.201 0.103] [0.175 0. 0.206 0.067 0. 0.067 0. 0.041 0.22 0.223]] .. rst-class:: sphx-glr-timing **Total running time of the script:** ( 0 minutes 36.906 seconds) .. _sphx_glr_download_examples_08_mocap6_plot-05-topic_model_gaussian_likelihood.py: .. only:: html .. container:: sphx-glr-footer sphx-glr-footer-example .. container:: sphx-glr-download sphx-glr-download-python :download:`Download Python source code: plot-05-topic_model_gaussian_likelihood.py ` .. container:: sphx-glr-download sphx-glr-download-jupyter :download:`Download Jupyter notebook: plot-05-topic_model_gaussian_likelihood.ipynb ` .. only:: html .. rst-class:: sphx-glr-signature `Gallery generated by Sphinx-Gallery `_