.. DO NOT EDIT. .. THIS FILE WAS AUTOMATICALLY GENERATED BY SPHINX-GALLERY. .. TO MAKE CHANGES, EDIT THE SOURCE PYTHON FILE: .. "examples/03_faithful/plot-03-demo=sparse_resp_vb-model=mix_gauss.py" .. LINE NUMBERS ARE GIVEN BELOW. .. only:: html .. note:: :class: sphx-glr-download-link-note Click :ref:`here ` to download the full example code .. rst-class:: sphx-glr-example-title .. _sphx_glr_examples_03_faithful_plot-03-demo=sparse_resp_vb-model=mix_gauss.py: ================================================================== Demonstration of Sparse Responsibilities for Mixtures of Gaussians ================================================================== This demo illustrates "sparse responsibilities" for mixture models. In this example, we show how BNPy makes it easy to vary per-example inference, so that for a 3-cluster model we can manually try each of the following: * each data point assigned to up to 1 cluster * each data point assigned to up to 2 clusters * each data point assigned to up to 3 clusters In our variational approximation, when we fit a K-cluster mixture model to a specific data point, we learn a vector of posterior **responsibilities** -- we often call these "resp" for short in the code -- indicating how much of the unit probability mass for this example is explained by each of the K clusters. For example, for a specific data point we might have a resp vector of: [ 0. 0.9262 0.0738] which we interpret as saying this point is 92% explained by the 2nd cluster, 7% by the 3rd cluster, and 0% by the first. This short demo just shows how we can deliberately enforce sparsity in learned responsibilities, so that each example may have only L non-zero entries in its resp vector. For example, we'll fit a K=3 model below, and show how we can enforce L=1 or L=2 sparsity. For a technical introduction, see our ArXiv paper: Michael C. Hughes and Erik B. Sudderth (2016) "Fast Learning of Clusters and Topics via Sparse Posteriors." https://arxiv.org/abs/1609.07521 .. GENERATED FROM PYTHON SOURCE LINES 43-56 .. code-block:: default from __future__ import print_function import bnpy import numpy as np import os from matplotlib import pylab import seaborn as sns SMALL_FIG_SIZE = (2.5, 2.5) FIG_SIZE = (5, 5) pylab.rcParams['figure.figsize'] = FIG_SIZE .. GENERATED FROM PYTHON SOURCE LINES 57-58 Load dataset from file .. GENERATED FROM PYTHON SOURCE LINES 59-70 .. code-block:: default dataset_path = os.path.join(bnpy.DATASET_PATH, 'faithful') dataset = bnpy.data.XData.read_csv( os.path.join(dataset_path, 'faithful.csv')) # Identify "target" example ids to focus on target_example_ids = np.asarray( [ 83, 46, 152, 173, 23, 164, 243, 239, 154, 100]) targeted_dataset = bnpy.data.XData( dataset.X[target_example_ids]) .. GENERATED FROM PYTHON SOURCE LINES 71-72 Make a simple plot of the raw data .. GENERATED FROM PYTHON SOURCE LINES 73-82 .. code-block:: default pylab.plot(dataset.X[:, 0], dataset.X[:, 1], 'k.') pylab.xlabel(dataset.column_names[0]) pylab.ylabel(dataset.column_names[1]) pylab.tight_layout() pylab.title('Complete Dataset') data_ax_h = pylab.gca() .. image-sg:: /examples/03_faithful/images/sphx_glr_plot-03-demo=sparse_resp_vb-model=mix_gauss_001.png :alt: Complete Dataset :srcset: /examples/03_faithful/images/sphx_glr_plot-03-demo=sparse_resp_vb-model=mix_gauss_001.png :class: sphx-glr-single-img .. GENERATED FROM PYTHON SOURCE LINES 83-85 Setup: Func to print resp array nicely -------------------------------------- .. GENERATED FROM PYTHON SOURCE LINES 86-97 .. code-block:: default def pprint_sparse_or_dense_resp(LP, target_example_ids=target_example_ids): np.set_printoptions(suppress=True, precision=4) if 'spR' in LP: # sparse case resp_NK = LP['spR'][target_example_ids].toarray() else: resp_NK = LP['resp'][target_example_ids] print(resp_NK) .. GENERATED FROM PYTHON SOURCE LINES 98-106 VB with DP mixture model and diagonal Gaussian observations ----------------------------------------------------------- Assumes exactly 3 clusters Assumes diagonal covariances. No sparsity assumptions during training .. GENERATED FROM PYTHON SOURCE LINES 107-125 .. code-block:: default K = 3 # n clusters gamma = 50.0 # DP concentration param sF = 0.1 # scale of expected covariance full_trained_model, full_info_dict = bnpy.run( dataset, 'DPMixtureModel', 'DiagGauss', 'VB', output_path='/tmp/faithful/demo_sparse_resp-K=3-lik=Gauss-ECovMat=5*eye/', nLap=1000, nTask=5, nBatch=1, convergeThr=0.0001, gamma0=gamma, sF=sF, ECovMat='eye', K=K, initname='randexamples', ) # Add this model into the current plot bnpy.viz.PlotComps.plotCompsFromHModel( full_trained_model, ) .. image-sg:: /examples/03_faithful/images/sphx_glr_plot-03-demo=sparse_resp_vb-model=mix_gauss_002.png :alt: plot 03 demo=sparse resp vb model=mix gauss :srcset: /examples/03_faithful/images/sphx_glr_plot-03-demo=sparse_resp_vb-model=mix_gauss_002.png :class: sphx-glr-single-img .. rst-class:: sphx-glr-script-out .. code-block:: none WARNING: Found unrecognized keyword args. These are ignored. --nBatch Dataset Summary: X Data num examples: 272 num dims: 2 Allocation Model: DP mixture with K=0. Concentration gamma0= 50.00 Obs. Data Model: Gaussian with diagonal covariance. Obs. Data Prior: independent Gauss-Wishart prior on each dimension Wishart params nu = 4 beta = [ 0.2 0.2] Expectations E[ mean[k]] = [ 0 0] E[ covar[k]] = [[0.1 0. ] [0. 0.1]] Initialization: initname = randexamples K = 3 (number of clusters) seed = 1607680 elapsed_time: 0.0 sec Learn Alg: VB | task 1/5 | alg. seed: 1607680 | data order seed: 8541952 task_output_path: /tmp/faithful/demo_sparse_resp-K=3-lik=Gauss-ECovMat=5*eye/1 1/1000 after 0 sec. | 218.2 MiB | K 3 | loss 3.024985920e+00 | 2/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.963751576e+00 | Ndiff 2.846 3/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.915936430e+00 | Ndiff 10.454 4/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.841297326e+00 | Ndiff 18.204 5/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.748858710e+00 | Ndiff 20.529 6/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.657778518e+00 | Ndiff 15.677 7/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.569542173e+00 | Ndiff 10.904 8/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.534007328e+00 | Ndiff 4.528 9/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.508961472e+00 | Ndiff 3.729 10/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.495535777e+00 | Ndiff 1.586 11/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494290057e+00 | Ndiff 0.411 12/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.493584130e+00 | Ndiff 0.696 13/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.492995794e+00 | Ndiff 0.929 14/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.492459487e+00 | Ndiff 1.135 15/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.491945636e+00 | Ndiff 1.318 16/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.491440653e+00 | Ndiff 1.481 17/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.490939573e+00 | Ndiff 1.625 18/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.490442396e+00 | Ndiff 1.749 19/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.489951832e+00 | Ndiff 1.852 20/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.489471711e+00 | Ndiff 1.933 21/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.489005811e+00 | Ndiff 1.993 22/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.488557093e+00 | Ndiff 2.033 23/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.488127311e+00 | Ndiff 2.055 24/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.487716959e+00 | Ndiff 2.063 25/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.487325464e+00 | Ndiff 2.059 26/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.486951484e+00 | Ndiff 2.047 27/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.486593250e+00 | Ndiff 2.028 28/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.486248844e+00 | Ndiff 2.006 29/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.485916412e+00 | Ndiff 1.981 30/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.485594294e+00 | Ndiff 1.954 31/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.485281079e+00 | Ndiff 1.927 32/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.484975632e+00 | Ndiff 1.900 33/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.484677073e+00 | Ndiff 1.873 34/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.484384755e+00 | Ndiff 1.845 35/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.484098229e+00 | Ndiff 1.817 36/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.483817216e+00 | Ndiff 1.789 37/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.483541575e+00 | Ndiff 1.760 38/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.483271282e+00 | Ndiff 1.731 39/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.483006407e+00 | Ndiff 1.701 40/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482747096e+00 | Ndiff 1.669 41/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482493559e+00 | Ndiff 1.637 42/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482246056e+00 | Ndiff 1.604 43/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482004886e+00 | Ndiff 1.569 44/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481770375e+00 | Ndiff 1.533 45/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481542863e+00 | Ndiff 1.496 46/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481322699e+00 | Ndiff 1.458 47/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481110224e+00 | Ndiff 1.419 48/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.480905765e+00 | Ndiff 1.379 49/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.480709619e+00 | Ndiff 1.338 50/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.480522049e+00 | Ndiff 1.296 51/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480343269e+00 | Ndiff 1.254 52/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480173442e+00 | Ndiff 1.211 53/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480012666e+00 | Ndiff 1.167 54/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479860980e+00 | Ndiff 1.124 55/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479718351e+00 | Ndiff 1.081 56/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479584685e+00 | Ndiff 1.038 57/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479459820e+00 | Ndiff 0.995 58/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479343538e+00 | Ndiff 0.953 59/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479235566e+00 | Ndiff 0.912 60/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479135586e+00 | Ndiff 0.871 61/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479043241e+00 | Ndiff 0.832 62/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478958148e+00 | Ndiff 0.793 63/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478879901e+00 | Ndiff 0.756 64/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478808084e+00 | Ndiff 0.720 65/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478742273e+00 | Ndiff 0.686 66/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478682051e+00 | Ndiff 0.653 67/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478627005e+00 | Ndiff 0.621 68/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478576736e+00 | Ndiff 0.591 69/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478530861e+00 | Ndiff 0.562 70/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478489016e+00 | Ndiff 0.534 71/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478450858e+00 | Ndiff 0.508 72/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478416065e+00 | Ndiff 0.483 73/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478384339e+00 | Ndiff 0.460 74/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478355403e+00 | Ndiff 0.438 75/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478329003e+00 | Ndiff 0.417 76/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478304903e+00 | Ndiff 0.397 77/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478282892e+00 | Ndiff 0.378 78/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478262773e+00 | Ndiff 0.361 79/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478244370e+00 | Ndiff 0.344 80/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478227522e+00 | Ndiff 0.328 81/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478212083e+00 | Ndiff 0.313 82/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478197921e+00 | Ndiff 0.299 83/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478184918e+00 | Ndiff 0.286 84/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478172966e+00 | Ndiff 0.274 85/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478161968e+00 | Ndiff 0.262 86/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478151836e+00 | Ndiff 0.251 87/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478142491e+00 | Ndiff 0.241 88/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478133862e+00 | Ndiff 0.231 89/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478125885e+00 | Ndiff 0.221 90/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478118502e+00 | Ndiff 0.213 91/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478111660e+00 | Ndiff 0.204 92/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478105312e+00 | Ndiff 0.196 93/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478099416e+00 | Ndiff 0.189 94/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478093933e+00 | Ndiff 0.182 95/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478088827e+00 | Ndiff 0.175 96/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478084067e+00 | Ndiff 0.169 97/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478079625e+00 | Ndiff 0.163 98/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478075475e+00 | Ndiff 0.157 99/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478071593e+00 | Ndiff 0.152 100/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478067957e+00 | Ndiff 0.147 101/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478064548e+00 | Ndiff 0.142 102/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478061348e+00 | Ndiff 0.137 103/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478058342e+00 | Ndiff 0.133 104/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478055514e+00 | Ndiff 0.129 105/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478052851e+00 | Ndiff 0.125 106/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478050340e+00 | Ndiff 0.121 107/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478047971e+00 | Ndiff 0.118 108/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478045734e+00 | Ndiff 0.114 109/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478043618e+00 | Ndiff 0.111 110/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478041615e+00 | Ndiff 0.108 111/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478039717e+00 | Ndiff 0.105 112/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478037917e+00 | Ndiff 0.102 113/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478036209e+00 | Ndiff 0.099 114/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478034585e+00 | Ndiff 0.097 115/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478033041e+00 | Ndiff 0.094 116/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478031571e+00 | Ndiff 0.092 117/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478030171e+00 | Ndiff 0.089 118/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478028835e+00 | Ndiff 0.087 119/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478027560e+00 | Ndiff 0.085 120/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478026342e+00 | Ndiff 0.083 121/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478025178e+00 | Ndiff 0.081 122/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478024063e+00 | Ndiff 0.079 123/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478022996e+00 | Ndiff 0.078 124/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478021972e+00 | Ndiff 0.076 125/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478020991e+00 | Ndiff 0.074 126/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478020048e+00 | Ndiff 0.073 127/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478019142e+00 | Ndiff 0.071 128/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478018271e+00 | Ndiff 0.070 129/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478017433e+00 | Ndiff 0.069 130/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478016626e+00 | Ndiff 0.067 131/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478015848e+00 | Ndiff 0.066 132/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478015097e+00 | Ndiff 0.065 133/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478014373e+00 | Ndiff 0.064 134/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478013673e+00 | Ndiff 0.062 135/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478012996e+00 | Ndiff 0.061 136/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478012342e+00 | Ndiff 0.060 137/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478011708e+00 | Ndiff 0.059 138/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478011095e+00 | Ndiff 0.058 139/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478010500e+00 | Ndiff 0.057 140/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478009923e+00 | Ndiff 0.056 141/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478009363e+00 | Ndiff 0.056 142/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478008818e+00 | Ndiff 0.055 143/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478008290e+00 | Ndiff 0.054 144/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478007775e+00 | Ndiff 0.053 145/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478007275e+00 | Ndiff 0.052 146/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478006787e+00 | Ndiff 0.052 147/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478006312e+00 | Ndiff 0.051 148/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478005849e+00 | Ndiff 0.050 149/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.478005396e+00 | Ndiff 0.050 150/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.478004955e+00 | Ndiff 0.049 151/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.478004524e+00 | Ndiff 0.048 152/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.478004102e+00 | Ndiff 0.048 153/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.478003690e+00 | Ndiff 0.047 154/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.478003287e+00 | Ndiff 0.047 155/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.478002891e+00 | Ndiff 0.046 156/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.478002504e+00 | Ndiff 0.046 157/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.478002125e+00 | Ndiff 0.045 158/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.478001752e+00 | Ndiff 0.045 159/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.478001387e+00 | Ndiff 0.044 160/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.478001027e+00 | Ndiff 0.044 161/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.478000675e+00 | Ndiff 0.044 162/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.478000328e+00 | Ndiff 0.043 163/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477999986e+00 | Ndiff 0.043 164/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477999650e+00 | Ndiff 0.042 165/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477999319e+00 | Ndiff 0.042 166/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477998993e+00 | Ndiff 0.042 167/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477998671e+00 | Ndiff 0.042 168/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477998353e+00 | Ndiff 0.041 169/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477998040e+00 | Ndiff 0.041 170/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477997731e+00 | Ndiff 0.041 171/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477997425e+00 | Ndiff 0.040 172/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477997122e+00 | Ndiff 0.040 173/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477996823e+00 | Ndiff 0.040 174/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477996526e+00 | Ndiff 0.040 175/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477996233e+00 | Ndiff 0.039 176/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477995942e+00 | Ndiff 0.039 177/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477995654e+00 | Ndiff 0.039 178/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477995368e+00 | Ndiff 0.039 179/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477995084e+00 | Ndiff 0.039 180/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477994802e+00 | Ndiff 0.039 181/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477994521e+00 | Ndiff 0.038 182/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477994243e+00 | Ndiff 0.038 183/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477993966e+00 | Ndiff 0.038 184/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477993690e+00 | Ndiff 0.038 185/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477993415e+00 | Ndiff 0.038 186/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477993141e+00 | Ndiff 0.038 187/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477992868e+00 | Ndiff 0.038 188/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477992596e+00 | Ndiff 0.038 189/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477992324e+00 | Ndiff 0.038 190/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477992053e+00 | Ndiff 0.038 191/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477991782e+00 | Ndiff 0.038 192/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477991511e+00 | Ndiff 0.038 193/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477991239e+00 | Ndiff 0.038 194/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477990968e+00 | Ndiff 0.038 195/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477990696e+00 | Ndiff 0.038 196/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477990424e+00 | Ndiff 0.038 197/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477990151e+00 | Ndiff 0.038 198/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477989878e+00 | Ndiff 0.038 199/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477989603e+00 | Ndiff 0.038 200/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477989327e+00 | Ndiff 0.038 201/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477989050e+00 | Ndiff 0.038 202/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477988772e+00 | Ndiff 0.038 203/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477988492e+00 | Ndiff 0.038 204/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477988210e+00 | Ndiff 0.038 205/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477987926e+00 | Ndiff 0.038 206/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477987640e+00 | Ndiff 0.038 207/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477987351e+00 | Ndiff 0.039 208/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477987061e+00 | Ndiff 0.039 209/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477986767e+00 | Ndiff 0.039 210/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477986470e+00 | Ndiff 0.039 211/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477986171e+00 | Ndiff 0.039 212/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477985868e+00 | Ndiff 0.039 213/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477985561e+00 | Ndiff 0.040 214/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477985251e+00 | Ndiff 0.040 215/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477984936e+00 | Ndiff 0.040 216/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477984618e+00 | Ndiff 0.040 217/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477984294e+00 | Ndiff 0.041 218/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477983966e+00 | Ndiff 0.041 219/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477983633e+00 | Ndiff 0.041 220/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477983294e+00 | Ndiff 0.041 221/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477982950e+00 | Ndiff 0.042 222/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477982600e+00 | Ndiff 0.042 223/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477982243e+00 | Ndiff 0.042 224/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477981879e+00 | Ndiff 0.043 225/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477981508e+00 | Ndiff 0.043 226/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477981130e+00 | Ndiff 0.044 227/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477980744e+00 | Ndiff 0.044 228/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477980349e+00 | Ndiff 0.044 229/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477979945e+00 | Ndiff 0.045 230/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477979532e+00 | Ndiff 0.045 231/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477979109e+00 | Ndiff 0.046 232/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477978676e+00 | Ndiff 0.046 233/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477978231e+00 | Ndiff 0.047 234/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477977775e+00 | Ndiff 0.048 235/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477977306e+00 | Ndiff 0.048 236/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477976824e+00 | Ndiff 0.049 237/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477976329e+00 | Ndiff 0.050 238/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477975818e+00 | Ndiff 0.050 239/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477975292e+00 | Ndiff 0.051 240/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477974749e+00 | Ndiff 0.052 241/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477974189e+00 | Ndiff 0.052 242/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477973610e+00 | Ndiff 0.053 243/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477973011e+00 | Ndiff 0.054 244/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477972391e+00 | Ndiff 0.055 245/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477971749e+00 | Ndiff 0.056 246/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477971083e+00 | Ndiff 0.057 247/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477970391e+00 | Ndiff 0.058 248/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477969672e+00 | Ndiff 0.059 249/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.477968924e+00 | Ndiff 0.060 250/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477968146e+00 | Ndiff 0.061 251/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477967334e+00 | Ndiff 0.063 252/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477966486e+00 | Ndiff 0.064 253/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477965601e+00 | Ndiff 0.065 254/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477964675e+00 | Ndiff 0.067 255/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477963705e+00 | Ndiff 0.068 256/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477962687e+00 | Ndiff 0.070 257/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477961619e+00 | Ndiff 0.071 258/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477960497e+00 | Ndiff 0.073 259/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477959315e+00 | Ndiff 0.075 260/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477958069e+00 | Ndiff 0.077 261/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477956753e+00 | Ndiff 0.079 262/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477955363e+00 | Ndiff 0.081 263/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477953891e+00 | Ndiff 0.083 264/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477952330e+00 | Ndiff 0.085 265/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477950671e+00 | Ndiff 0.088 266/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477948907e+00 | Ndiff 0.090 267/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477947028e+00 | Ndiff 0.093 268/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477945021e+00 | Ndiff 0.096 269/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477942874e+00 | Ndiff 0.099 270/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477940573e+00 | Ndiff 0.102 271/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477938103e+00 | Ndiff 0.106 272/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477935445e+00 | Ndiff 0.110 273/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477932578e+00 | Ndiff 0.114 274/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477929479e+00 | Ndiff 0.118 275/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477926122e+00 | Ndiff 0.122 276/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477922476e+00 | Ndiff 0.127 277/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477918505e+00 | Ndiff 0.132 278/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477914169e+00 | Ndiff 0.138 279/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477909421e+00 | Ndiff 0.144 280/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477904205e+00 | Ndiff 0.150 281/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477898458e+00 | Ndiff 0.157 282/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477892103e+00 | Ndiff 0.164 283/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477885051e+00 | Ndiff 0.172 284/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477877196e+00 | Ndiff 0.181 285/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477868411e+00 | Ndiff 0.191 286/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477858544e+00 | Ndiff 0.201 287/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477847411e+00 | Ndiff 0.212 288/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477834786e+00 | Ndiff 0.225 289/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477820395e+00 | Ndiff 0.238 290/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477803898e+00 | Ndiff 0.253 291/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477784870e+00 | Ndiff 0.270 292/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477762778e+00 | Ndiff 0.288 293/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477736945e+00 | Ndiff 0.308 294/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477706505e+00 | Ndiff 0.331 295/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477670330e+00 | Ndiff 0.356 296/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477626947e+00 | Ndiff 0.384 297/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477574395e+00 | Ndiff 0.416 298/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477510040e+00 | Ndiff 0.452 299/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477430283e+00 | Ndiff 0.492 300/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477330143e+00 | Ndiff 0.537 301/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477202613e+00 | Ndiff 0.588 302/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.477037673e+00 | Ndiff 0.646 303/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.476820794e+00 | Ndiff 0.710 304/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.476530732e+00 | Ndiff 0.780 305/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.476136866e+00 | Ndiff 0.855 306/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.475598527e+00 | Ndiff 0.929 307/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.474876012e+00 | Ndiff 0.989 308/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.473971580e+00 | Ndiff 1.018 309/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.472985078e+00 | Ndiff 0.999 310/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.472086685e+00 | Ndiff 0.935 311/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.471397849e+00 | Ndiff 0.841 312/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.470920902e+00 | Ndiff 0.742 313/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.470584489e+00 | Ndiff 0.653 314/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.470324872e+00 | Ndiff 0.580 315/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.470106989e+00 | Ndiff 0.523 316/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.469911918e+00 | Ndiff 0.481 317/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.469726780e+00 | Ndiff 0.453 318/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.469539898e+00 | Ndiff 0.437 319/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.469337523e+00 | Ndiff 0.434 320/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.469099855e+00 | Ndiff 0.443 321/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.468794891e+00 | Ndiff 0.463 322/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.468371096e+00 | Ndiff 0.492 323/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.467763504e+00 | Ndiff 0.513 324/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.466960962e+00 | Ndiff 0.496 325/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.466160474e+00 | Ndiff 0.400 326/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.465724445e+00 | Ndiff 0.232 327/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.465626565e+00 | Ndiff 0.094 328/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.465615098e+00 | Ndiff 0.031 329/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.465613516e+00 | Ndiff 0.014 330/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.465613125e+00 | Ndiff 0.008 331/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.465612997e+00 | Ndiff 0.005 332/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.465612952e+00 | Ndiff 0.003 333/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.465612936e+00 | Ndiff 0.002 334/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.465612930e+00 | Ndiff 0.001 335/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.465612928e+00 | Ndiff 0.001 336/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.465612927e+00 | Ndiff 0.000 337/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.465612927e+00 | Ndiff 0.000 338/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.465612927e+00 | Ndiff 0.000 339/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.465612927e+00 | Ndiff 0.000 ... done. converged. Learn Alg: VB | task 2/5 | alg. seed: 6454144 | data order seed: 7673856 task_output_path: /tmp/faithful/demo_sparse_resp-K=3-lik=Gauss-ECovMat=5*eye/2 1/1000 after 0 sec. | 218.2 MiB | K 3 | loss 3.144280649e+00 | 2/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.999427978e+00 | Ndiff 16.339 3/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.889092617e+00 | Ndiff 29.328 4/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.773372571e+00 | Ndiff 30.295 5/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.670818147e+00 | Ndiff 19.860 6/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.577419094e+00 | Ndiff 11.388 7/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.531167799e+00 | Ndiff 4.469 8/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.495532492e+00 | Ndiff 3.497 9/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.485361099e+00 | Ndiff 1.346 10/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.484760839e+00 | Ndiff 1.534 11/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.484517089e+00 | Ndiff 1.442 12/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.484320192e+00 | Ndiff 1.384 13/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.484140099e+00 | Ndiff 1.351 14/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.483970718e+00 | Ndiff 1.326 15/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.483809360e+00 | Ndiff 1.305 16/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.483654299e+00 | Ndiff 1.286 17/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.483504339e+00 | Ndiff 1.267 18/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.483358650e+00 | Ndiff 1.248 19/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.483216669e+00 | Ndiff 1.230 20/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.483078037e+00 | Ndiff 1.211 21/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482942536e+00 | Ndiff 1.192 22/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482810056e+00 | Ndiff 1.173 23/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482680562e+00 | Ndiff 1.153 24/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482554074e+00 | Ndiff 1.133 25/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482430645e+00 | Ndiff 1.113 26/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482310357e+00 | Ndiff 1.092 27/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482193304e+00 | Ndiff 1.070 28/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482079589e+00 | Ndiff 1.048 29/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481969318e+00 | Ndiff 1.025 30/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481862594e+00 | Ndiff 1.002 31/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481759514e+00 | Ndiff 0.978 32/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481660166e+00 | Ndiff 0.954 33/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481564628e+00 | Ndiff 0.929 34/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481472961e+00 | Ndiff 0.904 35/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481385213e+00 | Ndiff 0.879 36/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481301412e+00 | Ndiff 0.853 37/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481221570e+00 | Ndiff 0.828 38/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481145680e+00 | Ndiff 0.802 39/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481073718e+00 | Ndiff 0.777 40/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481005638e+00 | Ndiff 0.751 41/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.480941380e+00 | Ndiff 0.726 42/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.480880866e+00 | Ndiff 0.700 43/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.480824003e+00 | Ndiff 0.675 44/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.480770686e+00 | Ndiff 0.651 45/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.480720795e+00 | Ndiff 0.626 46/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.480674203e+00 | Ndiff 0.602 47/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.480630775e+00 | Ndiff 0.579 48/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.480590367e+00 | Ndiff 0.556 49/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.480552834e+00 | Ndiff 0.533 50/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.480518027e+00 | Ndiff 0.512 51/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480485796e+00 | Ndiff 0.490 52/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480455992e+00 | Ndiff 0.470 53/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480428469e+00 | Ndiff 0.450 54/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480403082e+00 | Ndiff 0.431 55/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480379690e+00 | Ndiff 0.412 56/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480358160e+00 | Ndiff 0.394 57/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480338360e+00 | Ndiff 0.377 58/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480320167e+00 | Ndiff 0.360 59/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480303462e+00 | Ndiff 0.344 60/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480288134e+00 | Ndiff 0.329 61/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480274078e+00 | Ndiff 0.314 62/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480261194e+00 | Ndiff 0.300 63/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480249391e+00 | Ndiff 0.287 64/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480238582e+00 | Ndiff 0.274 65/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480228686e+00 | Ndiff 0.261 66/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480219629e+00 | Ndiff 0.250 67/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480211341e+00 | Ndiff 0.238 68/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480203759e+00 | Ndiff 0.227 69/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480196823e+00 | Ndiff 0.217 70/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480190480e+00 | Ndiff 0.207 71/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480184678e+00 | Ndiff 0.198 72/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480179372e+00 | Ndiff 0.189 73/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480174520e+00 | Ndiff 0.181 74/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480170083e+00 | Ndiff 0.172 75/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480166025e+00 | Ndiff 0.165 76/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480162313e+00 | Ndiff 0.157 77/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480158918e+00 | Ndiff 0.150 78/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480155813e+00 | Ndiff 0.144 79/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480152973e+00 | Ndiff 0.137 80/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480150374e+00 | Ndiff 0.131 81/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480147996e+00 | Ndiff 0.125 82/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480145820e+00 | Ndiff 0.120 83/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480143828e+00 | Ndiff 0.114 84/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480142005e+00 | Ndiff 0.109 85/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480140336e+00 | Ndiff 0.105 86/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480138808e+00 | Ndiff 0.100 87/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480137409e+00 | Ndiff 0.096 88/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480136127e+00 | Ndiff 0.091 89/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480134953e+00 | Ndiff 0.087 90/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480133878e+00 | Ndiff 0.084 91/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480132893e+00 | Ndiff 0.080 92/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480131990e+00 | Ndiff 0.077 93/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480131162e+00 | Ndiff 0.073 94/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480130403e+00 | Ndiff 0.070 95/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480129708e+00 | Ndiff 0.067 96/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480129070e+00 | Ndiff 0.064 97/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480128485e+00 | Ndiff 0.061 98/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480127949e+00 | Ndiff 0.059 99/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480127457e+00 | Ndiff 0.056 100/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480127005e+00 | Ndiff 0.054 101/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480126591e+00 | Ndiff 0.052 102/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480126211e+00 | Ndiff 0.049 103/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480125862e+00 | Ndiff 0.047 104/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480125542e+00 | Ndiff 0.045 105/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480125248e+00 | Ndiff 0.043 106/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480124978e+00 | Ndiff 0.042 107/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480124731e+00 | Ndiff 0.040 108/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480124503e+00 | Ndiff 0.038 109/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480124294e+00 | Ndiff 0.037 110/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480124102e+00 | Ndiff 0.035 111/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480123926e+00 | Ndiff 0.034 112/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480123764e+00 | Ndiff 0.032 113/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480123615e+00 | Ndiff 0.031 114/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480123478e+00 | Ndiff 0.030 115/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480123353e+00 | Ndiff 0.028 116/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480123237e+00 | Ndiff 0.027 117/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480123131e+00 | Ndiff 0.026 118/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480123034e+00 | Ndiff 0.025 119/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122944e+00 | Ndiff 0.024 120/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122862e+00 | Ndiff 0.023 121/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122786e+00 | Ndiff 0.022 122/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122716e+00 | Ndiff 0.021 123/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122652e+00 | Ndiff 0.020 124/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122593e+00 | Ndiff 0.019 125/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122539e+00 | Ndiff 0.019 126/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122489e+00 | Ndiff 0.018 127/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122444e+00 | Ndiff 0.017 128/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122401e+00 | Ndiff 0.016 129/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122363e+00 | Ndiff 0.016 130/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122327e+00 | Ndiff 0.015 131/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122294e+00 | Ndiff 0.014 132/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122264e+00 | Ndiff 0.014 133/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122236e+00 | Ndiff 0.013 134/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122211e+00 | Ndiff 0.013 135/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122187e+00 | Ndiff 0.012 136/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122166e+00 | Ndiff 0.012 137/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122146e+00 | Ndiff 0.011 138/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122128e+00 | Ndiff 0.011 139/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122111e+00 | Ndiff 0.010 140/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122095e+00 | Ndiff 0.010 141/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122081e+00 | Ndiff 0.009 142/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122068e+00 | Ndiff 0.009 143/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122056e+00 | Ndiff 0.009 144/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122045e+00 | Ndiff 0.008 145/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122034e+00 | Ndiff 0.008 146/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122025e+00 | Ndiff 0.008 147/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122016e+00 | Ndiff 0.007 148/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122008e+00 | Ndiff 0.007 149/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480122001e+00 | Ndiff 0.007 150/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480121994e+00 | Ndiff 0.007 151/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121988e+00 | Ndiff 0.006 152/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121982e+00 | Ndiff 0.006 153/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121977e+00 | Ndiff 0.006 154/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121972e+00 | Ndiff 0.006 155/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121968e+00 | Ndiff 0.005 156/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121964e+00 | Ndiff 0.005 157/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121960e+00 | Ndiff 0.005 158/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121956e+00 | Ndiff 0.005 159/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121953e+00 | Ndiff 0.004 160/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121950e+00 | Ndiff 0.004 161/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121948e+00 | Ndiff 0.004 162/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121945e+00 | Ndiff 0.004 163/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121943e+00 | Ndiff 0.004 164/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121941e+00 | Ndiff 0.004 165/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121939e+00 | Ndiff 0.004 166/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121937e+00 | Ndiff 0.003 167/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121935e+00 | Ndiff 0.003 168/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121934e+00 | Ndiff 0.003 169/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121932e+00 | Ndiff 0.003 170/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121931e+00 | Ndiff 0.003 171/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121930e+00 | Ndiff 0.003 172/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121929e+00 | Ndiff 0.003 173/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121928e+00 | Ndiff 0.003 174/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121927e+00 | Ndiff 0.002 175/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121926e+00 | Ndiff 0.002 176/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121925e+00 | Ndiff 0.002 177/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121924e+00 | Ndiff 0.002 178/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121924e+00 | Ndiff 0.002 179/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121923e+00 | Ndiff 0.002 180/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121923e+00 | Ndiff 0.002 181/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121922e+00 | Ndiff 0.002 182/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121922e+00 | Ndiff 0.002 183/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121921e+00 | Ndiff 0.002 184/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121921e+00 | Ndiff 0.002 185/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121920e+00 | Ndiff 0.002 186/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121920e+00 | Ndiff 0.001 187/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121920e+00 | Ndiff 0.001 188/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121919e+00 | Ndiff 0.001 189/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121919e+00 | Ndiff 0.001 190/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121919e+00 | Ndiff 0.001 191/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121919e+00 | Ndiff 0.001 192/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121918e+00 | Ndiff 0.001 193/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121918e+00 | Ndiff 0.001 194/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121918e+00 | Ndiff 0.001 195/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121918e+00 | Ndiff 0.001 196/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121918e+00 | Ndiff 0.001 197/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121918e+00 | Ndiff 0.001 198/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121917e+00 | Ndiff 0.001 199/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121917e+00 | Ndiff 0.001 200/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121917e+00 | Ndiff 0.001 201/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121917e+00 | Ndiff 0.001 202/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121917e+00 | Ndiff 0.001 203/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121917e+00 | Ndiff 0.001 204/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121917e+00 | Ndiff 0.001 205/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121917e+00 | Ndiff 0.001 206/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121917e+00 | Ndiff 0.001 207/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121917e+00 | Ndiff 0.001 208/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121917e+00 | Ndiff 0.001 209/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121917e+00 | Ndiff 0.001 210/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.001 211/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.001 212/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.001 213/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 214/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 215/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 216/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 217/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 218/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 219/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 220/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 221/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 222/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 223/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 224/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 225/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 226/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 227/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 228/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 229/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 230/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 231/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 232/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 233/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 234/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 235/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 236/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 237/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 238/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 239/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 240/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 241/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 242/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 243/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 244/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 245/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 246/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 247/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 248/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 249/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 250/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 251/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 252/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.480121916e+00 | Ndiff 0.000 ... done. converged. Learn Alg: VB | task 3/5 | alg. seed: 6168832 | data order seed: 7360256 task_output_path: /tmp/faithful/demo_sparse_resp-K=3-lik=Gauss-ECovMat=5*eye/3 1/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.597890645e+00 | 2/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.500334722e+00 | Ndiff 12.103 3/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481732540e+00 | Ndiff 6.728 4/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.477128325e+00 | Ndiff 3.822 5/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.475214582e+00 | Ndiff 2.612 6/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.474025229e+00 | Ndiff 1.975 7/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.473158433e+00 | Ndiff 1.625 8/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.472487721e+00 | Ndiff 1.387 9/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.471960617e+00 | Ndiff 1.189 10/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.471546906e+00 | Ndiff 1.019 11/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.471223928e+00 | Ndiff 0.873 12/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470972980e+00 | Ndiff 0.748 13/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470778682e+00 | Ndiff 0.642 14/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470628726e+00 | Ndiff 0.551 15/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470513450e+00 | Ndiff 0.473 16/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470425312e+00 | Ndiff 0.405 17/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470358389e+00 | Ndiff 0.347 18/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470307985e+00 | Ndiff 0.297 19/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470270346e+00 | Ndiff 0.253 20/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470242474e+00 | Ndiff 0.215 21/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470221992e+00 | Ndiff 0.183 22/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470207040e+00 | Ndiff 0.155 23/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470196186e+00 | Ndiff 0.131 24/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470188343e+00 | Ndiff 0.111 25/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470182696e+00 | Ndiff 0.094 26/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470178643e+00 | Ndiff 0.079 27/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470175740e+00 | Ndiff 0.067 28/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470173665e+00 | Ndiff 0.056 29/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470172185e+00 | Ndiff 0.047 30/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470171130e+00 | Ndiff 0.040 31/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470170380e+00 | Ndiff 0.033 32/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470169846e+00 | Ndiff 0.028 33/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470169466e+00 | Ndiff 0.024 34/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470169197e+00 | Ndiff 0.020 35/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470169005e+00 | Ndiff 0.017 36/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470168870e+00 | Ndiff 0.014 37/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470168773e+00 | Ndiff 0.012 38/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470168705e+00 | Ndiff 0.010 39/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470168657e+00 | Ndiff 0.008 40/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470168622e+00 | Ndiff 0.007 41/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470168598e+00 | Ndiff 0.006 42/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470168581e+00 | Ndiff 0.005 43/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470168569e+00 | Ndiff 0.004 44/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470168560e+00 | Ndiff 0.004 45/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470168554e+00 | Ndiff 0.003 46/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470168550e+00 | Ndiff 0.003 47/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470168547e+00 | Ndiff 0.002 48/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470168544e+00 | Ndiff 0.002 49/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470168543e+00 | Ndiff 0.001 50/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.470168542e+00 | Ndiff 0.001 51/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.470168541e+00 | Ndiff 0.001 52/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.470168540e+00 | Ndiff 0.001 53/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.470168540e+00 | Ndiff 0.001 54/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.470168540e+00 | Ndiff 0.001 55/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.470168540e+00 | Ndiff 0.001 56/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.470168539e+00 | Ndiff 0.000 57/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.470168539e+00 | Ndiff 0.000 58/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.470168539e+00 | Ndiff 0.000 59/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.470168539e+00 | Ndiff 0.000 60/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.470168539e+00 | Ndiff 0.000 61/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.470168539e+00 | Ndiff 0.000 62/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.470168539e+00 | Ndiff 0.000 63/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.470168539e+00 | Ndiff 0.000 64/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.470168539e+00 | Ndiff 0.000 65/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.470168539e+00 | Ndiff 0.000 ... done. converged. Learn Alg: VB | task 4/5 | alg. seed: 8205184 | data order seed: 900864 task_output_path: /tmp/faithful/demo_sparse_resp-K=3-lik=Gauss-ECovMat=5*eye/4 1/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.625818566e+00 | 2/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.517079400e+00 | Ndiff 2.360 3/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.500595953e+00 | Ndiff 2.568 4/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.496654963e+00 | Ndiff 0.840 5/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494337582e+00 | Ndiff 0.186 6/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.492886037e+00 | Ndiff 0.280 7/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.491894017e+00 | Ndiff 0.615 8/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.491133552e+00 | Ndiff 0.875 9/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.490496784e+00 | Ndiff 1.087 10/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.489933426e+00 | Ndiff 1.260 11/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.489419675e+00 | Ndiff 1.401 12/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.488944406e+00 | Ndiff 1.512 13/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.488502591e+00 | Ndiff 1.597 14/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.488091868e+00 | Ndiff 1.656 15/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.487710702e+00 | Ndiff 1.695 16/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.487357459e+00 | Ndiff 1.716 17/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.487030061e+00 | Ndiff 1.722 18/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.486725982e+00 | Ndiff 1.718 19/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.486442414e+00 | Ndiff 1.706 20/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.486176489e+00 | Ndiff 1.689 21/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.485925474e+00 | Ndiff 1.668 22/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.485686912e+00 | Ndiff 1.646 23/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.485458687e+00 | Ndiff 1.623 24/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.485239049e+00 | Ndiff 1.600 25/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.485026593e+00 | Ndiff 1.576 26/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.484820224e+00 | Ndiff 1.554 27/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.484619104e+00 | Ndiff 1.532 28/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.484422613e+00 | Ndiff 1.510 29/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.484230302e+00 | Ndiff 1.488 30/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.484041861e+00 | Ndiff 1.467 31/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.483857084e+00 | Ndiff 1.445 32/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.483675854e+00 | Ndiff 1.423 33/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.483498117e+00 | Ndiff 1.402 34/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.483323872e+00 | Ndiff 1.379 35/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.483153160e+00 | Ndiff 1.357 36/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482986054e+00 | Ndiff 1.333 37/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482822653e+00 | Ndiff 1.310 38/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482663075e+00 | Ndiff 1.285 39/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482507456e+00 | Ndiff 1.260 40/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482355938e+00 | Ndiff 1.234 41/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482208671e+00 | Ndiff 1.208 42/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.482065808e+00 | Ndiff 1.181 43/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481927496e+00 | Ndiff 1.153 44/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481793878e+00 | Ndiff 1.125 45/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481665086e+00 | Ndiff 1.096 46/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481541238e+00 | Ndiff 1.067 47/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481422435e+00 | Ndiff 1.037 48/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481308757e+00 | Ndiff 1.007 49/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481200261e+00 | Ndiff 0.977 50/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.481096980e+00 | Ndiff 0.946 51/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480998920e+00 | Ndiff 0.916 52/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480906060e+00 | Ndiff 0.885 53/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480818354e+00 | Ndiff 0.855 54/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480735728e+00 | Ndiff 0.824 55/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480658085e+00 | Ndiff 0.794 56/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480585302e+00 | Ndiff 0.764 57/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480517238e+00 | Ndiff 0.735 58/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480453733e+00 | Ndiff 0.706 59/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480394611e+00 | Ndiff 0.677 60/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480339683e+00 | Ndiff 0.649 61/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480288754e+00 | Ndiff 0.622 62/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480241618e+00 | Ndiff 0.596 63/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480198068e+00 | Ndiff 0.570 64/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480157895e+00 | Ndiff 0.545 65/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480120891e+00 | Ndiff 0.521 66/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480086852e+00 | Ndiff 0.498 67/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480055578e+00 | Ndiff 0.475 68/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480026875e+00 | Ndiff 0.454 69/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.480000557e+00 | Ndiff 0.433 70/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479976447e+00 | Ndiff 0.413 71/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479954376e+00 | Ndiff 0.394 72/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479934185e+00 | Ndiff 0.376 73/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479915723e+00 | Ndiff 0.358 74/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479898850e+00 | Ndiff 0.342 75/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479883435e+00 | Ndiff 0.326 76/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479869356e+00 | Ndiff 0.311 77/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479856501e+00 | Ndiff 0.296 78/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479844764e+00 | Ndiff 0.282 79/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479834050e+00 | Ndiff 0.269 80/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479824270e+00 | Ndiff 0.257 81/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479815342e+00 | Ndiff 0.245 82/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479807191e+00 | Ndiff 0.233 83/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479799751e+00 | Ndiff 0.223 84/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479792957e+00 | Ndiff 0.212 85/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479786752e+00 | Ndiff 0.203 86/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479781086e+00 | Ndiff 0.193 87/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479775909e+00 | Ndiff 0.185 88/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479771178e+00 | Ndiff 0.176 89/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479766855e+00 | Ndiff 0.168 90/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479762903e+00 | Ndiff 0.161 91/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479759289e+00 | Ndiff 0.153 92/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479755983e+00 | Ndiff 0.147 93/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479752958e+00 | Ndiff 0.140 94/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479750190e+00 | Ndiff 0.134 95/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479747656e+00 | Ndiff 0.128 96/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479745336e+00 | Ndiff 0.122 97/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479743210e+00 | Ndiff 0.117 98/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479741263e+00 | Ndiff 0.112 99/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479739478e+00 | Ndiff 0.107 100/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479737841e+00 | Ndiff 0.102 101/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479736341e+00 | Ndiff 0.098 102/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479734964e+00 | Ndiff 0.094 103/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479733701e+00 | Ndiff 0.090 104/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479732542e+00 | Ndiff 0.086 105/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479731477e+00 | Ndiff 0.082 106/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479730500e+00 | Ndiff 0.079 107/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479729602e+00 | Ndiff 0.075 108/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479728777e+00 | Ndiff 0.072 109/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479728019e+00 | Ndiff 0.069 110/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479727321e+00 | Ndiff 0.066 111/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479726681e+00 | Ndiff 0.064 112/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479726091e+00 | Ndiff 0.061 113/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479725549e+00 | Ndiff 0.058 114/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479725050e+00 | Ndiff 0.056 115/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479724590e+00 | Ndiff 0.054 116/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479724168e+00 | Ndiff 0.051 117/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479723778e+00 | Ndiff 0.049 118/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479723420e+00 | Ndiff 0.047 119/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479723090e+00 | Ndiff 0.045 120/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479722785e+00 | Ndiff 0.044 121/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479722505e+00 | Ndiff 0.042 122/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479722247e+00 | Ndiff 0.040 123/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479722009e+00 | Ndiff 0.039 124/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479721789e+00 | Ndiff 0.037 125/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479721587e+00 | Ndiff 0.036 126/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479721400e+00 | Ndiff 0.034 127/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479721228e+00 | Ndiff 0.033 128/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479721069e+00 | Ndiff 0.031 129/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479720922e+00 | Ndiff 0.030 130/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479720787e+00 | Ndiff 0.029 131/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479720662e+00 | Ndiff 0.028 132/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479720547e+00 | Ndiff 0.027 133/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479720440e+00 | Ndiff 0.026 134/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479720342e+00 | Ndiff 0.025 135/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479720251e+00 | Ndiff 0.024 136/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479720168e+00 | Ndiff 0.023 137/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479720090e+00 | Ndiff 0.022 138/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479720019e+00 | Ndiff 0.021 139/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479719953e+00 | Ndiff 0.020 140/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479719892e+00 | Ndiff 0.019 141/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479719836e+00 | Ndiff 0.019 142/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479719783e+00 | Ndiff 0.018 143/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479719735e+00 | Ndiff 0.017 144/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479719691e+00 | Ndiff 0.017 145/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479719650e+00 | Ndiff 0.016 146/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479719612e+00 | Ndiff 0.015 147/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479719577e+00 | Ndiff 0.015 148/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479719544e+00 | Ndiff 0.014 149/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479719514e+00 | Ndiff 0.014 150/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.479719486e+00 | Ndiff 0.013 151/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719461e+00 | Ndiff 0.013 152/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719437e+00 | Ndiff 0.012 153/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719415e+00 | Ndiff 0.012 154/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719395e+00 | Ndiff 0.011 155/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719376e+00 | Ndiff 0.011 156/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719359e+00 | Ndiff 0.010 157/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719343e+00 | Ndiff 0.010 158/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719328e+00 | Ndiff 0.010 159/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719314e+00 | Ndiff 0.009 160/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719301e+00 | Ndiff 0.009 161/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719290e+00 | Ndiff 0.009 162/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719279e+00 | Ndiff 0.008 163/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719269e+00 | Ndiff 0.008 164/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719259e+00 | Ndiff 0.008 165/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719251e+00 | Ndiff 0.007 166/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719243e+00 | Ndiff 0.007 167/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719235e+00 | Ndiff 0.007 168/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719228e+00 | Ndiff 0.006 169/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719222e+00 | Ndiff 0.006 170/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719216e+00 | Ndiff 0.006 171/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719211e+00 | Ndiff 0.006 172/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719206e+00 | Ndiff 0.006 173/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719201e+00 | Ndiff 0.005 174/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719197e+00 | Ndiff 0.005 175/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719193e+00 | Ndiff 0.005 176/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719189e+00 | Ndiff 0.005 177/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719186e+00 | Ndiff 0.005 178/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719183e+00 | Ndiff 0.004 179/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719180e+00 | Ndiff 0.004 180/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719177e+00 | Ndiff 0.004 181/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719175e+00 | Ndiff 0.004 182/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719172e+00 | Ndiff 0.004 183/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719170e+00 | Ndiff 0.004 184/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719168e+00 | Ndiff 0.003 185/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719166e+00 | Ndiff 0.003 186/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719165e+00 | Ndiff 0.003 187/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719163e+00 | Ndiff 0.003 188/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719161e+00 | Ndiff 0.003 189/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719160e+00 | Ndiff 0.003 190/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719159e+00 | Ndiff 0.003 191/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719158e+00 | Ndiff 0.003 192/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719157e+00 | Ndiff 0.003 193/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719156e+00 | Ndiff 0.002 194/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719155e+00 | Ndiff 0.002 195/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719154e+00 | Ndiff 0.002 196/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719153e+00 | Ndiff 0.002 197/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719152e+00 | Ndiff 0.002 198/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719152e+00 | Ndiff 0.002 199/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719151e+00 | Ndiff 0.002 200/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719150e+00 | Ndiff 0.002 201/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719150e+00 | Ndiff 0.002 202/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719149e+00 | Ndiff 0.002 203/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719149e+00 | Ndiff 0.002 204/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719149e+00 | Ndiff 0.002 205/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719148e+00 | Ndiff 0.002 206/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719148e+00 | Ndiff 0.001 207/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719147e+00 | Ndiff 0.001 208/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719147e+00 | Ndiff 0.001 209/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719147e+00 | Ndiff 0.001 210/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719147e+00 | Ndiff 0.001 211/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719146e+00 | Ndiff 0.001 212/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719146e+00 | Ndiff 0.001 213/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719146e+00 | Ndiff 0.001 214/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719146e+00 | Ndiff 0.001 215/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719146e+00 | Ndiff 0.001 216/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719145e+00 | Ndiff 0.001 217/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719145e+00 | Ndiff 0.001 218/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719145e+00 | Ndiff 0.001 219/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719145e+00 | Ndiff 0.001 220/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719145e+00 | Ndiff 0.001 221/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719145e+00 | Ndiff 0.001 222/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719145e+00 | Ndiff 0.001 223/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.001 224/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.001 225/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.001 226/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.001 227/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.001 228/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.001 229/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.001 230/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.001 231/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.001 232/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.001 233/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.001 234/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.001 235/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.000 236/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.000 237/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.000 238/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.000 239/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.000 240/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.000 241/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719144e+00 | Ndiff 0.000 242/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 243/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 244/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 245/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 246/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 247/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 248/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 249/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 250/1000 after 2 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 251/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 252/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 253/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 254/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 255/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 256/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 257/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 258/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 259/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 260/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 261/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 262/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 263/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 264/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 265/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 266/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 267/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 268/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 269/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 270/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 271/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 272/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 273/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 274/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 275/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 276/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 277/1000 after 3 sec. | 218.2 MiB | K 3 | loss 2.479719143e+00 | Ndiff 0.000 ... done. converged. Learn Alg: VB | task 5/5 | alg. seed: 2986368 | data order seed: 6479872 task_output_path: /tmp/faithful/demo_sparse_resp-K=3-lik=Gauss-ECovMat=5*eye/5 1/1000 after 0 sec. | 218.2 MiB | K 3 | loss 3.172454094e+00 | 2/1000 after 0 sec. | 218.2 MiB | K 3 | loss 3.141604650e+00 | Ndiff 2.137 3/1000 after 0 sec. | 218.2 MiB | K 3 | loss 3.132916761e+00 | Ndiff 2.207 4/1000 after 0 sec. | 218.2 MiB | K 3 | loss 3.116013242e+00 | Ndiff 5.951 5/1000 after 0 sec. | 218.2 MiB | K 3 | loss 3.079969466e+00 | Ndiff 11.990 6/1000 after 0 sec. | 218.2 MiB | K 3 | loss 3.017967278e+00 | Ndiff 19.686 7/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.936658417e+00 | Ndiff 25.772 8/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.854720770e+00 | Ndiff 26.020 9/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.778771855e+00 | Ndiff 21.413 10/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.688031379e+00 | Ndiff 17.921 11/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.590482847e+00 | Ndiff 12.677 12/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.538125017e+00 | Ndiff 5.219 13/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.514221187e+00 | Ndiff 3.415 14/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.497495257e+00 | Ndiff 2.846 15/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.495853387e+00 | Ndiff 1.084 16/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.495615725e+00 | Ndiff 0.686 17/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.495466026e+00 | Ndiff 0.569 18/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.495360868e+00 | Ndiff 0.492 19/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.495282138e+00 | Ndiff 0.438 20/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.495220122e+00 | Ndiff 0.397 21/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.495169130e+00 | Ndiff 0.366 22/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.495125609e+00 | Ndiff 0.342 23/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.495087248e+00 | Ndiff 0.322 24/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.495052510e+00 | Ndiff 0.305 25/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.495020376e+00 | Ndiff 0.290 26/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494990186e+00 | Ndiff 0.277 27/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494961538e+00 | Ndiff 0.265 28/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494934218e+00 | Ndiff 0.254 29/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494908140e+00 | Ndiff 0.243 30/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494883308e+00 | Ndiff 0.233 31/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494859775e+00 | Ndiff 0.223 32/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494837612e+00 | Ndiff 0.212 33/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494816893e+00 | Ndiff 0.202 34/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494797668e+00 | Ndiff 0.192 35/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494779964e+00 | Ndiff 0.183 36/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494763774e+00 | Ndiff 0.173 37/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494749060e+00 | Ndiff 0.163 38/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494735759e+00 | Ndiff 0.154 39/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494723785e+00 | Ndiff 0.145 40/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494713036e+00 | Ndiff 0.137 41/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494703405e+00 | Ndiff 0.129 42/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494694776e+00 | Ndiff 0.121 43/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494687038e+00 | Ndiff 0.114 44/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494680081e+00 | Ndiff 0.108 45/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494673802e+00 | Ndiff 0.102 46/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494668101e+00 | Ndiff 0.096 47/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494662889e+00 | Ndiff 0.091 48/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494658081e+00 | Ndiff 0.087 49/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494653596e+00 | Ndiff 0.083 50/1000 after 0 sec. | 218.2 MiB | K 3 | loss 2.494649357e+00 | Ndiff 0.079 51/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494645290e+00 | Ndiff 0.076 52/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494641317e+00 | Ndiff 0.074 53/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494637354e+00 | Ndiff 0.072 54/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494633308e+00 | Ndiff 0.071 55/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494629063e+00 | Ndiff 0.071 56/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494624470e+00 | Ndiff 0.072 57/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494619327e+00 | Ndiff 0.073 58/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494613338e+00 | Ndiff 0.076 59/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494606055e+00 | Ndiff 0.080 60/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494596763e+00 | Ndiff 0.086 61/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494584268e+00 | Ndiff 0.094 62/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494566496e+00 | Ndiff 0.107 63/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494539723e+00 | Ndiff 0.123 64/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494497190e+00 | Ndiff 0.146 65/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494427049e+00 | Ndiff 0.177 66/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494311214e+00 | Ndiff 0.217 67/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.494130236e+00 | Ndiff 0.262 68/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.493873502e+00 | Ndiff 0.313 69/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.493523728e+00 | Ndiff 0.371 70/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.492991715e+00 | Ndiff 0.441 71/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.492034383e+00 | Ndiff 0.514 72/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.490416803e+00 | Ndiff 0.538 73/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.489022467e+00 | Ndiff 0.469 74/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.488517958e+00 | Ndiff 0.454 75/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.488074913e+00 | Ndiff 0.435 76/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.487289742e+00 | Ndiff 0.375 77/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.486119349e+00 | Ndiff 0.236 78/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.485305514e+00 | Ndiff 0.082 79/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.484928040e+00 | Ndiff 0.036 80/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.484776037e+00 | Ndiff 0.007 81/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.484732728e+00 | Ndiff 0.012 82/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.484723997e+00 | Ndiff 0.015 83/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.484722544e+00 | Ndiff 0.010 84/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.484722316e+00 | Ndiff 0.005 85/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.484722281e+00 | Ndiff 0.003 86/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.484722275e+00 | Ndiff 0.001 87/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.484722274e+00 | Ndiff 0.001 88/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.484722274e+00 | Ndiff 0.000 89/1000 after 1 sec. | 218.2 MiB | K 3 | loss 2.484722274e+00 | Ndiff 0.000 ... done. converged. .. GENERATED FROM PYTHON SOURCE LINES 126-134 Do inference with L=1 sparsity ------------------------------ Kwarg to set is "nnzPerRowLP = 1" nnzPerRowLP is read as "number of non-zero entries per row of local parameters" This enforces that each row of resp array has ___ non zero entries .. GENERATED FROM PYTHON SOURCE LINES 135-141 .. code-block:: default print('SPARSITY LEVEL: 1 of 3') LP1 = full_trained_model.calc_local_params(dataset, nnzPerRowLP=1) pprint_sparse_or_dense_resp(LP1) .. rst-class:: sphx-glr-script-out .. code-block:: none SPARSITY LEVEL: 1 of 3 [[0. 0. 1.] [0. 0. 1.] [0. 1. 0.] [0. 0. 1.] [0. 0. 1.] [0. 0. 1.] [0. 0. 1.] [0. 1. 0.] [1. 0. 0.] [0. 1. 0.]] .. GENERATED FROM PYTHON SOURCE LINES 142-144 Do inference with L=2 sparsity ------------------------------ .. GENERATED FROM PYTHON SOURCE LINES 145-151 .. code-block:: default print('SPARSITY LEVEL: 2 of 3') LP2 = full_trained_model.calc_local_params(dataset, nnzPerRowLP=2) pprint_sparse_or_dense_resp(LP2) .. rst-class:: sphx-glr-script-out .. code-block:: none SPARSITY LEVEL: 2 of 3 [[0. 0.2424 0.7576] [0.2281 0. 0.7719] [0. 0.9262 0.0738] [0.0427 0. 0.9573] [0.0269 0. 0.9731] [0.0247 0. 0.9753] [0. 0.021 0.979 ] [0. 0.9866 0.0134] [0.9866 0. 0.0134] [0. 0.9905 0.0095]] .. GENERATED FROM PYTHON SOURCE LINES 152-154 Do inference with L=3 sparsity ------------------------------ .. GENERATED FROM PYTHON SOURCE LINES 155-174 .. code-block:: default print('SPARSITY LEVEL: 3 of 3 (DENSE)') LP3 = full_trained_model.calc_local_params(dataset, nnzPerRowLP=3) pprint_sparse_or_dense_resp(LP3) # Show the model pylab.figure(2) bnpy.viz.PlotComps.plotCompsFromHModel( full_trained_model, dataset=targeted_dataset, ) pylab.xlabel(dataset.column_names[0]) pylab.ylabel(dataset.column_names[1]) pylab.tight_layout() pylab.title('Trained model with targeted examples') .. image-sg:: /examples/03_faithful/images/sphx_glr_plot-03-demo=sparse_resp_vb-model=mix_gauss_003.png :alt: Trained model with targeted examples :srcset: /examples/03_faithful/images/sphx_glr_plot-03-demo=sparse_resp_vb-model=mix_gauss_003.png :class: sphx-glr-single-img .. rst-class:: sphx-glr-script-out .. code-block:: none SPARSITY LEVEL: 3 of 3 (DENSE) [[0. 0.2424 0.7575] [0.2281 0. 0.7719] [0. 0.9262 0.0738] [0.0427 0. 0.9573] [0.0269 0.0002 0.9729] [0.0247 0. 0.9753] [0.0002 0.021 0.9788] [0. 0.9866 0.0134] [0.9866 0. 0.0134] [0. 0.9905 0.0095]] Text(0.5, 1.0, 'Trained model with targeted examples') .. GENERATED FROM PYTHON SOURCE LINES 175-178 How to incorporate sparsity during training? -------------------------------------------- Just pass "nnzPerRowLP" kwarg to bnpy.run(...) .. rst-class:: sphx-glr-timing **Total running time of the script:** ( 0 minutes 10.619 seconds) .. _sphx_glr_download_examples_03_faithful_plot-03-demo=sparse_resp_vb-model=mix_gauss.py: .. only:: html .. container:: sphx-glr-footer sphx-glr-footer-example .. container:: sphx-glr-download sphx-glr-download-python :download:`Download Python source code: plot-03-demo=sparse_resp_vb-model=mix_gauss.py ` .. container:: sphx-glr-download sphx-glr-download-jupyter :download:`Download Jupyter notebook: plot-03-demo=sparse_resp_vb-model=mix_gauss.ipynb ` .. only:: html .. rst-class:: sphx-glr-signature `Gallery generated by Sphinx-Gallery `_