.. DO NOT EDIT. .. THIS FILE WAS AUTOMATICALLY GENERATED BY SPHINX-GALLERY. .. TO MAKE CHANGES, EDIT THE SOURCE PYTHON FILE: .. "auto_examples/neuralLatents/plot_MC_MAZE_SMALL.py" .. LINE NUMBERS ARE GIVEN BELOW. .. only:: html .. note:: :class: sphx-glr-download-link-note :ref:`Go to the end ` to download the full example code or to run this example in your browser via Binder .. rst-class:: sphx-glr-example-title .. _sphx_glr_auto_examples_neuralLatents_plot_MC_MAZE_SMALL.py: Learning and inference of latents with MC_MAZE_SMALL data ============================================================ The code below learns and infers latents with MC_MAZE_SMALL data. .. GENERATED FROM PYTHON SOURCE LINES 11-24 .. code-block:: default import numpy as np import plotly.graph_objects as go from dandi.dandiapi import DandiAPIClient from pynwb import NWBHDF5IO import ssm.inference import ssm.learning import ssm.neural_latents.utils import ssm.neural_latents.plotting .. GENERATED FROM PYTHON SOURCE LINES 25-34 Define variables ^^^^^^^^^^^^^^^^ Here I am setting a small value to variable ``max_iter``, in order to build this documentation quickly. You may want to set this variable to ``max_iter=2000`` in combination with a small error tolerance ``tol=1e-3``. In addition, you may want to plot all the data, and not just a small time interval between ``from_time = 100.0`` and ``to_time = 130.0``, by setting ``from_time = -np.inf`` and ``to_time = np.inf``. .. GENERATED FROM PYTHON SOURCE LINES 34-70 .. code-block:: default # data get_data_from_Dandi = True dandiset_ID = "000140" dandi_filepath = "sub-Jenkins/sub-Jenkins_ses-small_desc-train_behavior+ecephys.nwb" local_filepath = f"../../../../projects/lds_neuralLatents_MC_MAZE_SMALL/data/{dandiset_ID}/sub-Jenkins/sub-Jenkins_ses-small_desc-train_behavior+ecephys.nwb" bin_size = 0.02 # plot events_names = ["start_time", "target_on_time", "go_cue_time", "move_onset_time", "stop_time"] events_linetypes = ["dot", "dash", "dashdot", "longdash", "solid"] events_colors_spikes = ["white", "white", "white", "white", "white"] events_colors_latents = ["black", "black", "black", "black", "black"] cb_alpha = 0.3 from_time = 100.0 to_time = 130.0 # model n_latents = 10 # estimation initial conditions sigma_B = 0.1 sigma_Z = 0.1 sigma_Q = 0.1 sigma_R = 0.1 sigma_m0 = 0.1 sigma_V0 = 0.1 # estimation parameters # max_iter = 2000 max_iter = 2000 tol = 1e-1 vars_to_estimate = {"B": True, "Q": True, "Z": True, "R": True, "m0": True, "V0": True, } .. GENERATED FROM PYTHON SOURCE LINES 71-73 Download data ^^^^^^^^^^^^^ .. GENERATED FROM PYTHON SOURCE LINES 73-92 .. code-block:: default if get_data_from_Dandi: with DandiAPIClient() as client: asset = client.get_dandiset(dandiset_ID, "draft").get_asset_by_path(dandi_filepath) s3_path = asset.get_content_url(follow_redirects=1, strip_query=True) io = NWBHDF5IO(s3_path, mode="r", driver="ros3") nwbfile = io.read() units_df = nwbfile.units.to_dataframe() trials_df = nwbfile.intervals["trials"].to_dataframe() else: with NWBHDF5IO(local_filepath, 'r') as io: nwbfile = io.read() units_df = nwbfile.units.to_dataframe() trials_df = nwbfile.intervals["trials"].to_dataframe() # n_clusters n_clusters = units_df.shape[0] .. GENERATED FROM PYTHON SOURCE LINES 93-95 Bin spikes ^^^^^^^^^^ .. GENERATED FROM PYTHON SOURCE LINES 95-116 .. code-block:: default # continuous spikes times continuous_spikes_times = [None for n in range(n_clusters)] for n in range(n_clusters): continuous_spikes_times[n] = units_df.iloc[n]['spike_times'] binned_spikes, bin_edges = ssm.neural_latents.utils.bin_spike_times( spike_times=continuous_spikes_times, bin_size=bin_size) bin_centers = (bin_edges[1:] + bin_edges[:-1])/2 transformed_binned_spikes = np.sqrt(binned_spikes + 0.5) # clip data to plot first_index = np.where(bin_centers >= from_time)[0][0] last_index = np.where(bin_centers <= to_time)[0][-1] to_plot_slice = slice(first_index, last_index) bin_centers_to_plot = bin_centers[to_plot_slice] trials_df = trials_df[np.logical_and( trials_df['start_time'] >= from_time, trials_df['stop_time'] <= to_time, )] .. GENERATED FROM PYTHON SOURCE LINES 117-119 Plot binned spikes ~~~~~~~~~~~~~~~~~~ .. GENERATED FROM PYTHON SOURCE LINES 119-132 .. code-block:: default fig = go.Figure() trace = go.Heatmap(x=bin_centers_to_plot, z=transformed_binned_spikes[:, to_plot_slice], colorbar=dict(title="Sqrt(spike_count+0.5)")) fig.add_trace(trace) ssm.neural_latents.plotting.add_events_vlines( fig=fig, trials_df=trials_df, events_names=events_names, events_linetypes=events_linetypes, events_colors=events_colors_spikes) fig.update_xaxes(title="Time (sec)") fig.update_yaxes(title="Cluster Index") fig .. raw:: html


.. GENERATED FROM PYTHON SOURCE LINES 133-135 Parameter learning using expectation maximization ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ .. GENERATED FROM PYTHON SOURCE LINES 135-149 .. code-block:: default B0 = np.diag(np.random.normal(loc=0, scale=sigma_B, size=n_latents)) Z0 = np.random.normal(loc=0, scale=sigma_Z, size=(n_clusters, n_latents)) Q0 = np.diag(np.abs(np.random.normal(loc=0, scale=sigma_Q, size=n_latents))) R0 = np.diag(np.abs(np.random.normal(loc=0, scale=sigma_R, size=n_clusters))) m0_0 = np.random.normal(loc=0, scale=sigma_m0, size=n_latents) V0_0 = np.diag(np.abs(np.random.normal(loc=0, scale=sigma_V0, size=n_latents))) optim_res = ssm.learning.em_SS_LDS( y=transformed_binned_spikes, B0=B0, Q0=Q0, Z0=Z0, R0=R0, m0_0=m0_0, V0_0=V0_0, max_iter=max_iter, tol=tol, vars_to_estimate=vars_to_estimate, ) .. rst-class:: sphx-glr-script-out .. code-block:: none LogLike[0000]=-16158167.081965 LogLike[0001]=1808272.347632 LogLike[0002]=1812268.574295 LogLike[0003]=1816801.948156 LogLike[0004]=1821518.131391 LogLike[0005]=1826169.132280 LogLike[0006]=1830564.557074 LogLike[0007]=1834477.274435 LogLike[0008]=1837680.142568 LogLike[0009]=1840098.395893 LogLike[0010]=1841941.587680 LogLike[0011]=1843504.113682 LogLike[0012]=1844822.927147 LogLike[0013]=1845834.828552 LogLike[0014]=1846610.928428 LogLike[0015]=1847269.520091 LogLike[0016]=1847903.367318 LogLike[0017]=1848584.400838 LogLike[0018]=1849344.984006 LogLike[0019]=1850142.650665 LogLike[0020]=1850898.464548 LogLike[0021]=1851575.124075 LogLike[0022]=1852175.043750 LogLike[0023]=1852705.218564 LogLike[0024]=1853170.873070 LogLike[0025]=1853580.768070 LogLike[0026]=1853946.976907 LogLike[0027]=1854281.487541 LogLike[0028]=1854593.835668 LogLike[0029]=1854890.094328 LogLike[0030]=1855172.538747 LogLike[0031]=1855440.010143 LogLike[0032]=1855689.261510 LogLike[0033]=1855916.938972 LogLike[0034]=1856121.202923 LogLike[0035]=1856302.250476 LogLike[0036]=1856461.863307 LogLike[0037]=1856602.609430 LogLike[0038]=1856727.195182 LogLike[0039]=1856838.115921 LogLike[0040]=1856937.539914 LogLike[0041]=1857027.313825 LogLike[0042]=1857109.011987 LogLike[0043]=1857183.988977 LogLike[0044]=1857253.422329 LogLike[0045]=1857318.343171 LogLike[0046]=1857379.657386 LogLike[0047]=1857438.160312 LogLike[0048]=1857494.547179 LogLike[0049]=1857549.420783 LogLike[0050]=1857603.296858 LogLike[0051]=1857656.608193 LogLike[0052]=1857709.707322 LogLike[0053]=1857762.868939 LogLike[0054]=1857816.292601 LogLike[0055]=1857870.105761 LogLike[0056]=1857924.369401 LogLike[0057]=1857979.085245 LogLike[0058]=1858034.205626 LogLike[0059]=1858089.645962 LogLike[0060]=1858145.299218 LogLike[0061]=1858201.050889 LogLike[0062]=1858256.794079 LogLike[0063]=1858312.442157 LogLike[0064]=1858367.938953 LogLike[0065]=1858423.264184 LogLike[0066]=1858478.434446 LogLike[0067]=1858533.499347 LogLike[0068]=1858588.533221 LogLike[0069]=1858643.622553 LogLike[0070]=1858698.850717 LogLike[0071]=1858754.280477 LogLike[0072]=1858809.936713 LogLike[0073]=1858865.790932 LogLike[0074]=1858921.750491 LogLike[0075]=1858977.655334 LogLike[0076]=1859033.283920 LogLike[0077]=1859088.368990 LogLike[0078]=1859142.620265 LogLike[0079]=1859195.750689 LogLike[0080]=1859247.500653 LogLike[0081]=1859297.656363 LogLike[0082]=1859346.060286 LogLike[0083]=1859392.613731 LogLike[0084]=1859437.273113 LogLike[0085]=1859480.042172 LogLike[0086]=1859520.962402 LogLike[0087]=1859560.102870 LogLike[0088]=1859597.550689 LogLike[0089]=1859633.402262 LogLike[0090]=1859667.756364 LogLike[0091]=1859700.709116 LogLike[0092]=1859732.350181 LogLike[0093]=1859762.761357 LogLike[0094]=1859792.016829 LogLike[0095]=1859820.185055 LogLike[0096]=1859847.332440 LogLike[0097]=1859873.527689 LogLike[0098]=1859898.847390 LogLike[0099]=1859923.382258 LogLike[0100]=1859947.243007 LogLike[0101]=1859970.566908 LogLike[0102]=1859993.523390 LogLike[0103]=1860016.319165 LogLike[0104]=1860039.201822 LogLike[0105]=1860062.461771 LogLike[0106]=1860086.430209 LogLike[0107]=1860111.471233 LogLike[0108]=1860137.966234 LogLike[0109]=1860166.286320 LogLike[0110]=1860196.752133 LogLike[0111]=1860229.580627 LogLike[0112]=1860264.825766 LogLike[0113]=1860302.324493 LogLike[0114]=1860341.665939 LogLike[0115]=1860382.201682 LogLike[0116]=1860423.105133 LogLike[0117]=1860463.473111 LogLike[0118]=1860502.444289 LogLike[0119]=1860539.304535 LogLike[0120]=1860573.553384 LogLike[0121]=1860604.922802 LogLike[0122]=1860633.354764 LogLike[0123]=1860658.954686 LogLike[0124]=1860681.937058 LogLike[0125]=1860702.575428 LogLike[0126]=1860721.163449 LogLike[0127]=1860737.988134 LogLike[0128]=1860753.314045 LogLike[0129]=1860767.375534 LogLike[0130]=1860780.374544 LogLike[0131]=1860792.481747 LogLike[0132]=1860803.839410 LogLike[0133]=1860814.565238 LogLike[0134]=1860824.756191 LogLike[0135]=1860834.491827 LogLike[0136]=1860843.837596 LogLike[0137]=1860852.847254 LogLike[0138]=1860861.565175 LogLike[0139]=1860870.028311 LogLike[0140]=1860878.267207 LogLike[0141]=1860886.307579 LogLike[0142]=1860894.170904 LogLike[0143]=1860901.875523 LogLike[0144]=1860909.436904 LogLike[0145]=1860916.868313 LogLike[0146]=1860924.181101 LogLike[0147]=1860931.385073 LogLike[0148]=1860938.488689 LogLike[0149]=1860945.499524 LogLike[0150]=1860952.424147 LogLike[0151]=1860959.268530 LogLike[0152]=1860966.037845 LogLike[0153]=1860972.736884 LogLike[0154]=1860979.370146 LogLike[0155]=1860985.941789 LogLike[0156]=1860992.455655 LogLike[0157]=1860998.915725 LogLike[0158]=1861005.325642 LogLike[0159]=1861011.689040 LogLike[0160]=1861018.009775 LogLike[0161]=1861024.291521 LogLike[0162]=1861030.538376 LogLike[0163]=1861036.754218 LogLike[0164]=1861042.943388 LogLike[0165]=1861049.110257 LogLike[0166]=1861055.259598 LogLike[0167]=1861061.396374 LogLike[0168]=1861067.525780 LogLike[0169]=1861073.653547 LogLike[0170]=1861079.785511 LogLike[0171]=1861085.928191 LogLike[0172]=1861092.088074 LogLike[0173]=1861098.272667 LogLike[0174]=1861104.489617 LogLike[0175]=1861110.747073 LogLike[0176]=1861117.053767 LogLike[0177]=1861123.419120 LogLike[0178]=1861129.853012 LogLike[0179]=1861136.366064 LogLike[0180]=1861142.969499 LogLike[0181]=1861149.675301 LogLike[0182]=1861156.496263 LogLike[0183]=1861163.445768 LogLike[0184]=1861170.538107 LogLike[0185]=1861177.788386 LogLike[0186]=1861185.212419 LogLike[0187]=1861192.826751 LogLike[0188]=1861200.648434 LogLike[0189]=1861208.695359 LogLike[0190]=1861216.985648 LogLike[0191]=1861225.537866 LogLike[0192]=1861234.370107 LogLike[0193]=1861243.500635 LogLike[0194]=1861252.946653 LogLike[0195]=1861262.723968 LogLike[0196]=1861272.846672 LogLike[0197]=1861283.326559 LogLike[0198]=1861294.171936 LogLike[0199]=1861305.387047 LogLike[0200]=1861316.971398 LogLike[0201]=1861328.918866 LogLike[0202]=1861341.216778 LogLike[0203]=1861353.845514 LogLike[0204]=1861366.777885 LogLike[0205]=1861379.979079 LogLike[0206]=1861393.406063 LogLike[0207]=1861407.008721 LogLike[0208]=1861420.729879 LogLike[0209]=1861434.506217 LogLike[0210]=1861448.269975 LogLike[0211]=1861461.950146 LogLike[0212]=1861475.474310 LogLike[0213]=1861488.770472 LogLike[0214]=1861501.769526 LogLike[0215]=1861514.406626 LogLike[0216]=1861526.623396 LogLike[0217]=1861538.369124 LogLike[0218]=1861549.602003 LogLike[0219]=1861560.290201 LogLike[0220]=1861570.411648 LogLike[0221]=1861579.954371 LogLike[0222]=1861588.915675 LogLike[0223]=1861597.301265 LogLike[0224]=1861605.124372 LogLike[0225]=1861612.404409 LogLike[0226]=1861619.165578 LogLike[0227]=1861625.435654 LogLike[0228]=1861631.245064 LogLike[0229]=1861636.625528 LogLike[0230]=1861641.609072 LogLike[0231]=1861646.227516 LogLike[0232]=1861650.511920 LogLike[0233]=1861654.491803 LogLike[0234]=1861658.195260 LogLike[0235]=1861661.648280 LogLike[0236]=1861664.875116 LogLike[0237]=1861667.897986 LogLike[0238]=1861670.737199 LogLike[0239]=1861673.411078 LogLike[0240]=1861675.936226 LogLike[0241]=1861678.327571 LogLike[0242]=1861680.598584 LogLike[0243]=1861682.761016 LogLike[0244]=1861684.825574 LogLike[0245]=1861686.801615 LogLike[0246]=1861688.697528 LogLike[0247]=1861690.521009 LogLike[0248]=1861692.278454 LogLike[0249]=1861693.975788 LogLike[0250]=1861695.618377 LogLike[0251]=1861697.210737 LogLike[0252]=1861698.757156 LogLike[0253]=1861700.261185 LogLike[0254]=1861701.726220 LogLike[0255]=1861703.155305 LogLike[0256]=1861704.551141 LogLike[0257]=1861705.916114 LogLike[0258]=1861707.252494 LogLike[0259]=1861708.562462 LogLike[0260]=1861709.847797 LogLike[0261]=1861711.110313 LogLike[0262]=1861712.351563 LogLike[0263]=1861713.573264 LogLike[0264]=1861714.776808 LogLike[0265]=1861715.963743 LogLike[0266]=1861717.135317 LogLike[0267]=1861718.292958 LogLike[0268]=1861719.437972 LogLike[0269]=1861720.571558 LogLike[0270]=1861721.695153 LogLike[0271]=1861722.809939 LogLike[0272]=1861723.917282 LogLike[0273]=1861725.018575 LogLike[0274]=1861726.114937 LogLike[0275]=1861727.207781 LogLike[0276]=1861728.298426 LogLike[0277]=1861729.388162 LogLike[0278]=1861730.478455 LogLike[0279]=1861731.570804 LogLike[0280]=1861732.666625 LogLike[0281]=1861733.767220 LogLike[0282]=1861734.874352 LogLike[0283]=1861735.989345 LogLike[0284]=1861737.113976 LogLike[0285]=1861738.249744 LogLike[0286]=1861739.398074 LogLike[0287]=1861740.560732 LogLike[0288]=1861741.739128 LogLike[0289]=1861742.935085 LogLike[0290]=1861744.150215 LogLike[0291]=1861745.385892 LogLike[0292]=1861746.643799 LogLike[0293]=1861747.925348 LogLike[0294]=1861749.231779 LogLike[0295]=1861750.564459 LogLike[0296]=1861751.924649 LogLike[0297]=1861753.313085 LogLike[0298]=1861754.730697 LogLike[0299]=1861756.178114 LogLike[0300]=1861757.655782 LogLike[0301]=1861759.163682 LogLike[0302]=1861760.701787 LogLike[0303]=1861762.269598 LogLike[0304]=1861763.866244 LogLike[0305]=1861765.490654 LogLike[0306]=1861767.141179 LogLike[0307]=1861768.816133 LogLike[0308]=1861770.513282 LogLike[0309]=1861772.229863 LogLike[0310]=1861773.963025 LogLike[0311]=1861775.709653 LogLike[0312]=1861777.466085 LogLike[0313]=1861779.228707 LogLike[0314]=1861780.993717 LogLike[0315]=1861782.757140 LogLike[0316]=1861784.514877 LogLike[0317]=1861786.263066 LogLike[0318]=1861787.997784 LogLike[0319]=1861789.715356 LogLike[0320]=1861791.412187 LogLike[0321]=1861793.085043 LogLike[0322]=1861794.730888 LogLike[0323]=1861796.347253 LogLike[0324]=1861797.931721 LogLike[0325]=1861799.482250 LogLike[0326]=1861800.997514 LogLike[0327]=1861802.476075 LogLike[0328]=1861803.917134 LogLike[0329]=1861805.320158 LogLike[0330]=1861806.684727 LogLike[0331]=1861808.011035 LogLike[0332]=1861809.299070 LogLike[0333]=1861810.549551 LogLike[0334]=1861811.763140 LogLike[0335]=1861812.940437 LogLike[0336]=1861814.082309 LogLike[0337]=1861815.189864 LogLike[0338]=1861816.264178 LogLike[0339]=1861817.306369 LogLike[0340]=1861818.317658 LogLike[0341]=1861819.299116 LogLike[0342]=1861820.251893 LogLike[0343]=1861821.177311 LogLike[0344]=1861822.076261 LogLike[0345]=1861822.950332 LogLike[0346]=1861823.800424 LogLike[0347]=1861824.627505 LogLike[0348]=1861825.432646 LogLike[0349]=1861826.216931 LogLike[0350]=1861826.981294 LogLike[0351]=1861827.726686 LogLike[0352]=1861828.454111 LogLike[0353]=1861829.164371 LogLike[0354]=1861829.858256 LogLike[0355]=1861830.536571 LogLike[0356]=1861831.200036 LogLike[0357]=1861831.849410 LogLike[0358]=1861832.485212 LogLike[0359]=1861833.108154 LogLike[0360]=1861833.718801 LogLike[0361]=1861834.317786 LogLike[0362]=1861834.905729 LogLike[0363]=1861835.482954 LogLike[0364]=1861836.050130 LogLike[0365]=1861836.607676 LogLike[0366]=1861837.156030 LogLike[0367]=1861837.695715 LogLike[0368]=1861838.227089 LogLike[0369]=1861838.750278 LogLike[0370]=1861839.265906 LogLike[0371]=1861839.774210 LogLike[0372]=1861840.275716 LogLike[0373]=1861840.770626 LogLike[0374]=1861841.259014 LogLike[0375]=1861841.741423 LogLike[0376]=1861842.218006 LogLike[0377]=1861842.689108 LogLike[0378]=1861843.154723 LogLike[0379]=1861843.615385 LogLike[0380]=1861844.071049 LogLike[0381]=1861844.522178 LogLike[0382]=1861844.968720 LogLike[0383]=1861845.410858 LogLike[0384]=1861845.849231 LogLike[0385]=1861846.283484 LogLike[0386]=1861846.714102 LogLike[0387]=1861847.140913 LogLike[0388]=1861847.564363 LogLike[0389]=1861847.984597 LogLike[0390]=1861848.401463 LogLike[0391]=1861848.815260 LogLike[0392]=1861849.226235 LogLike[0393]=1861849.634312 LogLike[0394]=1861850.039642 LogLike[0395]=1861850.442317 LogLike[0396]=1861850.842506 LogLike[0397]=1861851.240241 LogLike[0398]=1861851.635706 LogLike[0399]=1861852.028884 LogLike[0400]=1861852.420080 LogLike[0401]=1861852.809126 LogLike[0402]=1861853.195995 LogLike[0403]=1861853.581091 LogLike[0404]=1861853.964261 LogLike[0405]=1861854.345507 LogLike[0406]=1861854.725170 LogLike[0407]=1861855.103203 LogLike[0408]=1861855.479599 LogLike[0409]=1861855.854460 LogLike[0410]=1861856.227660 LogLike[0411]=1861856.599501 LogLike[0412]=1861856.969925 LogLike[0413]=1861857.339017 LogLike[0414]=1861857.706892 LogLike[0415]=1861858.073569 LogLike[0416]=1861858.438796 LogLike[0417]=1861858.803007 LogLike[0418]=1861859.166052 LogLike[0419]=1861859.527844 LogLike[0420]=1861859.888570 LogLike[0421]=1861860.248416 LogLike[0422]=1861860.607232 LogLike[0423]=1861860.964991 LogLike[0424]=1861861.322053 LogLike[0425]=1861861.677987 LogLike[0426]=1861862.033076 LogLike[0427]=1861862.387310 LogLike[0428]=1861862.740781 LogLike[0429]=1861863.093274 LogLike[0430]=1861863.445037 LogLike[0431]=1861863.796130 LogLike[0432]=1861864.146561 LogLike[0433]=1861864.496227 LogLike[0434]=1861864.845216 LogLike[0435]=1861865.193429 LogLike[0436]=1861865.541070 LogLike[0437]=1861865.888039 LogLike[0438]=1861866.234409 LogLike[0439]=1861866.580221 LogLike[0440]=1861866.925458 LogLike[0441]=1861867.269984 LogLike[0442]=1861867.613969 LogLike[0443]=1861867.957542 LogLike[0444]=1861868.300467 LogLike[0445]=1861868.643007 LogLike[0446]=1861868.985005 LogLike[0447]=1861869.326492 LogLike[0448]=1861869.667433 LogLike[0449]=1861870.007851 LogLike[0450]=1861870.347997 LogLike[0451]=1861870.687693 LogLike[0452]=1861871.026967 LogLike[0453]=1861871.365699 LogLike[0454]=1861871.704171 LogLike[0455]=1861872.042213 LogLike[0456]=1861872.379876 LogLike[0457]=1861872.717087 LogLike[0458]=1861873.053970 LogLike[0459]=1861873.390457 LogLike[0460]=1861873.726591 LogLike[0461]=1861874.062397 LogLike[0462]=1861874.398000 LogLike[0463]=1861874.733217 LogLike[0464]=1861875.068064 LogLike[0465]=1861875.402585 LogLike[0466]=1861875.736791 LogLike[0467]=1861876.070658 LogLike[0468]=1861876.404311 LogLike[0469]=1861876.737530 LogLike[0470]=1861877.070491 LogLike[0471]=1861877.403250 LogLike[0472]=1861877.735759 LogLike[0473]=1861878.067767 LogLike[0474]=1861878.399805 LogLike[0475]=1861878.731527 LogLike[0476]=1861879.062954 LogLike[0477]=1861879.394077 LogLike[0478]=1861879.725026 LogLike[0479]=1861880.055725 LogLike[0480]=1861880.386206 LogLike[0481]=1861880.716331 LogLike[0482]=1861881.046207 LogLike[0483]=1861881.375834 LogLike[0484]=1861881.705343 LogLike[0485]=1861882.034709 LogLike[0486]=1861882.363671 LogLike[0487]=1861882.692578 LogLike[0488]=1861883.021242 LogLike[0489]=1861883.349586 LogLike[0490]=1861883.677824 LogLike[0491]=1861884.005848 LogLike[0492]=1861884.333544 LogLike[0493]=1861884.661149 LogLike[0494]=1861884.988489 LogLike[0495]=1861885.315603 LogLike[0496]=1861885.642392 LogLike[0497]=1861885.969264 LogLike[0498]=1861886.295796 LogLike[0499]=1861886.622141 LogLike[0500]=1861886.948323 LogLike[0501]=1861887.274286 LogLike[0502]=1861887.599954 LogLike[0503]=1861887.925431 LogLike[0504]=1861888.250990 LogLike[0505]=1861888.576236 LogLike[0506]=1861888.901212 LogLike[0507]=1861889.226030 LogLike[0508]=1861889.550725 LogLike[0509]=1861889.875026 LogLike[0510]=1861890.199209 LogLike[0511]=1861890.523294 LogLike[0512]=1861890.847094 LogLike[0513]=1861891.170854 LogLike[0514]=1861891.494301 LogLike[0515]=1861891.817658 LogLike[0516]=1861892.140807 LogLike[0517]=1861892.463628 LogLike[0518]=1861892.786400 LogLike[0519]=1861893.109109 LogLike[0520]=1861893.431666 LogLike[0521]=1861893.753929 LogLike[0522]=1861894.076052 LogLike[0523]=1861894.398078 LogLike[0524]=1861894.719857 LogLike[0525]=1861895.041464 LogLike[0526]=1861895.362885 LogLike[0527]=1861895.684083 LogLike[0528]=1861896.005060 LogLike[0529]=1861896.326000 LogLike[0530]=1861896.646693 LogLike[0531]=1861896.967305 LogLike[0532]=1861897.287771 LogLike[0533]=1861897.607928 LogLike[0534]=1861897.928016 LogLike[0535]=1861898.247886 LogLike[0536]=1861898.567577 LogLike[0537]=1861898.887120 LogLike[0538]=1861899.206486 LogLike[0539]=1861899.525579 LogLike[0540]=1861899.844468 LogLike[0541]=1861900.163268 LogLike[0542]=1861900.481906 LogLike[0543]=1861900.800363 LogLike[0544]=1861901.118725 LogLike[0545]=1861901.436855 LogLike[0546]=1861901.754715 LogLike[0547]=1861902.072394 LogLike[0548]=1861902.390057 LogLike[0549]=1861902.707499 LogLike[0550]=1861903.024903 LogLike[0551]=1861903.342239 LogLike[0552]=1861903.659175 LogLike[0553]=1861903.975924 LogLike[0554]=1861904.292574 LogLike[0555]=1861904.608987 LogLike[0556]=1861904.925244 LogLike[0557]=1861905.241249 LogLike[0558]=1861905.557103 LogLike[0559]=1861905.872895 LogLike[0560]=1861906.188388 LogLike[0561]=1861906.503790 LogLike[0562]=1861906.819000 LogLike[0563]=1861907.134069 LogLike[0564]=1861907.448941 LogLike[0565]=1861907.763662 LogLike[0566]=1861908.078305 LogLike[0567]=1861908.392776 LogLike[0568]=1861908.707008 LogLike[0569]=1861909.021009 LogLike[0570]=1861909.334927 LogLike[0571]=1861909.648764 LogLike[0572]=1861909.962261 LogLike[0573]=1861910.275675 LogLike[0574]=1861910.588861 LogLike[0575]=1861910.901892 LogLike[0576]=1861911.214687 LogLike[0577]=1861911.527403 LogLike[0578]=1861911.839794 LogLike[0579]=1861912.152018 LogLike[0580]=1861912.464137 LogLike[0581]=1861912.776102 LogLike[0582]=1861913.087755 LogLike[0583]=1861913.399424 LogLike[0584]=1861913.710853 LogLike[0585]=1861914.022130 LogLike[0586]=1861914.333210 LogLike[0587]=1861914.644088 LogLike[0588]=1861914.954847 LogLike[0589]=1861915.265534 LogLike[0590]=1861915.575879 LogLike[0591]=1861915.886169 LogLike[0592]=1861916.196251 LogLike[0593]=1861916.506037 LogLike[0594]=1861916.815707 LogLike[0595]=1861917.125018 LogLike[0596]=1861917.434432 LogLike[0597]=1861917.743646 LogLike[0598]=1861918.052599 LogLike[0599]=1861918.361391 LogLike[0600]=1861918.669971 LogLike[0601]=1861918.978397 LogLike[0602]=1861919.286609 LogLike[0603]=1861919.594588 LogLike[0604]=1861919.902364 LogLike[0605]=1861920.210136 LogLike[0606]=1861920.517783 LogLike[0607]=1861920.825156 LogLike[0608]=1861921.132327 LogLike[0609]=1861921.439408 LogLike[0610]=1861921.746230 LogLike[0611]=1861922.052919 LogLike[0612]=1861922.359404 LogLike[0613]=1861922.665785 LogLike[0614]=1861922.971847 LogLike[0615]=1861923.277859 LogLike[0616]=1861923.583668 LogLike[0617]=1861923.889238 LogLike[0618]=1861924.194665 LogLike[0619]=1861924.499821 LogLike[0620]=1861924.804889 LogLike[0621]=1861925.109712 LogLike[0622]=1861925.414405 LogLike[0623]=1861925.719035 LogLike[0624]=1861926.023312 LogLike[0625]=1861926.327511 LogLike[0626]=1861926.631653 LogLike[0627]=1861926.935468 LogLike[0628]=1861927.239192 LogLike[0629]=1861927.542713 LogLike[0630]=1861927.846080 LogLike[0631]=1861928.149171 LogLike[0632]=1861928.452130 LogLike[0633]=1861928.754932 LogLike[0634]=1861929.057490 LogLike[0635]=1861929.360000 LogLike[0636]=1861929.662271 LogLike[0637]=1861929.964534 LogLike[0638]=1861930.266600 LogLike[0639]=1861930.568464 LogLike[0640]=1861930.870086 LogLike[0641]=1861931.171615 LogLike[0642]=1861931.473071 LogLike[0643]=1861931.774295 LogLike[0644]=1861932.075112 LogLike[0645]=1861932.375923 LogLike[0646]=1861932.676677 LogLike[0647]=1861932.977147 LogLike[0648]=1861933.277381 LogLike[0649]=1861933.577465 LogLike[0650]=1861933.877352 LogLike[0651]=1861934.177248 LogLike[0652]=1861934.476909 LogLike[0653]=1861934.776303 LogLike[0654]=1861935.075696 LogLike[0655]=1861935.374812 LogLike[0656]=1861935.673904 LogLike[0657]=1861935.972842 LogLike[0658]=1861936.271682 LogLike[0659]=1861936.570040 LogLike[0660]=1861936.868361 LogLike[0661]=1861937.166584 LogLike[0662]=1861937.464648 LogLike[0663]=1861937.762585 LogLike[0664]=1861938.060501 LogLike[0665]=1861938.357974 LogLike[0666]=1861938.655505 LogLike[0667]=1861938.952787 LogLike[0668]=1861939.249920 LogLike[0669]=1861939.546970 LogLike[0670]=1861939.843636 LogLike[0671]=1861940.140273 LogLike[0672]=1861940.436720 LogLike[0673]=1861940.733178 LogLike[0674]=1861941.029283 LogLike[0675]=1861941.325240 LogLike[0676]=1861941.621050 LogLike[0677]=1861941.916778 LogLike[0678]=1861942.212219 LogLike[0679]=1861942.507527 LogLike[0680]=1861942.802833 LogLike[0681]=1861943.097890 LogLike[0682]=1861943.392774 LogLike[0683]=1861943.687644 LogLike[0684]=1861943.982223 LogLike[0685]=1861944.276728 LogLike[0686]=1861944.571181 LogLike[0687]=1861944.865398 LogLike[0688]=1861945.159492 LogLike[0689]=1861945.453269 LogLike[0690]=1861945.746961 LogLike[0691]=1861946.040591 LogLike[0692]=1861946.334040 LogLike[0693]=1861946.627300 LogLike[0694]=1861946.920574 LogLike[0695]=1861947.213720 LogLike[0696]=1861947.506615 LogLike[0697]=1861947.799461 LogLike[0698]=1861948.092164 LogLike[0699]=1861948.384646 LogLike[0700]=1861948.676870 LogLike[0701]=1861948.969011 LogLike[0702]=1861949.261061 LogLike[0703]=1861949.552904 LogLike[0704]=1861949.844711 LogLike[0705]=1861950.136407 LogLike[0706]=1861950.427937 LogLike[0707]=1861950.719392 LogLike[0708]=1861951.010607 LogLike[0709]=1861951.301716 LogLike[0710]=1861951.592866 LogLike[0711]=1861951.883657 LogLike[0712]=1861952.174374 LogLike[0713]=1861952.465144 LogLike[0714]=1861952.755646 LogLike[0715]=1861953.045949 LogLike[0716]=1861953.336129 LogLike[0717]=1861953.626276 LogLike[0718]=1861953.916274 LogLike[0719]=1861954.206051 LogLike[0720]=1861954.495782 LogLike[0721]=1861954.785338 LogLike[0722]=1861955.074681 LogLike[0723]=1861955.363904 LogLike[0724]=1861955.653155 LogLike[0725]=1861955.942200 LogLike[0726]=1861956.231371 LogLike[0727]=1861956.520391 LogLike[0728]=1861956.809069 LogLike[0729]=1861957.097622 LogLike[0730]=1861957.386237 LogLike[0731]=1861957.674705 LogLike[0732]=1861957.962826 LogLike[0733]=1861958.250865 LogLike[0734]=1861958.539042 LogLike[0735]=1861958.826863 LogLike[0736]=1861959.114674 LogLike[0737]=1861959.402532 LogLike[0738]=1861959.690200 LogLike[0739]=1861959.977728 LogLike[0740]=1861960.265115 LogLike[0741]=1861960.552404 LogLike[0742]=1861960.839497 LogLike[0743]=1861961.126640 LogLike[0744]=1861961.413515 LogLike[0745]=1861961.700306 LogLike[0746]=1861961.987111 LogLike[0747]=1861962.273807 LogLike[0748]=1861962.560383 LogLike[0749]=1861962.846821 LogLike[0750]=1861963.133160 LogLike[0751]=1861963.419259 LogLike[0752]=1861963.705467 LogLike[0753]=1861963.991450 LogLike[0754]=1861964.277358 LogLike[0755]=1861964.563105 LogLike[0756]=1861964.848734 LogLike[0757]=1861965.134308 LogLike[0758]=1861965.419856 LogLike[0759]=1861965.705353 LogLike[0760]=1861965.990571 LogLike[0761]=1861966.275965 LogLike[0762]=1861966.561044 LogLike[0763]=1861966.846074 LogLike[0764]=1861967.130870 LogLike[0765]=1861967.415709 LogLike[0766]=1861967.700332 LogLike[0767]=1861967.984829 LogLike[0768]=1861968.269350 LogLike[0769]=1861968.553761 LogLike[0770]=1861968.838176 LogLike[0771]=1861969.122480 LogLike[0772]=1861969.406652 LogLike[0773]=1861969.690889 LogLike[0774]=1861969.974960 LogLike[0775]=1861970.258894 LogLike[0776]=1861970.542821 LogLike[0777]=1861970.826673 LogLike[0778]=1861971.110315 LogLike[0779]=1861971.393959 LogLike[0780]=1861971.677258 LogLike[0781]=1861971.960585 LogLike[0782]=1861972.243937 LogLike[0783]=1861972.527216 LogLike[0784]=1861972.810381 LogLike[0785]=1861973.093399 LogLike[0786]=1861973.376557 LogLike[0787]=1861973.659343 LogLike[0788]=1861973.942181 LogLike[0789]=1861974.225194 LogLike[0790]=1861974.507997 LogLike[0791]=1861974.790443 LogLike[0792]=1861975.072984 LogLike[0793]=1861975.355364 LogLike[0794]=1861975.637697 LogLike[0795]=1861975.920069 LogLike[0796]=1861976.202213 LogLike[0797]=1861976.484252 LogLike[0798]=1861976.766345 LogLike[0799]=1861977.048350 LogLike[0800]=1861977.330243 LogLike[0801]=1861977.612195 LogLike[0802]=1861977.893912 LogLike[0803]=1861978.175811 LogLike[0804]=1861978.457554 LogLike[0805]=1861978.739161 LogLike[0806]=1861979.020605 LogLike[0807]=1861979.302058 LogLike[0808]=1861979.583452 LogLike[0809]=1861979.864781 LogLike[0810]=1861980.145979 LogLike[0811]=1861980.427129 LogLike[0812]=1861980.708264 LogLike[0813]=1861980.989480 LogLike[0814]=1861981.270457 LogLike[0815]=1861981.551396 LogLike[0816]=1861981.832276 LogLike[0817]=1861982.112972 LogLike[0818]=1861982.393889 LogLike[0819]=1861982.674568 LogLike[0820]=1861982.955153 LogLike[0821]=1861983.235723 LogLike[0822]=1861983.516197 LogLike[0823]=1861983.796643 LogLike[0824]=1861984.076864 LogLike[0825]=1861984.357172 LogLike[0826]=1861984.637460 LogLike[0827]=1861984.917842 LogLike[0828]=1861985.197984 LogLike[0829]=1861985.478064 LogLike[0830]=1861985.758094 LogLike[0831]=1861986.038181 LogLike[0832]=1861986.318169 LogLike[0833]=1861986.598069 LogLike[0834]=1861986.877864 LogLike[0835]=1861987.157596 LogLike[0836]=1861987.437280 LogLike[0837]=1861987.716824 LogLike[0838]=1861987.996258 LogLike[0839]=1861988.275833 LogLike[0840]=1861988.555237 LogLike[0841]=1861988.834700 LogLike[0842]=1861989.114109 LogLike[0843]=1861989.393338 LogLike[0844]=1861989.672469 LogLike[0845]=1861989.951663 LogLike[0846]=1861990.230798 LogLike[0847]=1861990.509960 LogLike[0848]=1861990.789059 LogLike[0849]=1861991.068055 LogLike[0850]=1861991.347247 LogLike[0851]=1861991.626092 LogLike[0852]=1861991.904926 LogLike[0853]=1861992.183694 LogLike[0854]=1861992.462325 LogLike[0855]=1861992.741054 LogLike[0856]=1861993.019694 LogLike[0857]=1861993.298417 LogLike[0858]=1861993.576900 LogLike[0859]=1861993.855468 LogLike[0860]=1861994.133848 LogLike[0861]=1861994.412248 LogLike[0862]=1861994.690569 LogLike[0863]=1861994.968944 LogLike[0864]=1861995.247183 LogLike[0865]=1861995.525394 LogLike[0866]=1861995.803606 LogLike[0867]=1861996.081883 LogLike[0868]=1861996.359945 LogLike[0869]=1861996.637807 LogLike[0870]=1861996.915700 LogLike[0871]=1861997.193632 LogLike[0872]=1861997.471450 LogLike[0873]=1861997.749302 LogLike[0874]=1861998.027108 LogLike[0875]=1861998.304874 LogLike[0876]=1861998.582538 LogLike[0877]=1861998.860299 LogLike[0878]=1861999.137948 LogLike[0879]=1861999.415278 LogLike[0880]=1861999.692805 LogLike[0881]=1861999.970298 LogLike[0882]=1862000.247950 LogLike[0883]=1862000.525296 LogLike[0884]=1862000.802873 LogLike[0885]=1862001.080303 LogLike[0886]=1862001.357631 LogLike[0887]=1862001.634776 LogLike[0888]=1862001.911929 LogLike[0889]=1862002.189129 LogLike[0890]=1862002.466270 LogLike[0891]=1862002.743464 LogLike[0892]=1862003.020512 LogLike[0893]=1862003.297508 LogLike[0894]=1862003.574569 LogLike[0895]=1862003.851508 LogLike[0896]=1862004.128483 LogLike[0897]=1862004.405355 LogLike[0898]=1862004.682034 LogLike[0899]=1862004.958942 LogLike[0900]=1862005.235583 LogLike[0901]=1862005.512297 LogLike[0902]=1862005.788853 LogLike[0903]=1862006.065530 LogLike[0904]=1862006.342222 LogLike[0905]=1862006.618717 LogLike[0906]=1862006.895188 LogLike[0907]=1862007.171468 LogLike[0908]=1862007.447804 LogLike[0909]=1862007.724019 LogLike[0910]=1862008.000381 LogLike[0911]=1862008.276623 LogLike[0912]=1862008.552782 LogLike[0913]=1862008.828985 LogLike[0914]=1862009.105049 LogLike[0915]=1862009.381143 LogLike[0916]=1862009.657220 LogLike[0917]=1862009.933252 LogLike[0918]=1862010.209248 LogLike[0919]=1862010.485180 LogLike[0920]=1862010.760866 LogLike[0921]=1862011.036658 LogLike[0922]=1862011.312445 LogLike[0923]=1862011.588065 LogLike[0924]=1862011.863779 LogLike[0925]=1862012.139316 LogLike[0926]=1862012.415100 LogLike[0927]=1862012.690572 LogLike[0928]=1862012.966140 LogLike[0929]=1862013.241576 LogLike[0930]=1862013.516998 LogLike[0931]=1862013.792607 LogLike[0932]=1862014.068097 LogLike[0933]=1862014.343433 LogLike[0934]=1862014.618653 LogLike[0935]=1862014.893794 LogLike[0936]=1862015.169094 LogLike[0937]=1862015.444164 LogLike[0938]=1862015.719219 LogLike[0939]=1862015.994380 LogLike[0940]=1862016.269467 LogLike[0941]=1862016.544693 LogLike[0942]=1862016.819695 LogLike[0943]=1862017.094689 LogLike[0944]=1862017.369715 LogLike[0945]=1862017.644561 LogLike[0946]=1862017.919327 LogLike[0947]=1862018.194144 LogLike[0948]=1862018.468836 LogLike[0949]=1862018.743646 LogLike[0950]=1862019.018070 LogLike[0951]=1862019.292794 LogLike[0952]=1862019.567327 LogLike[0953]=1862019.841675 LogLike[0954]=1862020.116150 LogLike[0955]=1862020.390601 LogLike[0956]=1862020.664876 LogLike[0957]=1862020.939212 LogLike[0958]=1862021.213416 LogLike[0959]=1862021.487665 LogLike[0960]=1862021.762005 LogLike[0961]=1862022.036091 LogLike[0962]=1862022.310171 LogLike[0963]=1862022.584089 LogLike[0964]=1862022.858111 LogLike[0965]=1862023.131984 LogLike[0966]=1862023.405832 LogLike[0967]=1862023.679745 LogLike[0968]=1862023.953533 LogLike[0969]=1862024.227355 LogLike[0970]=1862024.501098 LogLike[0971]=1862024.774718 LogLike[0972]=1862025.048439 LogLike[0973]=1862025.322038 LogLike[0974]=1862025.595563 LogLike[0975]=1862025.868925 LogLike[0976]=1862026.142405 LogLike[0977]=1862026.415832 LogLike[0978]=1862026.689200 LogLike[0979]=1862026.962532 LogLike[0980]=1862027.236012 LogLike[0981]=1862027.509320 LogLike[0982]=1862027.782671 LogLike[0983]=1862028.055682 LogLike[0984]=1862028.328754 LogLike[0985]=1862028.601849 LogLike[0986]=1862028.874646 LogLike[0987]=1862029.147441 LogLike[0988]=1862029.420364 LogLike[0989]=1862029.693155 LogLike[0990]=1862029.965816 LogLike[0991]=1862030.238543 LogLike[0992]=1862030.511301 LogLike[0993]=1862030.783856 LogLike[0994]=1862031.056463 LogLike[0995]=1862031.329067 LogLike[0996]=1862031.601729 LogLike[0997]=1862031.874207 LogLike[0998]=1862032.146665 LogLike[0999]=1862032.418972 LogLike[1000]=1862032.691285 LogLike[1001]=1862032.963384 LogLike[1002]=1862033.235611 LogLike[1003]=1862033.507611 LogLike[1004]=1862033.779763 LogLike[1005]=1862034.051886 LogLike[1006]=1862034.323815 LogLike[1007]=1862034.595846 LogLike[1008]=1862034.867833 LogLike[1009]=1862035.139721 LogLike[1010]=1862035.411543 LogLike[1011]=1862035.683390 LogLike[1012]=1862035.955066 LogLike[1013]=1862036.226678 LogLike[1014]=1862036.498380 LogLike[1015]=1862036.770021 LogLike[1016]=1862037.041348 LogLike[1017]=1862037.312813 LogLike[1018]=1862037.584045 LogLike[1019]=1862037.855457 LogLike[1020]=1862038.126645 LogLike[1021]=1862038.397742 LogLike[1022]=1862038.668764 LogLike[1023]=1862038.939871 LogLike[1024]=1862039.211032 LogLike[1025]=1862039.481899 LogLike[1026]=1862039.752852 LogLike[1027]=1862040.023656 LogLike[1028]=1862040.294537 LogLike[1029]=1862040.565471 LogLike[1030]=1862040.836447 LogLike[1031]=1862041.107147 LogLike[1032]=1862041.377725 LogLike[1033]=1862041.648336 LogLike[1034]=1862041.918842 LogLike[1035]=1862042.189344 LogLike[1036]=1862042.459588 LogLike[1037]=1862042.729979 LogLike[1038]=1862043.000080 LogLike[1039]=1862043.270128 LogLike[1040]=1862043.540296 LogLike[1041]=1862043.810332 LogLike[1042]=1862044.080365 LogLike[1043]=1862044.350420 LogLike[1044]=1862044.620274 LogLike[1045]=1862044.890084 LogLike[1046]=1862045.159919 LogLike[1047]=1862045.429895 LogLike[1048]=1862045.699451 LogLike[1049]=1862045.969085 LogLike[1050]=1862046.238463 LogLike[1051]=1862046.507942 LogLike[1052]=1862046.777463 LogLike[1053]=1862047.047048 LogLike[1054]=1862047.316582 LogLike[1055]=1862047.585816 LogLike[1056]=1862047.855092 LogLike[1057]=1862048.124447 LogLike[1058]=1862048.393428 LogLike[1059]=1862048.662577 LogLike[1060]=1862048.931519 LogLike[1061]=1862049.200512 LogLike[1062]=1862049.469524 LogLike[1063]=1862049.738212 LogLike[1064]=1862050.007032 LogLike[1065]=1862050.275843 LogLike[1066]=1862050.544556 LogLike[1067]=1862050.813299 LogLike[1068]=1862051.081973 LogLike[1069]=1862051.350534 LogLike[1070]=1862051.618801 LogLike[1071]=1862051.887313 LogLike[1072]=1862052.155589 LogLike[1073]=1862052.423840 LogLike[1074]=1862052.691773 LogLike[1075]=1862052.959856 LogLike[1076]=1862053.227725 LogLike[1077]=1862053.495667 LogLike[1078]=1862053.763716 LogLike[1079]=1862054.031697 LogLike[1080]=1862054.299472 LogLike[1081]=1862054.567089 LogLike[1082]=1862054.834900 LogLike[1083]=1862055.102531 LogLike[1084]=1862055.370198 LogLike[1085]=1862055.637784 LogLike[1086]=1862055.905123 LogLike[1087]=1862056.172389 LogLike[1088]=1862056.439595 LogLike[1089]=1862056.706996 LogLike[1090]=1862056.974309 LogLike[1091]=1862057.241379 LogLike[1092]=1862057.508342 LogLike[1093]=1862057.775362 LogLike[1094]=1862058.042366 LogLike[1095]=1862058.309172 LogLike[1096]=1862058.575945 LogLike[1097]=1862058.842707 LogLike[1098]=1862059.109351 LogLike[1099]=1862059.375991 LogLike[1100]=1862059.642479 LogLike[1101]=1862059.909112 LogLike[1102]=1862060.175484 LogLike[1103]=1862060.442000 LogLike[1104]=1862060.708717 LogLike[1105]=1862060.975128 LogLike[1106]=1862061.241563 LogLike[1107]=1862061.507815 LogLike[1108]=1862061.773810 LogLike[1109]=1862062.039850 LogLike[1110]=1862062.305833 LogLike[1111]=1862062.571720 LogLike[1112]=1862062.837711 LogLike[1113]=1862063.103554 LogLike[1114]=1862063.369463 LogLike[1115]=1862063.635159 LogLike[1116]=1862063.900930 LogLike[1117]=1862064.166800 LogLike[1118]=1862064.432477 LogLike[1119]=1862064.698121 LogLike[1120]=1862064.963678 LogLike[1121]=1862065.229130 LogLike[1122]=1862065.494464 LogLike[1123]=1862065.759814 LogLike[1124]=1862066.025043 LogLike[1125]=1862066.290002 LogLike[1126]=1862066.555218 LogLike[1127]=1862066.820256 LogLike[1128]=1862067.085249 LogLike[1129]=1862067.350240 LogLike[1130]=1862067.615138 LogLike[1131]=1862067.880068 LogLike[1132]=1862068.145057 LogLike[1133]=1862068.409795 LogLike[1134]=1862068.674679 LogLike[1135]=1862068.939504 LogLike[1136]=1862069.204155 LogLike[1137]=1862069.468880 LogLike[1138]=1862069.733377 LogLike[1139]=1862069.997939 LogLike[1140]=1862070.262433 LogLike[1141]=1862070.526843 LogLike[1142]=1862070.791278 LogLike[1143]=1862071.055526 LogLike[1144]=1862071.319730 LogLike[1145]=1862071.584140 LogLike[1146]=1862071.848312 LogLike[1147]=1862072.112311 LogLike[1148]=1862072.376301 LogLike[1149]=1862072.640363 LogLike[1150]=1862072.904234 LogLike[1151]=1862073.168069 LogLike[1152]=1862073.432051 LogLike[1153]=1862073.695824 LogLike[1154]=1862073.959710 LogLike[1155]=1862074.223446 LogLike[1156]=1862074.487139 LogLike[1157]=1862074.750911 LogLike[1158]=1862075.014695 LogLike[1159]=1862075.278291 LogLike[1160]=1862075.541861 LogLike[1161]=1862075.805513 LogLike[1162]=1862076.069094 LogLike[1163]=1862076.332521 LogLike[1164]=1862076.595947 LogLike[1165]=1862076.859277 LogLike[1166]=1862077.122894 LogLike[1167]=1862077.386364 LogLike[1168]=1862077.649642 LogLike[1169]=1862077.912883 LogLike[1170]=1862078.176200 LogLike[1171]=1862078.439398 LogLike[1172]=1862078.702596 LogLike[1173]=1862078.965783 LogLike[1174]=1862079.228899 LogLike[1175]=1862079.491833 LogLike[1176]=1862079.754838 LogLike[1177]=1862080.017776 LogLike[1178]=1862080.280815 LogLike[1179]=1862080.543892 LogLike[1180]=1862080.806801 LogLike[1181]=1862081.069790 LogLike[1182]=1862081.332714 LogLike[1183]=1862081.595520 LogLike[1184]=1862081.858400 LogLike[1185]=1862082.121285 LogLike[1186]=1862082.384286 LogLike[1187]=1862082.647184 LogLike[1188]=1862082.909899 LogLike[1189]=1862083.172790 LogLike[1190]=1862083.435808 LogLike[1191]=1862083.698467 LogLike[1192]=1862083.961377 LogLike[1193]=1862084.224150 LogLike[1194]=1862084.486868 LogLike[1195]=1862084.749517 LogLike[1196]=1862085.012386 LogLike[1197]=1862085.275120 LogLike[1198]=1862085.537845 LogLike[1199]=1862085.800294 LogLike[1200]=1862086.062929 LogLike[1201]=1862086.325627 LogLike[1202]=1862086.588276 LogLike[1203]=1862086.851032 LogLike[1204]=1862087.113747 LogLike[1205]=1862087.376355 LogLike[1206]=1862087.639151 LogLike[1207]=1862087.901876 LogLike[1208]=1862088.164791 LogLike[1209]=1862088.427540 LogLike[1210]=1862088.690203 LogLike[1211]=1862088.952617 LogLike[1212]=1862089.215277 LogLike[1213]=1862089.478148 LogLike[1214]=1862089.741068 LogLike[1215]=1862090.004005 LogLike[1216]=1862090.266648 LogLike[1217]=1862090.529357 LogLike[1218]=1862090.792088 LogLike[1219]=1862091.054837 LogLike[1220]=1862091.317587 LogLike[1221]=1862091.580297 LogLike[1222]=1862091.843332 LogLike[1223]=1862092.106142 LogLike[1224]=1862092.369083 LogLike[1225]=1862092.631972 LogLike[1226]=1862092.895079 LogLike[1227]=1862093.158008 LogLike[1228]=1862093.421131 LogLike[1229]=1862093.684131 LogLike[1230]=1862093.947040 LogLike[1231]=1862094.210039 LogLike[1232]=1862094.473189 LogLike[1233]=1862094.736463 LogLike[1234]=1862094.999825 LogLike[1235]=1862095.263120 LogLike[1236]=1862095.526507 LogLike[1237]=1862095.790035 LogLike[1238]=1862096.053596 LogLike[1239]=1862096.316865 LogLike[1240]=1862096.580423 LogLike[1241]=1862096.844043 LogLike[1242]=1862097.107677 LogLike[1243]=1862097.371296 LogLike[1244]=1862097.634999 LogLike[1245]=1862097.898878 LogLike[1246]=1862098.162731 LogLike[1247]=1862098.426508 LogLike[1248]=1862098.690337 LogLike[1249]=1862098.954436 LogLike[1250]=1862099.218311 LogLike[1251]=1862099.482375 LogLike[1252]=1862099.746494 LogLike[1253]=1862100.010910 LogLike[1254]=1862100.275017 LogLike[1255]=1862100.539480 LogLike[1256]=1862100.803945 LogLike[1257]=1862101.068587 LogLike[1258]=1862101.333085 LogLike[1259]=1862101.597696 LogLike[1260]=1862101.862451 LogLike[1261]=1862102.127339 LogLike[1262]=1862102.392242 LogLike[1263]=1862102.657380 LogLike[1264]=1862102.922339 LogLike[1265]=1862103.187476 LogLike[1266]=1862103.452710 LogLike[1267]=1862103.717938 LogLike[1268]=1862103.983352 LogLike[1269]=1862104.248823 LogLike[1270]=1862104.514578 LogLike[1271]=1862104.780197 LogLike[1272]=1862105.046165 LogLike[1273]=1862105.312087 LogLike[1274]=1862105.578054 LogLike[1275]=1862105.844175 LogLike[1276]=1862106.110411 LogLike[1277]=1862106.376703 LogLike[1278]=1862106.643421 LogLike[1279]=1862106.909969 LogLike[1280]=1862107.176561 LogLike[1281]=1862107.443368 LogLike[1282]=1862107.710275 LogLike[1283]=1862107.977288 LogLike[1284]=1862108.244544 LogLike[1285]=1862108.511853 LogLike[1286]=1862108.779417 LogLike[1287]=1862109.047028 LogLike[1288]=1862109.314719 LogLike[1289]=1862109.582524 LogLike[1290]=1862109.850514 LogLike[1291]=1862110.118718 LogLike[1292]=1862110.386807 LogLike[1293]=1862110.655275 LogLike[1294]=1862110.923778 LogLike[1295]=1862111.192525 LogLike[1296]=1862111.461537 LogLike[1297]=1862111.730708 LogLike[1298]=1862111.999978 LogLike[1299]=1862112.269160 LogLike[1300]=1862112.538537 LogLike[1301]=1862112.808158 LogLike[1302]=1862113.078022 LogLike[1303]=1862113.347909 LogLike[1304]=1862113.618125 LogLike[1305]=1862113.888433 LogLike[1306]=1862114.158896 LogLike[1307]=1862114.429675 LogLike[1308]=1862114.700525 LogLike[1309]=1862114.971636 LogLike[1310]=1862115.242934 LogLike[1311]=1862115.514309 LogLike[1312]=1862115.785800 LogLike[1313]=1862116.057589 LogLike[1314]=1862116.329531 LogLike[1315]=1862116.601854 LogLike[1316]=1862116.874185 LogLike[1317]=1862117.146842 LogLike[1318]=1862117.419807 LogLike[1319]=1862117.692680 LogLike[1320]=1862117.965862 LogLike[1321]=1862118.239156 LogLike[1322]=1862118.512895 LogLike[1323]=1862118.786834 LogLike[1324]=1862119.060926 LogLike[1325]=1862119.335197 LogLike[1326]=1862119.609822 LogLike[1327]=1862119.884858 LogLike[1328]=1862120.159875 LogLike[1329]=1862120.435174 LogLike[1330]=1862120.710565 LogLike[1331]=1862120.986113 LogLike[1332]=1862121.262213 LogLike[1333]=1862121.538481 LogLike[1334]=1862121.815074 LogLike[1335]=1862122.091713 LogLike[1336]=1862122.368706 LogLike[1337]=1862122.645942 LogLike[1338]=1862122.923311 LogLike[1339]=1862123.201002 LogLike[1340]=1862123.479068 LogLike[1341]=1862123.757225 LogLike[1342]=1862124.035963 LogLike[1343]=1862124.314798 LogLike[1344]=1862124.593870 LogLike[1345]=1862124.873286 LogLike[1346]=1862125.152767 LogLike[1347]=1862125.432731 LogLike[1348]=1862125.712882 LogLike[1349]=1862125.993400 LogLike[1350]=1862126.274173 LogLike[1351]=1862126.555103 LogLike[1352]=1862126.836598 LogLike[1353]=1862127.118265 LogLike[1354]=1862127.400131 LogLike[1355]=1862127.682598 LogLike[1356]=1862127.965089 LogLike[1357]=1862128.248064 LogLike[1358]=1862128.531263 LogLike[1359]=1862128.814918 LogLike[1360]=1862129.098904 LogLike[1361]=1862129.382924 LogLike[1362]=1862129.667324 LogLike[1363]=1862129.952197 LogLike[1364]=1862130.237207 LogLike[1365]=1862130.522782 LogLike[1366]=1862130.808369 LogLike[1367]=1862131.094602 LogLike[1368]=1862131.381292 LogLike[1369]=1862131.668166 LogLike[1370]=1862131.955415 LogLike[1371]=1862132.242969 LogLike[1372]=1862132.530825 LogLike[1373]=1862132.819081 LogLike[1374]=1862133.107828 LogLike[1375]=1862133.396846 LogLike[1376]=1862133.686239 LogLike[1377]=1862133.975838 LogLike[1378]=1862134.265947 LogLike[1379]=1862134.556526 LogLike[1380]=1862134.847487 LogLike[1381]=1862135.138757 LogLike[1382]=1862135.430509 LogLike[1383]=1862135.722658 LogLike[1384]=1862136.015032 LogLike[1385]=1862136.307854 LogLike[1386]=1862136.601232 LogLike[1387]=1862136.894867 LogLike[1388]=1862137.188893 LogLike[1389]=1862137.483430 LogLike[1390]=1862137.778289 LogLike[1391]=1862138.073811 LogLike[1392]=1862138.369631 LogLike[1393]=1862138.665892 LogLike[1394]=1862138.962512 LogLike[1395]=1862139.259666 LogLike[1396]=1862139.557115 LogLike[1397]=1862139.855073 LogLike[1398]=1862140.153467 LogLike[1399]=1862140.452269 LogLike[1400]=1862140.751567 LogLike[1401]=1862141.051356 LogLike[1402]=1862141.351450 LogLike[1403]=1862141.652248 LogLike[1404]=1862141.953311 LogLike[1405]=1862142.254899 LogLike[1406]=1862142.556705 LogLike[1407]=1862142.859272 LogLike[1408]=1862143.162220 LogLike[1409]=1862143.465778 LogLike[1410]=1862143.769580 LogLike[1411]=1862144.074091 LogLike[1412]=1862144.379040 LogLike[1413]=1862144.684482 LogLike[1414]=1862144.990503 LogLike[1415]=1862145.296786 LogLike[1416]=1862145.603643 LogLike[1417]=1862145.911055 LogLike[1418]=1862146.218934 LogLike[1419]=1862146.527209 LogLike[1420]=1862146.836077 LogLike[1421]=1862147.145386 LogLike[1422]=1862147.455260 LogLike[1423]=1862147.765767 LogLike[1424]=1862148.076788 LogLike[1425]=1862148.388216 LogLike[1426]=1862148.700472 LogLike[1427]=1862149.012958 LogLike[1428]=1862149.326067 LogLike[1429]=1862149.639821 LogLike[1430]=1862149.954202 LogLike[1431]=1862150.268907 LogLike[1432]=1862150.584270 LogLike[1433]=1862150.900134 LogLike[1434]=1862151.216633 LogLike[1435]=1862151.533672 LogLike[1436]=1862151.851417 LogLike[1437]=1862152.169581 LogLike[1438]=1862152.488437 LogLike[1439]=1862152.807746 LogLike[1440]=1862153.127801 LogLike[1441]=1862153.448382 LogLike[1442]=1862153.769628 LogLike[1443]=1862154.091473 LogLike[1444]=1862154.413650 LogLike[1445]=1862154.736543 LogLike[1446]=1862155.059938 LogLike[1447]=1862155.384085 LogLike[1448]=1862155.708715 LogLike[1449]=1862156.034000 LogLike[1450]=1862156.359717 LogLike[1451]=1862156.686352 LogLike[1452]=1862157.013541 LogLike[1453]=1862157.341320 LogLike[1454]=1862157.669817 LogLike[1455]=1862157.999020 LogLike[1456]=1862158.328688 LogLike[1457]=1862158.659186 LogLike[1458]=1862158.990157 LogLike[1459]=1862159.321712 LogLike[1460]=1862159.654017 LogLike[1461]=1862159.986841 LogLike[1462]=1862160.320311 LogLike[1463]=1862160.654563 LogLike[1464]=1862160.989429 LogLike[1465]=1862161.324858 LogLike[1466]=1862161.661027 LogLike[1467]=1862161.997881 LogLike[1468]=1862162.335413 LogLike[1469]=1862162.673519 LogLike[1470]=1862163.012363 LogLike[1471]=1862163.351855 LogLike[1472]=1862163.692105 LogLike[1473]=1862164.033161 LogLike[1474]=1862164.374790 LogLike[1475]=1862164.717088 LogLike[1476]=1862165.060186 LogLike[1477]=1862165.403948 LogLike[1478]=1862165.748260 LogLike[1479]=1862166.093387 LogLike[1480]=1862166.439288 LogLike[1481]=1862166.785988 LogLike[1482]=1862167.133353 LogLike[1483]=1862167.481318 LogLike[1484]=1862167.830024 LogLike[1485]=1862168.179686 LogLike[1486]=1862168.529878 LogLike[1487]=1862168.880885 LogLike[1488]=1862169.232411 LogLike[1489]=1862169.584682 LogLike[1490]=1862169.937830 LogLike[1491]=1862170.291860 LogLike[1492]=1862170.646542 LogLike[1493]=1862171.001734 LogLike[1494]=1862171.357780 LogLike[1495]=1862171.714646 LogLike[1496]=1862172.072173 LogLike[1497]=1862172.430602 LogLike[1498]=1862172.789762 LogLike[1499]=1862173.149430 LogLike[1500]=1862173.510053 LogLike[1501]=1862173.871553 LogLike[1502]=1862174.233614 LogLike[1503]=1862174.596444 LogLike[1504]=1862174.960178 LogLike[1505]=1862175.324620 LogLike[1506]=1862175.689870 LogLike[1507]=1862176.055899 LogLike[1508]=1862176.422767 LogLike[1509]=1862176.790360 LogLike[1510]=1862177.158879 LogLike[1511]=1862177.528189 LogLike[1512]=1862177.898153 LogLike[1513]=1862178.268963 LogLike[1514]=1862178.640551 LogLike[1515]=1862179.012819 LogLike[1516]=1862179.386085 LogLike[1517]=1862179.760039 LogLike[1518]=1862180.134967 LogLike[1519]=1862180.510570 LogLike[1520]=1862180.887040 LogLike[1521]=1862181.264219 LogLike[1522]=1862181.642247 LogLike[1523]=1862182.021178 LogLike[1524]=1862182.400913 LogLike[1525]=1862182.781430 LogLike[1526]=1862183.162679 LogLike[1527]=1862183.544731 LogLike[1528]=1862183.927567 LogLike[1529]=1862184.311551 LogLike[1530]=1862184.696217 LogLike[1531]=1862185.081717 LogLike[1532]=1862185.468006 LogLike[1533]=1862185.855369 LogLike[1534]=1862186.243474 LogLike[1535]=1862186.632423 LogLike[1536]=1862187.022066 LogLike[1537]=1862187.412551 LogLike[1538]=1862187.803973 LogLike[1539]=1862188.196281 LogLike[1540]=1862188.589528 LogLike[1541]=1862188.983480 LogLike[1542]=1862189.378214 LogLike[1543]=1862189.773576 LogLike[1544]=1862190.170000 LogLike[1545]=1862190.567332 LogLike[1546]=1862190.965510 LogLike[1547]=1862191.364598 LogLike[1548]=1862191.764477 LogLike[1549]=1862192.165261 LogLike[1550]=1862192.566906 LogLike[1551]=1862192.969377 LogLike[1552]=1862193.372557 LogLike[1553]=1862193.776840 LogLike[1554]=1862194.181925 LogLike[1555]=1862194.587962 LogLike[1556]=1862194.994849 LogLike[1557]=1862195.402463 LogLike[1558]=1862195.810918 LogLike[1559]=1862196.220287 LogLike[1560]=1862196.630693 LogLike[1561]=1862197.041745 LogLike[1562]=1862197.453638 LogLike[1563]=1862197.866482 LogLike[1564]=1862198.280172 LogLike[1565]=1862198.694799 LogLike[1566]=1862199.110258 LogLike[1567]=1862199.526687 LogLike[1568]=1862199.943996 LogLike[1569]=1862200.362207 LogLike[1570]=1862200.781247 LogLike[1571]=1862201.201236 LogLike[1572]=1862201.621963 LogLike[1573]=1862202.043618 LogLike[1574]=1862202.466243 LogLike[1575]=1862202.889793 LogLike[1576]=1862203.314074 LogLike[1577]=1862203.739224 LogLike[1578]=1862204.165420 LogLike[1579]=1862204.592382 LogLike[1580]=1862205.020031 LogLike[1581]=1862205.448870 LogLike[1582]=1862205.878423 LogLike[1583]=1862206.308792 LogLike[1584]=1862206.740171 LogLike[1585]=1862207.172379 LogLike[1586]=1862207.605416 LogLike[1587]=1862208.039489 LogLike[1588]=1862208.474381 LogLike[1589]=1862208.910105 LogLike[1590]=1862209.346678 LogLike[1591]=1862209.784133 LogLike[1592]=1862210.222609 LogLike[1593]=1862210.661932 LogLike[1594]=1862211.101936 LogLike[1595]=1862211.543110 LogLike[1596]=1862211.984978 LogLike[1597]=1862212.427961 LogLike[1598]=1862212.871747 LogLike[1599]=1862213.316259 LogLike[1600]=1862213.761658 LogLike[1601]=1862214.207942 LogLike[1602]=1862214.655122 LogLike[1603]=1862215.103057 LogLike[1604]=1862215.551849 LogLike[1605]=1862216.001729 LogLike[1606]=1862216.452456 LogLike[1607]=1862216.903881 LogLike[1608]=1862217.356417 LogLike[1609]=1862217.809653 LogLike[1610]=1862218.263921 LogLike[1611]=1862218.718878 LogLike[1612]=1862219.174818 LogLike[1613]=1862219.631532 LogLike[1614]=1862220.089250 LogLike[1615]=1862220.547789 LogLike[1616]=1862221.007181 LogLike[1617]=1862221.467292 LogLike[1618]=1862221.928467 LogLike[1619]=1862222.390370 LogLike[1620]=1862222.853043 LogLike[1621]=1862223.316535 LogLike[1622]=1862223.780998 LogLike[1623]=1862224.246206 LogLike[1624]=1862224.712506 LogLike[1625]=1862225.179579 LogLike[1626]=1862225.647510 LogLike[1627]=1862226.116234 LogLike[1628]=1862226.585782 LogLike[1629]=1862227.056178 LogLike[1630]=1862227.527369 LogLike[1631]=1862227.999582 LogLike[1632]=1862228.472521 LogLike[1633]=1862228.946436 LogLike[1634]=1862229.421185 LogLike[1635]=1862229.896651 LogLike[1636]=1862230.372830 LogLike[1637]=1862230.849958 LogLike[1638]=1862231.327897 LogLike[1639]=1862231.806680 LogLike[1640]=1862232.286312 LogLike[1641]=1862232.766646 LogLike[1642]=1862233.247933 LogLike[1643]=1862233.729937 LogLike[1644]=1862234.212913 LogLike[1645]=1862234.696737 LogLike[1646]=1862235.181249 LogLike[1647]=1862235.666628 LogLike[1648]=1862236.152707 LogLike[1649]=1862236.639667 LogLike[1650]=1862237.127401 LogLike[1651]=1862237.615979 LogLike[1652]=1862238.105312 LogLike[1653]=1862238.595593 LogLike[1654]=1862239.086501 LogLike[1655]=1862239.578200 LogLike[1656]=1862240.070624 LogLike[1657]=1862240.564073 LogLike[1658]=1862241.058127 LogLike[1659]=1862241.552901 LogLike[1660]=1862242.048677 LogLike[1661]=1862242.545119 LogLike[1662]=1862243.042390 LogLike[1663]=1862243.540322 LogLike[1664]=1862244.039094 LogLike[1665]=1862244.538731 LogLike[1666]=1862245.039161 LogLike[1667]=1862245.540304 LogLike[1668]=1862246.042341 LogLike[1669]=1862246.544946 LogLike[1670]=1862247.048323 LogLike[1671]=1862247.552544 LogLike[1672]=1862248.057403 LogLike[1673]=1862248.563038 LogLike[1674]=1862249.069476 LogLike[1675]=1862249.576689 LogLike[1676]=1862250.084567 LogLike[1677]=1862250.593402 LogLike[1678]=1862251.102894 LogLike[1679]=1862251.612948 LogLike[1680]=1862252.123744 LogLike[1681]=1862252.635305 LogLike[1682]=1862253.147713 LogLike[1683]=1862253.660889 LogLike[1684]=1862254.174818 LogLike[1685]=1862254.689534 LogLike[1686]=1862255.204797 LogLike[1687]=1862255.720866 LogLike[1688]=1862256.237416 LogLike[1689]=1862256.754839 LogLike[1690]=1862257.273169 LogLike[1691]=1862257.792065 LogLike[1692]=1862258.311656 LogLike[1693]=1862258.831784 LogLike[1694]=1862259.352675 LogLike[1695]=1862259.874189 LogLike[1696]=1862260.396597 LogLike[1697]=1862260.919566 LogLike[1698]=1862261.443237 LogLike[1699]=1862261.967544 LogLike[1700]=1862262.492534 LogLike[1701]=1862263.018267 LogLike[1702]=1862263.544739 LogLike[1703]=1862264.071762 LogLike[1704]=1862264.599520 LogLike[1705]=1862265.128012 LogLike[1706]=1862265.657139 LogLike[1707]=1862266.187003 LogLike[1708]=1862266.717436 LogLike[1709]=1862267.248503 LogLike[1710]=1862267.780207 LogLike[1711]=1862268.312575 LogLike[1712]=1862268.845540 LogLike[1713]=1862269.379211 LogLike[1714]=1862269.913521 LogLike[1715]=1862270.448442 LogLike[1716]=1862270.984051 LogLike[1717]=1862271.520183 LogLike[1718]=1862272.056948 LogLike[1719]=1862272.594271 LogLike[1720]=1862273.132294 LogLike[1721]=1862273.671058 LogLike[1722]=1862274.210428 LogLike[1723]=1862274.750279 LogLike[1724]=1862275.290811 LogLike[1725]=1862275.832010 LogLike[1726]=1862276.373568 LogLike[1727]=1862276.915921 LogLike[1728]=1862277.458724 LogLike[1729]=1862278.002217 LogLike[1730]=1862278.546283 LogLike[1731]=1862279.090910 LogLike[1732]=1862279.636293 LogLike[1733]=1862280.182175 LogLike[1734]=1862280.728642 LogLike[1735]=1862281.275706 LogLike[1736]=1862281.823265 LogLike[1737]=1862282.371526 LogLike[1738]=1862282.920354 LogLike[1739]=1862283.469576 LogLike[1740]=1862284.019350 LogLike[1741]=1862284.569788 LogLike[1742]=1862285.120855 LogLike[1743]=1862285.672417 LogLike[1744]=1862286.224625 LogLike[1745]=1862286.777269 LogLike[1746]=1862287.330445 LogLike[1747]=1862287.884103 LogLike[1748]=1862288.438320 LogLike[1749]=1862288.993019 LogLike[1750]=1862289.548192 LogLike[1751]=1862290.103947 LogLike[1752]=1862290.660419 LogLike[1753]=1862291.217295 LogLike[1754]=1862291.774542 LogLike[1755]=1862292.332498 LogLike[1756]=1862292.890856 LogLike[1757]=1862293.449742 LogLike[1758]=1862294.009110 LogLike[1759]=1862294.569044 LogLike[1760]=1862295.129423 LogLike[1761]=1862295.690347 LogLike[1762]=1862296.251753 LogLike[1763]=1862296.813660 LogLike[1764]=1862297.376009 LogLike[1765]=1862297.938941 LogLike[1766]=1862298.502097 LogLike[1767]=1862299.065936 LogLike[1768]=1862299.630301 LogLike[1769]=1862300.195037 LogLike[1770]=1862300.760302 LogLike[1771]=1862301.325975 LogLike[1772]=1862301.892137 LogLike[1773]=1862302.458779 LogLike[1774]=1862303.025823 LogLike[1775]=1862303.593353 LogLike[1776]=1862304.161408 LogLike[1777]=1862304.729914 LogLike[1778]=1862305.298799 LogLike[1779]=1862305.868187 LogLike[1780]=1862306.438070 LogLike[1781]=1862307.008382 LogLike[1782]=1862307.579018 LogLike[1783]=1862308.150215 LogLike[1784]=1862308.721718 LogLike[1785]=1862309.293817 LogLike[1786]=1862309.866277 LogLike[1787]=1862310.439102 LogLike[1788]=1862311.012413 LogLike[1789]=1862311.586013 LogLike[1790]=1862312.160092 LogLike[1791]=1862312.734628 LogLike[1792]=1862313.309594 LogLike[1793]=1862313.885105 LogLike[1794]=1862314.460994 LogLike[1795]=1862315.037237 LogLike[1796]=1862315.613902 LogLike[1797]=1862316.190872 LogLike[1798]=1862316.768288 LogLike[1799]=1862317.346098 LogLike[1800]=1862317.924423 LogLike[1801]=1862318.503180 LogLike[1802]=1862319.082310 LogLike[1803]=1862319.661795 LogLike[1804]=1862320.241756 LogLike[1805]=1862320.821988 LogLike[1806]=1862321.402607 LogLike[1807]=1862321.983766 LogLike[1808]=1862322.565314 LogLike[1809]=1862323.147273 LogLike[1810]=1862323.729549 LogLike[1811]=1862324.312231 LogLike[1812]=1862324.895412 LogLike[1813]=1862325.479053 LogLike[1814]=1862326.063039 LogLike[1815]=1862326.647401 LogLike[1816]=1862327.232133 LogLike[1817]=1862327.817327 LogLike[1818]=1862328.402897 LogLike[1819]=1862328.988797 LogLike[1820]=1862329.575291 LogLike[1821]=1862330.162054 LogLike[1822]=1862330.749239 LogLike[1823]=1862331.336765 LogLike[1824]=1862331.924836 LogLike[1825]=1862332.513383 LogLike[1826]=1862333.102313 LogLike[1827]=1862333.691625 LogLike[1828]=1862334.281301 LogLike[1829]=1862334.871485 LogLike[1830]=1862335.462012 LogLike[1831]=1862336.052974 LogLike[1832]=1862336.644470 LogLike[1833]=1862337.236293 LogLike[1834]=1862337.828592 LogLike[1835]=1862338.421511 LogLike[1836]=1862339.014862 LogLike[1837]=1862339.608596 LogLike[1838]=1862340.202827 LogLike[1839]=1862340.797542 LogLike[1840]=1862341.392666 LogLike[1841]=1862341.988353 LogLike[1842]=1862342.584658 LogLike[1843]=1862343.181424 LogLike[1844]=1862343.778781 LogLike[1845]=1862344.376612 LogLike[1846]=1862344.975040 LogLike[1847]=1862345.573904 LogLike[1848]=1862346.173423 LogLike[1849]=1862346.773473 LogLike[1850]=1862347.374014 LogLike[1851]=1862347.975150 LogLike[1852]=1862348.576943 LogLike[1853]=1862349.179381 LogLike[1854]=1862349.782380 LogLike[1855]=1862350.386074 LogLike[1856]=1862350.990577 LogLike[1857]=1862351.595574 LogLike[1858]=1862352.201346 LogLike[1859]=1862352.807815 LogLike[1860]=1862353.414924 LogLike[1861]=1862354.022876 LogLike[1862]=1862354.631666 LogLike[1863]=1862355.241160 LogLike[1864]=1862355.851398 LogLike[1865]=1862356.462566 LogLike[1866]=1862357.074581 LogLike[1867]=1862357.687413 LogLike[1868]=1862358.301068 LogLike[1869]=1862358.915710 LogLike[1870]=1862359.531346 LogLike[1871]=1862360.147897 LogLike[1872]=1862360.765471 LogLike[1873]=1862361.383977 LogLike[1874]=1862362.003657 LogLike[1875]=1862362.624374 LogLike[1876]=1862363.246113 LogLike[1877]=1862363.869117 LogLike[1878]=1862364.493329 LogLike[1879]=1862365.118777 LogLike[1880]=1862365.745521 LogLike[1881]=1862366.373484 LogLike[1882]=1862367.002924 LogLike[1883]=1862367.633753 LogLike[1884]=1862368.265979 LogLike[1885]=1862368.899627 LogLike[1886]=1862369.534745 LogLike[1887]=1862370.171613 LogLike[1888]=1862370.809997 LogLike[1889]=1862371.450232 LogLike[1890]=1862372.091907 LogLike[1891]=1862372.735412 LogLike[1892]=1862373.380924 LogLike[1893]=1862374.028350 LogLike[1894]=1862374.677579 LogLike[1895]=1862375.328949 LogLike[1896]=1862375.982374 LogLike[1897]=1862376.638078 LogLike[1898]=1862377.295928 LogLike[1899]=1862377.956138 LogLike[1900]=1862378.618715 LogLike[1901]=1862379.283759 LogLike[1902]=1862379.951290 LogLike[1903]=1862380.621478 LogLike[1904]=1862381.294475 LogLike[1905]=1862381.970254 LogLike[1906]=1862382.649008 LogLike[1907]=1862383.330800 LogLike[1908]=1862384.015766 LogLike[1909]=1862384.703906 LogLike[1910]=1862385.395545 LogLike[1911]=1862386.090626 LogLike[1912]=1862386.789333 LogLike[1913]=1862387.491755 LogLike[1914]=1862388.198104 LogLike[1915]=1862388.908409 LogLike[1916]=1862389.622755 LogLike[1917]=1862390.341493 LogLike[1918]=1862391.064592 LogLike[1919]=1862391.792410 LogLike[1920]=1862392.525033 LogLike[1921]=1862393.262715 LogLike[1922]=1862394.005478 LogLike[1923]=1862394.753629 LogLike[1924]=1862395.507305 LogLike[1925]=1862396.266773 LogLike[1926]=1862397.032163 LogLike[1927]=1862397.803740 LogLike[1928]=1862398.581733 LogLike[1929]=1862399.366511 LogLike[1930]=1862400.158148 LogLike[1931]=1862400.957146 LogLike[1932]=1862401.763577 LogLike[1933]=1862402.577785 LogLike[1934]=1862403.400038 LogLike[1935]=1862404.230815 LogLike[1936]=1862405.070458 LogLike[1937]=1862405.919294 LogLike[1938]=1862406.777564 LogLike[1939]=1862407.645738 LogLike[1940]=1862408.524231 LogLike[1941]=1862409.413402 LogLike[1942]=1862410.313945 LogLike[1943]=1862411.226220 LogLike[1944]=1862412.150775 LogLike[1945]=1862413.087982 LogLike[1946]=1862414.038511 LogLike[1947]=1862415.002953 LogLike[1948]=1862415.981899 LogLike[1949]=1862416.976024 LogLike[1950]=1862417.986183 LogLike[1951]=1862419.012872 LogLike[1952]=1862420.057038 LogLike[1953]=1862421.119438 LogLike[1954]=1862422.200963 LogLike[1955]=1862423.302539 LogLike[1956]=1862424.425223 LogLike[1957]=1862425.569971 LogLike[1958]=1862426.737959 LogLike[1959]=1862427.930353 LogLike[1960]=1862429.148345 LogLike[1961]=1862430.393454 LogLike[1962]=1862431.667017 LogLike[1963]=1862432.970608 LogLike[1964]=1862434.305807 LogLike[1965]=1862435.674598 LogLike[1966]=1862437.078479 LogLike[1967]=1862438.519725 LogLike[1968]=1862440.000441 LogLike[1969]=1862441.523076 LogLike[1970]=1862443.090192 LogLike[1971]=1862444.704413 LogLike[1972]=1862446.368571 LogLike[1973]=1862448.085928 LogLike[1974]=1862449.859812 LogLike[1975]=1862451.694087 LogLike[1976]=1862453.592619 LogLike[1977]=1862455.559625 LogLike[1978]=1862457.600177 LogLike[1979]=1862459.719115 LogLike[1980]=1862461.922180 LogLike[1981]=1862464.215199 LogLike[1982]=1862466.604925 LogLike[1983]=1862469.098580 LogLike[1984]=1862471.703967 LogLike[1985]=1862474.429572 LogLike[1986]=1862477.285011 LogLike[1987]=1862480.280334 LogLike[1988]=1862483.426971 LogLike[1989]=1862486.737056 LogLike[1990]=1862490.223792 LogLike[1991]=1862493.902014 LogLike[1992]=1862497.787671 LogLike[1993]=1862501.897929 LogLike[1994]=1862506.251721 LogLike[1995]=1862510.869115 LogLike[1996]=1862515.772368 LogLike[1997]=1862520.984742 LogLike[1998]=1862526.531189 LogLike[1999]=1862532.438022 .. GENERATED FROM PYTHON SOURCE LINES 150-152 Plot log likelihood vs iteration number ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ .. GENERATED FROM PYTHON SOURCE LINES 152-164 .. code-block:: default N = len(optim_res["log_like"]) iter_no = np.arange(0, N) fig = go.Figure() trace = go.Scatter(x=iter_no, y=optim_res["log_like"], mode="lines+markers") fig.add_trace(trace) fig.update_layout(xaxis=dict(title="Iteration Number"), yaxis=dict(title="Lower Bound")) fig .. raw:: html


.. GENERATED FROM PYTHON SOURCE LINES 165-167 Kalman filtering ^^^^^^^^^^^^^^^^ .. GENERATED FROM PYTHON SOURCE LINES 167-172 .. code-block:: default filter_res = ssm.inference.filterLDS_SS_withMissingValues_np( y=transformed_binned_spikes, B=optim_res["B"], Q=optim_res["Q"], m0=optim_res["m0"], V0=optim_res["V0"], Z=optim_res["Z"], R=optim_res["R"]) .. GENERATED FROM PYTHON SOURCE LINES 173-175 Kalman smoothing ^^^^^^^^^^^^^^^^ .. GENERATED FROM PYTHON SOURCE LINES 175-181 .. code-block:: default smoothing_res = ssm.inference.smoothLDS_SS( B=optim_res["B"], xnn=filter_res["xnn"], Pnn=filter_res["Pnn"], xnn1=filter_res["xnn1"], Pnn1=filter_res["Pnn1"], m0=optim_res["m0"], V0=optim_res["V0"]) .. GENERATED FROM PYTHON SOURCE LINES 182-184 Plot smoothed states ^^^^^^^^^^^^^^^^^^^^ .. GENERATED FROM PYTHON SOURCE LINES 184-202 .. code-block:: default o_means_to_plot, o_covs_to_plot = ssm.neural_latents.utils.ortogonalizeMeansAndCovs( means=smoothing_res["xnN"][:, :, to_plot_slice], covs=smoothing_res["PnN"][:, :, to_plot_slice], Z=optim_res["Z"]) fig = ssm.neural_latents.plotting.plot_latents( means=o_means_to_plot, covs=o_covs_to_plot, bin_centers=bin_centers_to_plot, trials_df=trials_df, events_names=events_names, events_linetypes=events_linetypes, events_colors=events_colors_latents, cb_alpha=cb_alpha, legend_pattern="smoothing_{:d}", ) fig .. raw:: html


.. rst-class:: sphx-glr-timing **Total running time of the script:** ( 898 minutes 35.168 seconds) .. _sphx_glr_download_auto_examples_neuralLatents_plot_MC_MAZE_SMALL.py: .. only:: html .. container:: sphx-glr-footer sphx-glr-footer-example .. container:: binder-badge .. image:: images/binder_badge_logo.svg :target: https://mybinder.org/v2/gh/joacorapela/lds_python/gh-pages?filepath=notebooks/auto_examples/neuralLatents/plot_MC_MAZE_SMALL.ipynb :alt: Launch binder :width: 150 px .. container:: sphx-glr-download sphx-glr-download-python :download:`Download Python source code: plot_MC_MAZE_SMALL.py ` .. container:: sphx-glr-download sphx-glr-download-jupyter :download:`Download Jupyter notebook: plot_MC_MAZE_SMALL.ipynb ` .. only:: html .. rst-class:: sphx-glr-signature `Gallery generated by Sphinx-Gallery `_