Linear-Gaussian ELBO Ablation
Source artifact rendered for reading.
| Steps | MC samples | Seeds | filter KL | edge KL | state RMSE | state NLL |
|---|---|---|---|---|---|---|
| 250 | 1 | 5 | 0.204475 +/- 0.026362 | 0.804616 +/- 0.069668 | 0.449553 +/- 0.002821 | 0.607539 +/- 0.026580 |
| 250 | 4 | 5 | 0.198774 +/- 0.027052 | 0.769202 +/- 0.072202 | 0.448925 +/- 0.002732 | 0.601943 +/- 0.026751 |
| 250 | 8 | 5 | 0.195375 +/- 0.026457 | 0.753137 +/- 0.070108 | 0.448535 +/- 0.002657 | 0.598567 +/- 0.026163 |
| 250 | 16 | 5 | 0.192327 +/- 0.026590 | 0.738557 +/- 0.072104 | 0.448172 +/- 0.002652 | 0.595544 +/- 0.026187 |
| 250 | 32 | 5 | 0.189909 +/- 0.026688 | 0.726516 +/- 0.072154 | 0.447866 +/- 0.002595 | 0.593159 +/- 0.026136 |
| 1000 | 1 | 5 | 0.172575 +/- 0.018729 | 0.496918 +/- 0.060188 | 0.442066 +/- 0.002878 | 0.575477 +/- 0.017847 |
| 1000 | 4 | 5 | 0.154388 +/- 0.016666 | 0.447803 +/- 0.047658 | 0.439322 +/- 0.002896 | 0.557245 +/- 0.016674 |
| 1000 | 8 | 5 | 0.147975 +/- 0.019769 | 0.437122 +/- 0.061967 | 0.438186 +/- 0.003349 | 0.550803 +/- 0.021862 |
| 1000 | 16 | 5 | 0.141261 +/- 0.019490 | 0.419709 +/- 0.055556 | 0.436941 +/- 0.003271 | 0.544201 +/- 0.021810 |
| 1000 | 32 | 5 | 0.139600 +/- 0.020257 | 0.416881 +/- 0.043102 | 0.436199 +/- 0.003547 | 0.542554 +/- 0.023419 |
Oracle Reference
| Model | Seeds | state RMSE | state NLL |
|---|---|---|---|
| exact Kalman | 5 | 0.522426 +/- 0.003409 | 0.401983 +/- 0.003410 |
Per-Seed Rows
| Seed | Steps | MC samples | filter KL | edge KL | state RMSE | state NLL |
|---|---|---|---|---|---|---|
| 321 | 250 | 1 | 0.186411 | 0.789765 | 0.450123 | 0.598636 |
| 322 | 250 | 1 | 0.220401 | 0.822594 | 0.450064 | 0.623493 |
| 323 | 250 | 1 | 0.230063 | 0.823965 | 0.454128 | 0.637144 |
| 324 | 250 | 1 | 0.161404 | 0.685914 | 0.445656 | 0.560484 |
| 325 | 250 | 1 | 0.224095 | 0.900845 | 0.447794 | 0.617937 |
| 321 | 250 | 4 | 0.177005 | 0.729722 | 0.449156 | 0.589527 |
| 322 | 250 | 4 | 0.214309 | 0.792886 | 0.449399 | 0.617405 |
| 323 | 250 | 4 | 0.224686 | 0.790928 | 0.453366 | 0.631796 |
| 324 | 250 | 4 | 0.156694 | 0.657939 | 0.444925 | 0.555893 |
| 325 | 250 | 4 | 0.221175 | 0.874534 | 0.447779 | 0.615094 |
| 321 | 250 | 8 | 0.173543 | 0.711016 | 0.448767 | 0.586042 |
| 322 | 250 | 8 | 0.211985 | 0.780051 | 0.449083 | 0.615101 |
| 323 | 250 | 8 | 0.220102 | 0.775175 | 0.452827 | 0.627253 |
| 324 | 250 | 8 | 0.154432 | 0.645876 | 0.444646 | 0.553629 |
| 325 | 250 | 8 | 0.216813 | 0.853568 | 0.447350 | 0.610811 |
| 321 | 250 | 16 | 0.169896 | 0.692561 | 0.448305 | 0.582392 |
| 322 | 250 | 16 | 0.209087 | 0.762745 | 0.448810 | 0.612242 |
| 323 | 250 | 16 | 0.216300 | 0.759417 | 0.452376 | 0.623547 |
| 324 | 250 | 16 | 0.151483 | 0.632122 | 0.444150 | 0.550656 |
| 325 | 250 | 16 | 0.214867 | 0.845939 | 0.447221 | 0.608885 |
| 321 | 250 | 32 | 0.165779 | 0.671062 | 0.447771 | 0.578311 |
| 322 | 250 | 32 | 0.206930 | 0.752735 | 0.448505 | 0.610082 |
| 323 | 250 | 32 | 0.214195 | 0.750093 | 0.452082 | 0.621485 |
| 324 | 250 | 32 | 0.150080 | 0.625190 | 0.444048 | 0.549288 |
| 325 | 250 | 32 | 0.212562 | 0.833501 | 0.446923 | 0.606630 |
| 321 | 1000 | 1 | 0.155479 | 0.449957 | 0.439732 | 0.567435 |
| 322 | 1000 | 1 | 0.158907 | 0.456107 | 0.439973 | 0.561619 |
| 323 | 1000 | 1 | 0.198791 | 0.573167 | 0.447609 | 0.605952 |
| 324 | 1000 | 1 | 0.157861 | 0.438020 | 0.441839 | 0.557582 |
| 325 | 1000 | 1 | 0.191839 | 0.567340 | 0.441176 | 0.584799 |
| 321 | 1000 | 4 | 0.133284 | 0.384125 | 0.436663 | 0.544956 |
| 322 | 1000 | 4 | 0.146685 | 0.450398 | 0.437870 | 0.549239 |
| 323 | 1000 | 4 | 0.182631 | 0.517652 | 0.444722 | 0.590097 |
| 324 | 1000 | 4 | 0.148107 | 0.408942 | 0.439853 | 0.548055 |
| 325 | 1000 | 4 | 0.161236 | 0.477899 | 0.437502 | 0.553877 |
| 321 | 1000 | 8 | 0.130446 | 0.374330 | 0.435771 | 0.542057 |
| 322 | 1000 | 8 | 0.138744 | 0.439520 | 0.436877 | 0.541424 |
| 323 | 1000 | 8 | 0.186586 | 0.552289 | 0.444360 | 0.594080 |
| 324 | 1000 | 8 | 0.142588 | 0.394127 | 0.438886 | 0.542479 |
| 325 | 1000 | 8 | 0.141511 | 0.425341 | 0.435036 | 0.533977 |
| 321 | 1000 | 16 | 0.127362 | 0.365832 | 0.435149 | 0.538941 |
| 322 | 1000 | 16 | 0.125316 | 0.412190 | 0.434702 | 0.528060 |
| 323 | 1000 | 16 | 0.178802 | 0.525496 | 0.442818 | 0.586574 |
| 324 | 1000 | 16 | 0.139953 | 0.385333 | 0.438142 | 0.539838 |
| 325 | 1000 | 16 | 0.134871 | 0.409694 | 0.433895 | 0.527594 |
| 321 | 1000 | 32 | 0.132896 | 0.378686 | 0.435491 | 0.544207 |
| 322 | 1000 | 32 | 0.116860 | 0.390839 | 0.433091 | 0.519689 |
| 323 | 1000 | 32 | 0.176472 | 0.497737 | 0.442336 | 0.584627 |
| 324 | 1000 | 32 | 0.143047 | 0.424005 | 0.437528 | 0.542825 |
| 325 | 1000 | 32 | 0.128726 | 0.393140 | 0.432551 | 0.521424 |