Identifiable Representation and Model Learning for Latent Dynamic Systems

Learning identifiable representations and models from low-level observations is helpful for an intelligent spacecraft to complete downstream tasks reliably. For temporal observations, to ensure that the data generating process is provably inverted, most existing works either assume that the noise va...

Full description

Saved in:
Bibliographic Details
Main Authors: Congxi Zhang, Yongchun Xie
Format: Article
Language:English
Published: American Association for the Advancement of Science (AAAS) 2025-01-01
Series:Space: Science & Technology
Online Access:https://spj.science.org/doi/10.34133/space.0267
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1839646397254598656
author Congxi Zhang
Yongchun Xie
author_facet Congxi Zhang
Yongchun Xie
author_sort Congxi Zhang
collection DOAJ
description Learning identifiable representations and models from low-level observations is helpful for an intelligent spacecraft to complete downstream tasks reliably. For temporal observations, to ensure that the data generating process is provably inverted, most existing works either assume that the noise variables in the dynamic mechanisms are (conditionally) independent or require that the interventions can directly affect each latent variable. However, in practice, the relationship between the exogenous inputs/interventions and the latent variables may follow some complex deterministic mechanisms. In this work, we study the problem of identifiable representation and model learning for latent dynamic systems. The key idea is to use an inductive bias inspired by controllable canonical forms, which are sparse and input-dependent by definition. We prove that, for linear and affine nonlinear latent dynamic systems with sparse input matrices, it is possible to identify the latent variables up to scaling and determine the dynamic models up to some simple transformations. The results have the potential to provide some theoretical guarantees for developing more trustworthy decision-making and control methods for intelligent spacecrafts.
format Article
id doaj-art-ea2cfa7ecdf340c28f57e521e1665d3d
institution Matheson Library
issn 2692-7659
language English
publishDate 2025-01-01
publisher American Association for the Advancement of Science (AAAS)
record_format Article
series Space: Science & Technology
spelling doaj-art-ea2cfa7ecdf340c28f57e521e1665d3d2025-06-30T16:56:54ZengAmerican Association for the Advancement of Science (AAAS)Space: Science & Technology2692-76592025-01-01510.34133/space.0267Identifiable Representation and Model Learning for Latent Dynamic SystemsCongxi Zhang0Yongchun Xie1Beijing Institute of Control Engineering, Beijing, P. R. China.Beijing Institute of Control Engineering, Beijing, P. R. China.Learning identifiable representations and models from low-level observations is helpful for an intelligent spacecraft to complete downstream tasks reliably. For temporal observations, to ensure that the data generating process is provably inverted, most existing works either assume that the noise variables in the dynamic mechanisms are (conditionally) independent or require that the interventions can directly affect each latent variable. However, in practice, the relationship between the exogenous inputs/interventions and the latent variables may follow some complex deterministic mechanisms. In this work, we study the problem of identifiable representation and model learning for latent dynamic systems. The key idea is to use an inductive bias inspired by controllable canonical forms, which are sparse and input-dependent by definition. We prove that, for linear and affine nonlinear latent dynamic systems with sparse input matrices, it is possible to identify the latent variables up to scaling and determine the dynamic models up to some simple transformations. The results have the potential to provide some theoretical guarantees for developing more trustworthy decision-making and control methods for intelligent spacecrafts.https://spj.science.org/doi/10.34133/space.0267
spellingShingle Congxi Zhang
Yongchun Xie
Identifiable Representation and Model Learning for Latent Dynamic Systems
Space: Science & Technology
title Identifiable Representation and Model Learning for Latent Dynamic Systems
title_full Identifiable Representation and Model Learning for Latent Dynamic Systems
title_fullStr Identifiable Representation and Model Learning for Latent Dynamic Systems
title_full_unstemmed Identifiable Representation and Model Learning for Latent Dynamic Systems
title_short Identifiable Representation and Model Learning for Latent Dynamic Systems
title_sort identifiable representation and model learning for latent dynamic systems
url https://spj.science.org/doi/10.34133/space.0267
work_keys_str_mv AT congxizhang identifiablerepresentationandmodellearningforlatentdynamicsystems
AT yongchunxie identifiablerepresentationandmodellearningforlatentdynamicsystems