isaaclab_contrib.deformable#
Sub-package for externally contributed assets.
This package contains contributed code that depends on Isaac Lab’s public API but is not required for core functionality. This includes implementations of Newton solvers for deformables.
Classes
A deformable object asset class (Newton backend). |
|
Data container for a deformable object (Newton backend). |
|
Global Newton model parameters applied after builder finalization. |
|
Base for solver configs whose manager applies |
|
Configuration for the Vertex Block Descent (VBD) solver. |
|
Configuration for the coupled MJWarp + VBD solver. |
|
Configuration for the coupled Featherstone + VBD solver. |
|
|
|
|
|
|
|
Deformable Object#
- class isaaclab_contrib.deformable.deformable_object.DeformableObject[source]#
Bases:
BaseDeformableObjectA deformable object asset class (Newton backend).
This class manages cloth/deformable bodies in the Newton physics engine. Newton stores all particles in flat arrays (
state.particle_q,state.particle_qd). This class builds a per-instance indexing layer on top of those flat arrays, enabling the standardBaseDeformableObjectinterface for reading/writing nodal state.The cloth mesh is added to the Newton
ModelBuilderduring theMODEL_INITphase. The mesh data is read from the USD prim atcfg.prim_path, and cloth simulation parameters (density, stiffness, etc.) come fromDeformableObjectCfg.Attributes:
Configuration instance for the deformable object.
Data container for the deformable object.
Number of instances of the asset.
Number of bodies in the asset.
The maximum number of simulation mesh vertices per deformable body.
Memory device for computation.
Whether the asset has a debug visualization implemented.
Whether the asset is initialized.
Methods:
__init__(cfg)Initialize the deformable object.
reset([env_ids, env_mask])Reset the deformable object.
Apply kinematic targets to the Newton simulation.
update(dt)Update the internal buffers.
write_nodal_pos_to_sim_index(nodal_pos[, ...])Set the nodal positions over selected environment indices into the simulation.
write_nodal_velocity_to_sim_index(nodal_vel)Set the nodal velocity over selected environment indices into the simulation.
Set the kinematic targets of the simulation mesh for the deformable bodies.
write_nodal_state_to_sim_mask(nodal_state[, ...])Set the nodal state over selected environment mask into the simulation.
write_nodal_pos_to_sim_mask(nodal_pos[, ...])Set the nodal positions over selected environment mask into the simulation.
write_nodal_velocity_to_sim_mask(nodal_vel)Set the nodal velocity over selected environment mask into the simulation.
Set the kinematic targets over selected environment mask into the target buffer.
assert_shape_and_dtype(tensor, shape, dtype)Assert the shape and dtype of a tensor or warp array.
assert_shape_and_dtype_mask(tensor, masks, dtype)Assert the shape of a tensor or warp array against mask dimensions.
set_debug_vis(debug_vis)Sets whether to visualize the asset data.
set_visibility(visible[, env_ids])Set the visibility of the prims corresponding to the asset.
transform_nodal_pos(nodal_pos[, pos, quat])Transform the nodal positions based on the pose transformation.
write_nodal_kinematic_target_to_sim(targets)Deprecated.
write_nodal_pos_to_sim(nodal_pos[, env_ids])Deprecated.
write_nodal_state_to_sim(nodal_state[, env_ids])Deprecated.
write_nodal_state_to_sim_index(nodal_state)Set the nodal state over selected environment indices into the simulation.
write_nodal_velocity_to_sim(nodal_vel[, env_ids])Deprecated.
- cfg: DeformableObjectCfg#
Configuration instance for the deformable object.
- __init__(cfg: DeformableObjectCfg)[source]#
Initialize the deformable object.
- Parameters:
cfg¶ – A configuration instance.
- property data: DeformableObjectData#
Data container for the deformable object.
- property num_bodies: int#
Number of bodies in the asset.
This is always 1 since each object is a single deformable body.
- property max_sim_vertices_per_body: int#
The maximum number of simulation mesh vertices per deformable body.
- reset(env_ids: Sequence[int] | None = None, env_mask: wp.array | None = None) None[source]#
Reset the deformable object.
No-op to match the PhysX deformable object convention.
- write_data_to_sim()[source]#
Apply kinematic targets to the Newton simulation.
Reads the stored kinematic target buffer and enforces it on particles: kinematic particles (flag=0) get inv_mass=0, particle_flags=0, target position, and zero velocity; free particles (flag=1) get their original inv_mass and particle_flags=1 (ACTIVE) restored.
Writes to both
state_0andstate_1so kinematic positions survive the state swaps that happen between substeps.
- write_nodal_pos_to_sim_index(nodal_pos: torch.Tensor | wp.array | ProxyArray, env_ids: Sequence[int] | torch.Tensor | wp.array | None = None, full_data: bool = False) None[source]#
Set the nodal positions over selected environment indices into the simulation.
- write_nodal_velocity_to_sim_index(nodal_vel: torch.Tensor | wp.array | ProxyArray, env_ids: Sequence[int] | torch.Tensor | wp.array | None = None, full_data: bool = False) None[source]#
Set the nodal velocity over selected environment indices into the simulation.
- Parameters:
- write_nodal_kinematic_target_to_sim_index(targets: torch.Tensor | wp.array | ProxyArray, env_ids: Sequence[int] | torch.Tensor | wp.array | None = None, full_data: bool = False) None[source]#
Set the kinematic targets of the simulation mesh for the deformable bodies.
Newton has no native kinematic target API. Instead: - Kinematic (flag=0.0): set
particle_inv_massto 0, write target pos, zero vel - Free (flag=1.0): restore originalparticle_inv_mass- Parameters:
targets¶ – The kinematic targets comprising of nodal positions and flags [m]. Shape is (len(env_ids), max_sim_vertices_per_body, 4) or (num_instances, max_sim_vertices_per_body, 4).
env_ids¶ – Environment indices. If None, then all indices are used.
full_data¶ – Whether to expect full data. Defaults to False.
- write_nodal_state_to_sim_mask(nodal_state: torch.Tensor | wp.array | ProxyArray, env_mask: wp.array | torch.Tensor | None = None) None[source]#
Set the nodal state over selected environment mask into the simulation.
- write_nodal_pos_to_sim_mask(nodal_pos: torch.Tensor | wp.array | ProxyArray, env_mask: wp.array | torch.Tensor | None = None) None[source]#
Set the nodal positions over selected environment mask into the simulation.
- write_nodal_velocity_to_sim_mask(nodal_vel: torch.Tensor | wp.array | ProxyArray, env_mask: wp.array | torch.Tensor | None = None) None[source]#
Set the nodal velocity over selected environment mask into the simulation.
- write_nodal_kinematic_target_to_sim_mask(targets: torch.Tensor | wp.array | ProxyArray, env_mask: wp.array | torch.Tensor | None = None) None[source]#
Set the kinematic targets over selected environment mask into the target buffer.
- assert_shape_and_dtype(tensor: float | torch.Tensor | wp.array, shape: tuple[int, ...], dtype: type, name: str = '') None#
Assert the shape and dtype of a tensor or warp array.
Controlled by
AssetBaseCfg.disable_shape_checks. When checks are disabled this method is a no-op.
- assert_shape_and_dtype_mask(tensor: float | torch.Tensor | wp.array, masks: tuple[wp.array, ...], dtype: type, name: str = '', trailing_dims: tuple[int, ...] = ()) None#
Assert the shape of a tensor or warp array against mask dimensions.
Mask-based write methods expect full-sized data — one element per entry in each mask dimension, regardless of how many entries are
True. The expected leading shape is therefore(mask_0.shape[0], mask_1.shape[0], ...)(i.e. the total size of each dimension, not the number of selected entries).Controlled by
AssetBaseCfg.disable_shape_checks. When checks are disabled this method is a no-op.- Parameters:
tensor¶ – The tensor or warp array to assert the shape of. Floats are skipped.
masks¶ – Tuple of mask arrays whose
shape[0]dimensions form the expected leading shape.dtype¶ – The expected warp dtype.
name¶ – Optional parameter name for error messages.
trailing_dims¶ – Extra trailing dimensions to append (e.g.
(9,)for inertias withwp.float32).
- property has_debug_vis_implementation: bool#
Whether the asset has a debug visualization implemented.
- property is_initialized: bool#
Whether the asset is initialized.
Returns True if the asset is initialized, False otherwise.
- set_debug_vis(debug_vis: bool) bool#
Sets whether to visualize the asset data.
- Parameters:
debug_vis¶ – Whether to visualize the asset data.
- Returns:
Whether the debug visualization was successfully set. False if the asset does not support debug visualization.
- set_visibility(visible: bool, env_ids: Sequence[int] | None = None)#
Set the visibility of the prims corresponding to the asset.
This operation affects the visibility of the prims corresponding to the asset in the USD stage. It is useful for toggling the visibility of the asset in the simulator. For instance, one can hide the asset when it is not being used to reduce the rendering overhead.
Note
This operation uses the PXR API to set the visibility of the prims. Thus, the operation may have an overhead if the number of prims is large.
- transform_nodal_pos(nodal_pos: torch.Tensor, pos: torch.Tensor | None = None, quat: torch.Tensor | None = None) torch.Tensor#
Transform the nodal positions based on the pose transformation.
This function computes the transformation of the nodal positions based on the pose transformation. It multiplies the nodal positions with the rotation matrix of the pose and adds the translation. Internally, it calls the
isaaclab.utils.math.transform_points()function.- Parameters:
nodal_pos¶ – The nodal positions in the simulation frame [m]. Shape is (N, max_sim_vertices_per_body, 3).
pos¶ – The position transformation [m]. Shape is (N, 3). Defaults to None, in which case the position is assumed to be zero.
quat¶ – The orientation transformation as quaternion (x, y, z, w). Shape is (N, 4). Defaults to None, in which case the orientation is assumed to be identity.
- Returns:
The transformed nodal positions [m]. Shape is (N, max_sim_vertices_per_body, 3).
- write_nodal_kinematic_target_to_sim(targets: torch.Tensor | wp.array | ProxyArray, env_ids: Sequence[int] | torch.Tensor | wp.array | None = None) None#
Deprecated. Please use
write_nodal_kinematic_target_to_sim_index()instead.
- write_nodal_pos_to_sim(nodal_pos: torch.Tensor | wp.array | ProxyArray, env_ids: Sequence[int] | torch.Tensor | wp.array | None = None) None#
Deprecated. Please use
write_nodal_pos_to_sim_index()instead.
- write_nodal_state_to_sim(nodal_state: torch.Tensor | wp.array | ProxyArray, env_ids: Sequence[int] | torch.Tensor | wp.array | None = None) None#
Deprecated. Please use
write_nodal_state_to_sim_index()instead.
- write_nodal_state_to_sim_index(nodal_state: torch.Tensor | wp.array | ProxyArray, env_ids: Sequence[int] | torch.Tensor | wp.array | None = None, full_data: bool = False) None#
Set the nodal state over selected environment indices into the simulation.
The nodal state comprises of the nodal positions and velocities. Since these are nodes, the velocity only has a translational component. All the quantities are in the simulation frame.
- Parameters:
- write_nodal_velocity_to_sim(nodal_vel: torch.Tensor | wp.array | ProxyArray, env_ids: Sequence[int] | torch.Tensor | wp.array | None = None) None#
Deprecated. Please use
write_nodal_velocity_to_sim_index()instead.
- class isaaclab_contrib.deformable.deformable_object_data.DeformableObjectData[source]#
Bases:
BaseDeformableObjectDataData container for a deformable object (Newton backend).
Newton stores all particles in flat arrays (
model.particle_q,state.particle_qd). This data class builds a per-instance view by gathering from the flat arrays using precomputed offsets.The data is lazily updated, meaning that the data is only updated when it is accessed.
Attributes:
Default nodal state
[nodal_pos, nodal_vel]in simulation world frame.Simulation mesh kinematic targets for the deformable bodies.
Nodal positions in simulation world frame [m].
Nodal velocities in simulation world frame [m/s].
Nodal state
[nodal_pos, nodal_vel]in simulation world frame [m, m/s].Root position from nodal positions [m].
Root velocity from nodal velocities [m/s].
Methods:
update(dt)Update the data for the deformable object.
- default_nodal_state_w: ProxyArray = None#
Default nodal state
[nodal_pos, nodal_vel]in simulation world frame. Shape is (num_instances, particles_per_body) with dtype vec6f.
- nodal_kinematic_target: ProxyArray = None#
Simulation mesh kinematic targets for the deformable bodies. Shape is (num_instances, particles_per_body) with dtype vec4f.
- property nodal_pos_w: ProxyArray#
Nodal positions in simulation world frame [m]. Shape is (num_instances, particles_per_body) vec3f.
- property nodal_vel_w: ProxyArray#
Nodal velocities in simulation world frame [m/s]. Shape is (num_instances, particles_per_body) vec3f.
- property nodal_state_w: ProxyArray#
Nodal state
[nodal_pos, nodal_vel]in simulation world frame [m, m/s].Shape is (num_instances, particles_per_body) vec6f.
- property root_pos_w: ProxyArray#
Root position from nodal positions [m]. Shape is (num_instances,) vec3f.
This quantity is computed as the mean of the nodal positions.
- update(dt: float)#
Update the data for the deformable object.
- Parameters:
dt¶ – The time step for the update [s]. This must be a positive value.
- property root_vel_w: ProxyArray#
Root velocity from nodal velocities [m/s]. Shape is (num_instances,) vec3f.
This quantity is computed as the mean of the nodal velocities.
Newton Solver Configurations#
- class isaaclab_contrib.deformable.newton_manager_cfg.NewtonModelCfg[source]#
Bases:
objectGlobal Newton model parameters applied after builder finalization.
These control model-level contact behavior shared across all objects.
Attributes:
Body-particle and particle self-contact stiffness [N/m].
Body-particle contact damping [N*s/m].
Body-particle contact friction coefficient [dimensionless].
- class isaaclab_contrib.deformable.newton_manager_cfg.NewtonModelSolverCfg[source]#
Bases:
NewtonSolverCfgBase for solver configs whose manager applies
NewtonModelCfgto the finalized model.TODO: Temporary. This base only exists because
NewtonModelCfglives inisaaclab_contribwhileNewtonSolverCfgis inisaaclab_newtoncore. Once these model params move into core,model_cfgshould live onNewtonSolverCfg(orNewtonCfg) directly and this class can be removed.Attributes:
Global Newton model parameters applied after builder finalization.
Manager class for this solver.
Solver type metadata (deprecated).
- model_cfg: NewtonModelCfg | None#
Global Newton model parameters applied after builder finalization.
- class_type: type[NewtonManager] | str#
Manager class for this solver.
Default points at the abstract
NewtonManager; concrete subclasses override it.
- solver_type: str#
Solver type metadata (deprecated).
Deprecated since version Manager: dispatch is now driven by
class_type; this field is retained as metadata for logging and debugging only. Do not branch onsolver_typein new code.
- class isaaclab_contrib.deformable.newton_manager_cfg.VBDSolverCfg[source]#
Bases:
NewtonModelSolverCfgConfiguration for the Vertex Block Descent (VBD) solver.
Supports cloth, soft bodies, and coupled rigid-body systems. Requires
ModelBuilder.color()beforefinalize()to build the vertex coloring.Attributes:
Manager class for the VBD solver.
Number of VBD iterations per substep.
Whether rigid bodies are integrated by an external solver (one-way coupling).
Whether to enable VBD deformable's self-contact.
Particle radius used for self-contact detection [m].
Self-contact detection margin [m].
How often particle self-contact detection is applied.
Preallocation size for each vertex's vertex-triangle collision buffer.
Preallocation size for each edge's edge-edge collision buffer.
Solver type metadata (deprecated).
Global Newton model parameters applied after builder finalization.
Maximum topological distance (in rings) below which self-contacts are discarded.
Rest-configuration separation threshold for filtering close primitives [m].
Initial stiffness seed for all rigid body contacts [N/m].
- class_type: type[NewtonManager] | str#
Manager class for the VBD solver.
- integrate_with_external_rigid_solver: bool#
Whether rigid bodies are integrated by an external solver (one-way coupling).
Set to
Truewhen coupling cloth with a separate rigid-body solver so VBD only integrates the cloth particles.
- particle_self_contact_margin: float#
Self-contact detection margin [m]. Should be >= particle_self_contact_radius.
- particle_collision_detection_interval: int#
How often particle self-contact detection is applied.
< 0: once before initialization.0: once before and once after initialization.k >= 1: before everykVBD iterations.
- particle_vertex_contact_buffer_size: int#
Preallocation size for each vertex’s vertex-triangle collision buffer.
- particle_edge_contact_buffer_size: int#
Preallocation size for each edge’s edge-edge collision buffer.
- solver_type: str#
Solver type metadata (deprecated).
Deprecated since version Manager: dispatch is now driven by
class_type; this field is retained as metadata for logging and debugging only. Do not branch onsolver_typein new code.
- model_cfg: NewtonModelCfg | None#
Global Newton model parameters applied after builder finalization.
- particle_topological_contact_filter_threshold: int#
Maximum topological distance (in rings) below which self-contacts are discarded.
Only used when
particle_enable_self_contactisTrue. Values > 3 significantly increase computation time.
- class isaaclab_contrib.deformable.newton_manager_cfg.CoupledMJWarpVBDSolverCfg[source]#
Bases:
NewtonModelSolverCfgConfiguration for the coupled MJWarp + VBD solver.
Alternates a rigid-body solver (
MJWarpSolverCfg) and VBD per substep. The coupling direction is controlled bycoupling_mode.Attributes:
Solver type metadata (deprecated).
Global Newton model parameters applied after builder finalization.
Manager class for the coupled MJWarp + VBD solver.
Rigid-body sub-solver configuration.
VBD sub-solver configuration for cloth/particle dynamics.
Coupling direction between the rigid and VBD solvers.
- solver_type: str#
Solver type metadata (deprecated).
Deprecated since version Manager: dispatch is now driven by
class_type; this field is retained as metadata for logging and debugging only. Do not branch onsolver_typein new code.
- model_cfg: NewtonModelCfg | None#
Global Newton model parameters applied after builder finalization.
- class_type: type[NewtonManager] | str#
Manager class for the coupled MJWarp + VBD solver.
- rigid_solver_cfg: MJWarpSolverCfg#
Rigid-body sub-solver configuration.
- soft_solver_cfg: VBDSolverCfg#
VBD sub-solver configuration for cloth/particle dynamics.
- coupling_mode: Literal['one_way', 'two_way']#
Coupling direction between the rigid and VBD solvers.
"one_way": Rigid -> soft only."two_way": Same-substep two-way coupling with normal + Coulomb friction.
- class isaaclab_contrib.deformable.newton_manager_cfg.CoupledFeatherstoneVBDSolverCfg[source]#
Bases:
NewtonModelSolverCfgConfiguration for the coupled Featherstone + VBD solver.
Alternates a rigid-body solver (
FeatherstoneSolverCfg) and VBD per substep. The coupling direction is controlled bycoupling_mode.Attributes:
Solver type metadata (deprecated).
Global Newton model parameters applied after builder finalization.
Manager class for the coupled Featherstone + VBD solver.
Rigid-body sub-solver configuration.
VBD sub-solver configuration for cloth/particle dynamics.
Coupling direction between the rigid and VBD solvers.
- solver_type: str#
Solver type metadata (deprecated).
Deprecated since version Manager: dispatch is now driven by
class_type; this field is retained as metadata for logging and debugging only. Do not branch onsolver_typein new code.
- model_cfg: NewtonModelCfg | None#
Global Newton model parameters applied after builder finalization.
- class_type: type[NewtonManager] | str#
Manager class for the coupled Featherstone + VBD solver.
- rigid_solver_cfg: FeatherstoneSolverCfg#
Rigid-body sub-solver configuration.
- soft_solver_cfg: VBDSolverCfg#
VBD sub-solver configuration for cloth/particle dynamics.
- coupling_mode: Literal['one_way', 'two_way', 'kinematic']#
Coupling direction between the rigid and VBD solvers.
Accepts the same values as
CoupledMJWarpVBDSolverCfg.coupling_mode, plus"kinematic"(rigid -> soft only, rigid bodies kinematically updated).
Newton Solver Managers#
- class isaaclab_contrib.deformable.vbd_manager.NewtonVBDManager[source]#
Bases:
NewtonManagerNewtonManagerspecialization for the VBD solver.Always uses Newton’s
CollisionPipelinefor contact handling.Methods:
initialize(sim_context)Initialize the manager with simulation context.
Start simulation by finalizing model and initializing state.
Create builder from USD stage with special treatment for deformable bodies, as these are not read from USD yet.
Opt an articulation into the Newton actuator fast path.
add_contact_sensor([body_names_expr, ...])Add a contact sensor for reporting contacts between bodies/shapes.
add_frame_transform_sensor(shapes, ...)Add a frame transform sensor for measuring relative transforms.
add_imu_sensor(sites)Add an IMU sensor for measuring acceleration and angular velocity at sites.
add_model_change(change)Register a model change to notify the solver.
Hook after visualizers have stepped during
render().cl_register_site(body_pattern, xform, *[, ...])Register a site request for injection into prototypes before replication.
clear()Clear all Newton-specific state (callbacks cleared by super().close()).
Remove all registered callbacks.
close()Clean up Newton physics resources.
create_builder([up_axis])Create a
ModelBuilderconfigured with default settings.deregister_callback(callback_id)Remove a registered callback.
dispatch_event(event[, payload])Dispatch an event to all registered callbacks.
fix_articulation_root(articulation_prim[, stage])Ensure that an articulation root has one enabled world fixed joint.
forward()Update articulation kinematics without stepping physics.
Get the tensor backend being used ("numpy" or "torch").
Get the current Newton contact buffer, if the active solver exposes one.
Get the control object.
Get the physics simulation device.
get_dt()Get the physics timestep.
Get the Newton model.
Get the physics timestep in seconds.
Get the list of registered views.
Return the SceneDataBackend for the SceneDataProvider.
Return the active scene data provider.
Get the current simulation time in seconds.
Get the solver substep timestep.
get_state([scene_data_provider])Get the current Newton state for visualization.
Get the current state.
Get the next state.
Truewhenstep()executes the full decimation loop internally.Initialize the solver and collision pipeline.
invalidate_fk([env_mask, env_ids, ...])Mark environments as needing FK recomputation and solver reset.
Check if fabric interface is enabled (not applicable for Newton).
pause()Pause physics simulation.
play()Start or resume physics simulation.
Refresh derived Newton state before cameras and visualizers read it.
Whether this backend's integrator has implicit numerical damping.
register_callback(callback, event[, order, ...])Register a callback.
register_particle_visual_prim(prim_path, ...)Register a
UsdGeom.Pointsprim whose points mirror a slice of Newton's particle state.register_post_actuator_callback(callback)Append a hook to the list invoked after the actuator step on every iteration.
register_post_step_callback(callback)Append a hook to the list invoked after the last solver substep on every step.
Request an extended contact attribute (e.g.
"force").Request an extended state attribute (e.g.
"body_qdd").reset([soft])Reset physics simulation.
safe_callback_invoke(fn, *args[, ...])Invoke a callback, catching exceptions that would be swallowed by external event buses.
set_builder(builder)Set the Newton model builder.
set_decimation(decimation)Set the decimation count and re-capture the CUDA graph.
step()Step the physics simulation.
stop()Stop physics simulation.
Write Newton particle positions to USD/Fabric for Kit viewport rendering.
Write Newton body_q to USD Fabric world matrices for Kit viewport / RTX rendering.
unregister_post_step_callback(callback)Remove a previously registered post-step callback.
update_visualization_state([scene_data_provider])Refresh visualization state for the active sim backend.
Block until the timeline is playing.
- classmethod initialize(sim_context: SimulationContext) None[source]#
Initialize the manager with simulation context.
- Parameters:
sim_context¶ – Parent simulation context.
TODO: Subclass should not override this method, once deformables supported on Newton import_usd, this can be unified with NewtonManager’s implementation.
- classmethod start_simulation() None[source]#
Start simulation by finalizing model and initializing state.
This function finalizes the model and initializes the simulation state. Note: Collision pipeline is initialized later in initialize_solver() after we determine whether the solver needs external collision detection.
TODO: Subclass should not override this method, missing piece is having Newton bind a surface mesh to volume deformable tetrahedral mesh in addition to removing the deformable_registry data structure.
- classmethod instantiate_builder_from_stage()[source]#
Create builder from USD stage with special treatment for deformable bodies, as these are not read from USD yet.
Detects env Xforms (e.g.
/World/Env_0,/World/Env_1) and builds each as a separate Newton world viabegin_world/end_world. Falls back to a flatadd_usdwhen no env Xforms are found.TODO: Subclass should not override this method, once deformables supported on Newton import_usd, this can be unified with NewtonManager’s implementation.
- classmethod activate_newton_actuator_path() None#
Opt an articulation into the Newton actuator fast path.
Idempotent — called by every Newton-fast-path articulation’s
_process_actuators_cfg:Sets
_use_newton_actuators_active, which_is_all_graphable()checks (adapter presence alone cannot distinguish the fast path from the standard Lab path).On first call, builds the single sim-level
NewtonActuatorAdapterover the full flat DOF layout; later calls reuse it.
- classmethod add_contact_sensor(body_names_expr: str | list[str] | None = None, shape_names_expr: str | list[str] | None = None, contact_partners_body_expr: str | list[str] | None = None, contact_partners_shape_expr: str | list[str] | None = None, verbose: bool = False) tuple[str | list[str] | None, str | list[str] | None, str | list[str] | None, str | list[str] | None]#
Add a contact sensor for reporting contacts between bodies/shapes.
Converts Isaac Lab pattern conventions (
.*regex, full USD paths) to fnmatch globs and delegates tonewton.sensors.SensorContact.- Parameters:
- classmethod add_frame_transform_sensor(shapes: list[int], reference_sites: list[int]) int#
Add a frame transform sensor for measuring relative transforms.
Creates a
SensorFrameTransformfrom pre-resolved shape and reference site indices, appends it to the internal list, and returns its index.
- classmethod add_imu_sensor(sites: list[int]) int#
Add an IMU sensor for measuring acceleration and angular velocity at sites.
Creates a
newton.sensors.SensorIMUfrom pre-resolved site indices, appends it to the internal list, and returns its index.- Parameters:
sites¶ – Ordered list of site indices (one per environment).
- Returns:
Index of the newly created sensor in the internal IMU sensor list.
- classmethod add_model_change(change: newton.ModelFlags) None#
Register a model change to notify the solver.
- classmethod after_visualizers_render() None#
Hook after visualizers have stepped during
render().Use for physics-backend sync (e.g. fabric) if needed. Recording pipelines (Kit/RTX, Newton GL video, etc.) run from
isaaclab.envs.utils.recording_hooksso they are not tied to a specific physics manager. Default is a no-op.
- classmethod cl_register_site(body_pattern: str | None, xform: warp.transform, *, per_world: bool = False) str#
Register a site request for injection into prototypes before replication.
Sensors call this during
__init__. Sites are injected into prototype builders by_cl_inject_sites()(called fromnewton_replicate) beforeadd_builder, so they replicate correctly per-world.Identical
(body_pattern, per_world, transform)registrations share sites.The body_pattern is matched against prototype-local body labels (e.g.
"Robot/link.*") when replication is active, or against the flat builder’s body labels in the fallback path. Wildcard patterns that match multiple bodies create one site per matched body.- Parameters:
body_pattern¶ – Regex pattern matched against body labels in the prototype builder (e.g.
"Robot/link0"or"Robot/finger.*"for multi-body wildcards), orNonefor global sites (world-origin reference, etc.).xform¶ – Site transform relative to body.
per_world¶ – When
True,body_patternmust beNoneand one bodyless site is created in each cloned world’s frame.
- Returns:
Assigned site label suffix.
- classmethod clear()#
Clear all Newton-specific state (callbacks cleared by super().close()).
- classmethod clear_callbacks() None#
Remove all registered callbacks.
Do NOT reset
_callback_id— handle IDs must remain monotonically unique across the lifetime of the process. Resetting the counter would let a futureregister_callback()hand out an ID that an old, still-aliveCallbackHandle(e.g. on a sensor that has not been garbage-collected yet) holds, so when the old object eventually finalizes its__del__would deregister the new callback. This bit ovphysx’s kitless multi-context tests where twoInteractiveScene``s are created in sequence: the first scene's sensor would post-GC deregister the second scene's ``_initialize_callbackby ID collision, leaving the second sensor forever uninitialized.
- classmethod create_builder(up_axis: str | None = None, **kwargs) newton.ModelBuilder#
Create a
ModelBuilderconfigured with default settings.Forwards
NewtonShapeCfgdefaults onto Newton’s upstreamModelBuilder.default_shape_cfgviachecked_apply(). Falls back to wrapper defaults when no Newton config is active so rough-terrain margin/gap still apply during early construction.
- classmethod deregister_callback(callback_id: int | CallbackHandle) None#
Remove a registered callback.
- Parameters:
callback_id¶ – The ID or CallbackHandle returned by register_callback().
- classmethod dispatch_event(event: PhysicsEvent, payload: Any = None) None#
Dispatch an event to all registered callbacks.
This is the default implementation using simple callback lists. Subclasses may override or extend with platform-specific dispatch.
- classmethod fix_articulation_root(articulation_prim: Any, stage: Any = None) Any#
Ensure that an articulation root has one enabled world fixed joint.
The base implementation leaves the root in place. Backends whose parser requires a different root topology may relocate it and return the resulting root prim.
- Parameters:
- Returns:
The articulation-root prim after backend normalization.
- Raises:
NotImplementedError – If a new joint is needed and the root is not a rigid body.
- classmethod forward() None#
Update articulation kinematics without stepping physics.
Update body poses from joint coordinates via the solver-specialized FK delegate (
_eval_fk, bound to the active subclass’s_eval_fk_impl()ininitialize_solver()). Only the articulations flagged dirty in_fk_reset_maskand_world_reset_mask(seeinvalidate_fk()) are updated. The masks are consumed (zeroed) afterwards so the nextstep()does not redundantly re-solve them.The delegate (rather than a direct
cls._eval_fk_implcall) is required because the data layer invokesNewtonManager.forward()on the base class, whereclsis the baseNewtonManager; the bound delegate dispatches to the concrete subclass override.
- classmethod get_contacts() Contacts | None#
Get the current Newton contact buffer, if the active solver exposes one.
- classmethod get_control() newton.Control#
Get the control object.
- classmethod get_model() newton.Model#
Get the Newton model.
When the active sim backend is Newton this returns the manager’s own authoritative model. When the active sim backend is PhysX a shadow Newton model is built lazily (from the visualizer prebuilt artifact) so renderers/visualizers that operate on Newton
ModelandStatecan still drive a PhysX-simulated scene.
- classmethod get_physics_sim_view() list#
Get the list of registered views.
Assets can append their views to this list, and sensors can access them. Returns a list that callers can append to.
- Returns:
List of registered views (e.g., NewtonArticulationView instances).
- classmethod get_scene_data_backend() SceneDataBackend | None#
Return the SceneDataBackend for the SceneDataProvider.
- classmethod get_scene_data_provider() SceneDataProvider#
Return the active scene data provider.
- classmethod get_state(scene_data_provider: SceneDataProvider | None = None) newton.State#
Get the current Newton state for visualization.
Use this method from visualizers/renderers/video recorders that need a backend-agnostic Newton
State. When the sim backend is PhysX this refreshes the shadow_state_0.body_qfrom the live PhysX scene viaupdate_visualization_state()before returning, so callers never observe stale transforms. Under the Newton sim backend, pending forward kinematics is applied before returning the live state.
- classmethod get_state_0() newton.State#
Get the current state.
- classmethod get_state_1() newton.State#
Get the next state.
- classmethod handles_decimation() bool#
Truewhenstep()executes the full decimation loop internally.This is the case when all Newton actuators are CUDA-graph-safe. The full decimation loop (including the trivial
decimation=1case) is folded into a singlestep()call.
- classmethod initialize_solver() None#
Initialize the solver and collision pipeline.
Thin orchestrator: delegates solver construction to
_build_solver()(overridden by each solver subclass), allocates the collision pipeline (when applicable) via_initialize_contacts(), then sets up cubric bindings and either captures the CUDA graph immediately or defers capture until the firststep()call (RTX-active path).Warning
When using a CUDA-enabled device, the simulation is graphed. This means the function steps the simulation once to capture the graph, so it should only be called after everything else in the simulation is initialized.
- classmethod invalidate_fk(env_mask: wp.array | None = None, env_ids: wp.array | None = None, articulation_ids: wp.array | None = None) None#
Mark environments as needing FK recomputation and solver reset.
Called by asset write methods that modify joint coordinates or root transforms. The masks are consumed by the next forward, raw-state, rendering, or physics-step boundary.
- Parameters:
env_mask¶ – Boolean mask of dirtied environments. Shape
(num_envs,). Used by_maskwrite methods.env_ids¶ – Integer indices of dirtied environments. Used by
_indexwrite methods.articulation_ids¶ – Mapping from
(world, arti)to model articulation index. Shape(world_count, count_per_world). Obtained fromArticulationView.articulation_ids.
- classmethod is_fabric_enabled() bool#
Check if fabric interface is enabled (not applicable for Newton).
- classmethod provides_implicit_damping() bool#
Whether this backend’s integrator has implicit numerical damping.
With implicit damping (PhysX, OV-PhysX) a camera policy can infer velocity from a single frame. Without it (Newton’s symplectic integrator) the policy needs a temporal cue in the observation (e.g. frame stacking).
The base default is
True; backends without implicit damping override toFalse.- Returns:
Whether the backend’s integrator has implicit numerical damping.
- classmethod register_callback(callback: Callable, event: PhysicsEvent, order: int = 0, name: str | None = None, wrap_weak_ref: bool = True) CallbackHandle#
Register a callback. Passes event to parent class.
- classmethod register_particle_visual_prim(prim_path: str, particle_offset: int, particle_count: int, sync_frequency: int = 1) None#
Register a
UsdGeom.Pointsprim whose points mirror a slice of Newton’s particle state.
- classmethod register_post_actuator_callback(callback: Callable[[], None]) None#
Append a hook to the list invoked after the actuator step on every iteration.
Each callback runs inside the captured CUDA graph (when
_is_all_graphable()isTrue) right afterNewtonActuatorAdapter.step()and before the solver substeps, so kernel writes tostate/controlare visible to the integrator on the same iteration. Multiple articulations register their own implicit-DOF telemetry / FF-routing kernels here; all registered callbacks fire in registration order each step.
- classmethod register_post_step_callback(callback: Callable[[], None]) None#
Append a hook to the list invoked after the last solver substep on every step.
Each callback runs inside the stepped (and, when
_is_all_graphable()isTrue, captured) region right after the final solver substep of the decimation loop and before_update_sensors(), so the launches it issues are recorded into every captured CUDA graph and replayed on each tick. Callbacks must be graph-safe (fixed shapes, no host branching on device data) and must be registered before capture. Articulations with non-identity ordering register their backend-to-user state republish here; all registered callbacks fire in registration order each step.
- classmethod request_extended_contact_attribute(attr: str) None#
Request an extended contact attribute (e.g.
"force").Sensors call this during
__init__, before model finalization. Attributes are forwarded to the model instart_simulation()so that subsequentContactscreation includes them.- Parameters:
attr¶ – Contact attribute name.
- classmethod request_extended_state_attribute(attr: str) None#
Request an extended state attribute (e.g.
"body_qdd").Sensors call this during
__init__, before model finalization. Attributes are forwarded to the builder instart_simulation()so that subsequentmodel.state()calls allocate them.- Parameters:
attr¶ – State attribute name (must be in
State.EXTENDED_ATTRIBUTES).
- classmethod reset(soft: bool = False) None#
Reset physics simulation.
A hard reset (
soft=False) re-finalizes the Newton model, reallocating its device arrays. The cached collision pipeline, contacts and any captured CUDA graph reference the old buffers, so they are released here and rebuilt against the re-finalized model byinitialize_solver(). This avoids the illegal CUDA memory access (CUDA error 700) that would otherwise occur on the first step after a hard reset.A soft reset (
soft=True) skips this full reinitialization and reuses the existing model, solver, collision pipeline and CUDA graph.- Parameters:
soft¶ – If True, skip full reinitialization.
- static safe_callback_invoke(fn: Callable, *args, physics_manager: type[PhysicsManager] | None = None) None#
Invoke a callback, catching exceptions that would be swallowed by external event buses.
Ignores
ReferenceError(from garbage-collected weakref proxies). All other exceptions are forwarded to physics_manager.``store_callback_exception`` when available (see note below), or re-raised immediately otherwise.- Note (Octi):
The carb event bus used by PhysX/Omniverse silently swallows exceptions raised inside callbacks.
PhysxManagerworks around this by storing the exception and re-raising it after event dispatch completes (inreset()/step()). Backends that dispatch events directly (e.g. Newton) don’t need this — exceptions propagate normally — sostore_callback_exceptionis not called for them. This is a known wart; a cleaner solution is actively being explored.
- classmethod set_decimation(decimation: int) None#
Set the decimation count and re-capture the CUDA graph.
When all actuators are graphable the entire decimation loop (actuators + solver substeps, repeated decimation times) is captured as a single CUDA graph.
If a CUDA graph was previously captured, it is automatically re-captured with the new decimation count using the same strategy as
start_simulation(): standardwp.ScopedCapturewhen no USDRT stage is active, or deferred relaxed capture when RTX is running.
- classmethod step() None#
Step the physics simulation.
The stepping logic follows one of two paths depending on whether all actuators are CUDA-graph-safe:
All-graphable path (
_simulate_full()):Actuators and solver substeps are captured together in a single CUDA graph containing the full
decimation x (actuators + solver substeps)loop.Eager-actuator path (fallback, some actuators not graph-safe):
Actuators are stepped eagerly on the CPU timeline (outside the graph), then a graph containing only the solver substeps is launched via
_simulate_physics_only().In both paths the sequence within one physics step is:
zero actuated DOFs in control.joint_f -> actuator.step (computes effort, writes to control.joint_f) -> solver.step x num_substeps (integrates, reads control.joint_f) -> sensors.update
- classmethod sync_particles_to_usd() None#
Write Newton particle positions to USD/Fabric for Kit viewport rendering.
Two prim families are synced from
state_0.particle_q:Fabric mesh prims tagged with
newton:particleOffset/newton:particleCount(deformable visual meshes) receive local-frame points on the GPU via_sync_fabric_mesh_particles().UsdGeom.Pointsprims registered throughregister_particle_visual_prim()(MPM particle clouds) receive world-frame points via_sync_particle_points_prims().
No-op when there is no particle state or nothing changed since the last sync.
- classmethod sync_transforms_to_usd() None#
Write Newton body_q to USD Fabric world matrices for Kit viewport / RTX rendering.
No-op when
_usdrt_stageis None (i.e. Kit visualizer is not active) or when transforms have not changed since the last sync.Called at render cadence by
pre_render()(viarender()). Physics stepping marks transforms dirty via_mark_transforms_dirty()so that the expensive Fabric hierarchy update only runs once per render frame rather than after every physics step.Uses
wp.fabricarraydirectly (noisaacsim.physics.newtonextension needed). The Warp kernel readsstate_0.body_q[newton_index[i]]and writes the correspondingmat44dtoomni:fabric:worldMatrixfor each prim.When cubric is available the method mirrors PhysX’s
DirectGpuHelperpattern: pause Fabric change tracking, write transforms, resume tracking, then callIAdapter::computeon the GPU to propagate the hierarchy and notify the Fabric Scene Delegate. Otherwise it falls back to the CPUupdate_world_xforms()path.
- classmethod unregister_post_step_callback(callback: Callable[[], None]) None#
Remove a previously registered post-step callback.
Symmetric to
register_post_step_callback(), this lets an articulation deregister its republish hook when its callbacks are cleared so the bound method does not linger on the class-level list after the articulation is gone. Removing a callback that was never registered (or was already removed) is a safe no-op, matching the tolerant deregistration of other handles.
- classmethod update_visualization_state(scene_data_provider: SceneDataProvider | None = None) None#
Refresh visualization state for the active sim backend.
Newton sim backend: no-op —
_state_0is the live, authoritative state already advanced bystep()/ forward kinematics.PhysX sim backend: pull rigid-body transforms from the
SceneDataProviderand write them into the shadow_state_0.body_qso Newton-native consumers (Newton renderer, Newton/Rerun/Viser visualizers, OVRTX renderer, Newton GL video) see fresh poses.Invoked lazily from
get_state()so consumers do not need to coordinate the sync explicitly.
- class isaaclab_contrib.deformable.coupled_mjwarp_vbd_manager.NewtonCoupledMJWarpVBDManager[source]#
Bases:
NewtonVBDManagerNewtonVBDManagerspecialization for the coupled MJWarp + VBD solver. Reuses the VBD manager’s deformable stage handling and adds a custom rigid/soft coupling step.Always uses Newton’s
CollisionPipelinefor contact handling.Methods:
step()Step the physics simulation.
Opt an articulation into the Newton actuator fast path.
add_contact_sensor([body_names_expr, ...])Add a contact sensor for reporting contacts between bodies/shapes.
add_frame_transform_sensor(shapes, ...)Add a frame transform sensor for measuring relative transforms.
add_imu_sensor(sites)Add an IMU sensor for measuring acceleration and angular velocity at sites.
add_model_change(change)Register a model change to notify the solver.
Hook after visualizers have stepped during
render().cl_register_site(body_pattern, xform, *[, ...])Register a site request for injection into prototypes before replication.
clear()Clear all Newton-specific state (callbacks cleared by super().close()).
Remove all registered callbacks.
close()Clean up Newton physics resources.
create_builder([up_axis])Create a
ModelBuilderconfigured with default settings.deregister_callback(callback_id)Remove a registered callback.
dispatch_event(event[, payload])Dispatch an event to all registered callbacks.
fix_articulation_root(articulation_prim[, stage])Ensure that an articulation root has one enabled world fixed joint.
forward()Update articulation kinematics without stepping physics.
Get the tensor backend being used ("numpy" or "torch").
Get the current Newton contact buffer, if the active solver exposes one.
Get the control object.
Get the physics simulation device.
get_dt()Get the physics timestep.
Get the Newton model.
Get the physics timestep in seconds.
Get the list of registered views.
Return the SceneDataBackend for the SceneDataProvider.
Return the active scene data provider.
Get the current simulation time in seconds.
Get the solver substep timestep.
get_state([scene_data_provider])Get the current Newton state for visualization.
Get the current state.
Get the next state.
Truewhenstep()executes the full decimation loop internally.initialize(sim_context)Initialize the manager with simulation context.
Initialize the solver and collision pipeline.
Create builder from USD stage with special treatment for deformable bodies, as these are not read from USD yet.
invalidate_fk([env_mask, env_ids, ...])Mark environments as needing FK recomputation and solver reset.
Check if fabric interface is enabled (not applicable for Newton).
pause()Pause physics simulation.
play()Start or resume physics simulation.
Refresh derived Newton state before cameras and visualizers read it.
Whether this backend's integrator has implicit numerical damping.
register_callback(callback, event[, order, ...])Register a callback.
register_particle_visual_prim(prim_path, ...)Register a
UsdGeom.Pointsprim whose points mirror a slice of Newton's particle state.register_post_actuator_callback(callback)Append a hook to the list invoked after the actuator step on every iteration.
register_post_step_callback(callback)Append a hook to the list invoked after the last solver substep on every step.
Request an extended contact attribute (e.g.
"force").Request an extended state attribute (e.g.
"body_qdd").reset([soft])Reset physics simulation.
safe_callback_invoke(fn, *args[, ...])Invoke a callback, catching exceptions that would be swallowed by external event buses.
set_builder(builder)Set the Newton model builder.
set_decimation(decimation)Set the decimation count and re-capture the CUDA graph.
Start simulation by finalizing model and initializing state.
stop()Stop physics simulation.
Write Newton particle positions to USD/Fabric for Kit viewport rendering.
Write Newton body_q to USD Fabric world matrices for Kit viewport / RTX rendering.
unregister_post_step_callback(callback)Remove a previously registered post-step callback.
update_visualization_state([scene_data_provider])Refresh visualization state for the active sim backend.
Block until the timeline is playing.
- classmethod activate_newton_actuator_path() None#
Opt an articulation into the Newton actuator fast path.
Idempotent — called by every Newton-fast-path articulation’s
_process_actuators_cfg:Sets
_use_newton_actuators_active, which_is_all_graphable()checks (adapter presence alone cannot distinguish the fast path from the standard Lab path).On first call, builds the single sim-level
NewtonActuatorAdapterover the full flat DOF layout; later calls reuse it.
- classmethod add_contact_sensor(body_names_expr: str | list[str] | None = None, shape_names_expr: str | list[str] | None = None, contact_partners_body_expr: str | list[str] | None = None, contact_partners_shape_expr: str | list[str] | None = None, verbose: bool = False) tuple[str | list[str] | None, str | list[str] | None, str | list[str] | None, str | list[str] | None]#
Add a contact sensor for reporting contacts between bodies/shapes.
Converts Isaac Lab pattern conventions (
.*regex, full USD paths) to fnmatch globs and delegates tonewton.sensors.SensorContact.- Parameters:
- classmethod add_frame_transform_sensor(shapes: list[int], reference_sites: list[int]) int#
Add a frame transform sensor for measuring relative transforms.
Creates a
SensorFrameTransformfrom pre-resolved shape and reference site indices, appends it to the internal list, and returns its index.
- classmethod add_imu_sensor(sites: list[int]) int#
Add an IMU sensor for measuring acceleration and angular velocity at sites.
Creates a
newton.sensors.SensorIMUfrom pre-resolved site indices, appends it to the internal list, and returns its index.- Parameters:
sites¶ – Ordered list of site indices (one per environment).
- Returns:
Index of the newly created sensor in the internal IMU sensor list.
- classmethod add_model_change(change: newton.ModelFlags) None#
Register a model change to notify the solver.
- classmethod after_visualizers_render() None#
Hook after visualizers have stepped during
render().Use for physics-backend sync (e.g. fabric) if needed. Recording pipelines (Kit/RTX, Newton GL video, etc.) run from
isaaclab.envs.utils.recording_hooksso they are not tied to a specific physics manager. Default is a no-op.
- classmethod cl_register_site(body_pattern: str | None, xform: warp.transform, *, per_world: bool = False) str#
Register a site request for injection into prototypes before replication.
Sensors call this during
__init__. Sites are injected into prototype builders by_cl_inject_sites()(called fromnewton_replicate) beforeadd_builder, so they replicate correctly per-world.Identical
(body_pattern, per_world, transform)registrations share sites.The body_pattern is matched against prototype-local body labels (e.g.
"Robot/link.*") when replication is active, or against the flat builder’s body labels in the fallback path. Wildcard patterns that match multiple bodies create one site per matched body.- Parameters:
body_pattern¶ – Regex pattern matched against body labels in the prototype builder (e.g.
"Robot/link0"or"Robot/finger.*"for multi-body wildcards), orNonefor global sites (world-origin reference, etc.).xform¶ – Site transform relative to body.
per_world¶ – When
True,body_patternmust beNoneand one bodyless site is created in each cloned world’s frame.
- Returns:
Assigned site label suffix.
- classmethod clear()#
Clear all Newton-specific state (callbacks cleared by super().close()).
- classmethod clear_callbacks() None#
Remove all registered callbacks.
Do NOT reset
_callback_id— handle IDs must remain monotonically unique across the lifetime of the process. Resetting the counter would let a futureregister_callback()hand out an ID that an old, still-aliveCallbackHandle(e.g. on a sensor that has not been garbage-collected yet) holds, so when the old object eventually finalizes its__del__would deregister the new callback. This bit ovphysx’s kitless multi-context tests where twoInteractiveScene``s are created in sequence: the first scene's sensor would post-GC deregister the second scene's ``_initialize_callbackby ID collision, leaving the second sensor forever uninitialized.
- classmethod create_builder(up_axis: str | None = None, **kwargs) newton.ModelBuilder#
Create a
ModelBuilderconfigured with default settings.Forwards
NewtonShapeCfgdefaults onto Newton’s upstreamModelBuilder.default_shape_cfgviachecked_apply(). Falls back to wrapper defaults when no Newton config is active so rough-terrain margin/gap still apply during early construction.
- classmethod deregister_callback(callback_id: int | CallbackHandle) None#
Remove a registered callback.
- Parameters:
callback_id¶ – The ID or CallbackHandle returned by register_callback().
- classmethod dispatch_event(event: PhysicsEvent, payload: Any = None) None#
Dispatch an event to all registered callbacks.
This is the default implementation using simple callback lists. Subclasses may override or extend with platform-specific dispatch.
- classmethod fix_articulation_root(articulation_prim: Any, stage: Any = None) Any#
Ensure that an articulation root has one enabled world fixed joint.
The base implementation leaves the root in place. Backends whose parser requires a different root topology may relocate it and return the resulting root prim.
- Parameters:
- Returns:
The articulation-root prim after backend normalization.
- Raises:
NotImplementedError – If a new joint is needed and the root is not a rigid body.
- classmethod forward() None#
Update articulation kinematics without stepping physics.
Update body poses from joint coordinates via the solver-specialized FK delegate (
_eval_fk, bound to the active subclass’s_eval_fk_impl()ininitialize_solver()). Only the articulations flagged dirty in_fk_reset_maskand_world_reset_mask(seeinvalidate_fk()) are updated. The masks are consumed (zeroed) afterwards so the nextstep()does not redundantly re-solve them.The delegate (rather than a direct
cls._eval_fk_implcall) is required because the data layer invokesNewtonManager.forward()on the base class, whereclsis the baseNewtonManager; the bound delegate dispatches to the concrete subclass override.
- classmethod get_contacts() Contacts | None#
Get the current Newton contact buffer, if the active solver exposes one.
- classmethod get_control() newton.Control#
Get the control object.
- classmethod get_model() newton.Model#
Get the Newton model.
When the active sim backend is Newton this returns the manager’s own authoritative model. When the active sim backend is PhysX a shadow Newton model is built lazily (from the visualizer prebuilt artifact) so renderers/visualizers that operate on Newton
ModelandStatecan still drive a PhysX-simulated scene.
- classmethod get_physics_sim_view() list#
Get the list of registered views.
Assets can append their views to this list, and sensors can access them. Returns a list that callers can append to.
- Returns:
List of registered views (e.g., NewtonArticulationView instances).
- classmethod get_scene_data_backend() SceneDataBackend | None#
Return the SceneDataBackend for the SceneDataProvider.
- classmethod get_scene_data_provider() SceneDataProvider#
Return the active scene data provider.
- classmethod get_state(scene_data_provider: SceneDataProvider | None = None) newton.State#
Get the current Newton state for visualization.
Use this method from visualizers/renderers/video recorders that need a backend-agnostic Newton
State. When the sim backend is PhysX this refreshes the shadow_state_0.body_qfrom the live PhysX scene viaupdate_visualization_state()before returning, so callers never observe stale transforms. Under the Newton sim backend, pending forward kinematics is applied before returning the live state.
- classmethod get_state_0() newton.State#
Get the current state.
- classmethod get_state_1() newton.State#
Get the next state.
- classmethod handles_decimation() bool#
Truewhenstep()executes the full decimation loop internally.This is the case when all Newton actuators are CUDA-graph-safe. The full decimation loop (including the trivial
decimation=1case) is folded into a singlestep()call.
- classmethod initialize(sim_context: SimulationContext) None#
Initialize the manager with simulation context.
- Parameters:
sim_context¶ – Parent simulation context.
TODO: Subclass should not override this method, once deformables supported on Newton import_usd, this can be unified with NewtonManager’s implementation.
- classmethod initialize_solver() None#
Initialize the solver and collision pipeline.
Thin orchestrator: delegates solver construction to
_build_solver()(overridden by each solver subclass), allocates the collision pipeline (when applicable) via_initialize_contacts(), then sets up cubric bindings and either captures the CUDA graph immediately or defers capture until the firststep()call (RTX-active path).Warning
When using a CUDA-enabled device, the simulation is graphed. This means the function steps the simulation once to capture the graph, so it should only be called after everything else in the simulation is initialized.
- classmethod instantiate_builder_from_stage()#
Create builder from USD stage with special treatment for deformable bodies, as these are not read from USD yet.
Detects env Xforms (e.g.
/World/Env_0,/World/Env_1) and builds each as a separate Newton world viabegin_world/end_world. Falls back to a flatadd_usdwhen no env Xforms are found.TODO: Subclass should not override this method, once deformables supported on Newton import_usd, this can be unified with NewtonManager’s implementation.
- classmethod invalidate_fk(env_mask: wp.array | None = None, env_ids: wp.array | None = None, articulation_ids: wp.array | None = None) None#
Mark environments as needing FK recomputation and solver reset.
Called by asset write methods that modify joint coordinates or root transforms. The masks are consumed by the next forward, raw-state, rendering, or physics-step boundary.
- Parameters:
env_mask¶ – Boolean mask of dirtied environments. Shape
(num_envs,). Used by_maskwrite methods.env_ids¶ – Integer indices of dirtied environments. Used by
_indexwrite methods.articulation_ids¶ – Mapping from
(world, arti)to model articulation index. Shape(world_count, count_per_world). Obtained fromArticulationView.articulation_ids.
- classmethod is_fabric_enabled() bool#
Check if fabric interface is enabled (not applicable for Newton).
- classmethod provides_implicit_damping() bool#
Whether this backend’s integrator has implicit numerical damping.
With implicit damping (PhysX, OV-PhysX) a camera policy can infer velocity from a single frame. Without it (Newton’s symplectic integrator) the policy needs a temporal cue in the observation (e.g. frame stacking).
The base default is
True; backends without implicit damping override toFalse.- Returns:
Whether the backend’s integrator has implicit numerical damping.
- classmethod register_callback(callback: Callable, event: PhysicsEvent, order: int = 0, name: str | None = None, wrap_weak_ref: bool = True) CallbackHandle#
Register a callback. Passes event to parent class.
- classmethod register_particle_visual_prim(prim_path: str, particle_offset: int, particle_count: int, sync_frequency: int = 1) None#
Register a
UsdGeom.Pointsprim whose points mirror a slice of Newton’s particle state.
- classmethod register_post_actuator_callback(callback: Callable[[], None]) None#
Append a hook to the list invoked after the actuator step on every iteration.
Each callback runs inside the captured CUDA graph (when
_is_all_graphable()isTrue) right afterNewtonActuatorAdapter.step()and before the solver substeps, so kernel writes tostate/controlare visible to the integrator on the same iteration. Multiple articulations register their own implicit-DOF telemetry / FF-routing kernels here; all registered callbacks fire in registration order each step.
- classmethod register_post_step_callback(callback: Callable[[], None]) None#
Append a hook to the list invoked after the last solver substep on every step.
Each callback runs inside the stepped (and, when
_is_all_graphable()isTrue, captured) region right after the final solver substep of the decimation loop and before_update_sensors(), so the launches it issues are recorded into every captured CUDA graph and replayed on each tick. Callbacks must be graph-safe (fixed shapes, no host branching on device data) and must be registered before capture. Articulations with non-identity ordering register their backend-to-user state republish here; all registered callbacks fire in registration order each step.
- classmethod request_extended_contact_attribute(attr: str) None#
Request an extended contact attribute (e.g.
"force").Sensors call this during
__init__, before model finalization. Attributes are forwarded to the model instart_simulation()so that subsequentContactscreation includes them.- Parameters:
attr¶ – Contact attribute name.
- classmethod request_extended_state_attribute(attr: str) None#
Request an extended state attribute (e.g.
"body_qdd").Sensors call this during
__init__, before model finalization. Attributes are forwarded to the builder instart_simulation()so that subsequentmodel.state()calls allocate them.- Parameters:
attr¶ – State attribute name (must be in
State.EXTENDED_ATTRIBUTES).
- classmethod reset(soft: bool = False) None#
Reset physics simulation.
A hard reset (
soft=False) re-finalizes the Newton model, reallocating its device arrays. The cached collision pipeline, contacts and any captured CUDA graph reference the old buffers, so they are released here and rebuilt against the re-finalized model byinitialize_solver(). This avoids the illegal CUDA memory access (CUDA error 700) that would otherwise occur on the first step after a hard reset.A soft reset (
soft=True) skips this full reinitialization and reuses the existing model, solver, collision pipeline and CUDA graph.- Parameters:
soft¶ – If True, skip full reinitialization.
- static safe_callback_invoke(fn: Callable, *args, physics_manager: type[PhysicsManager] | None = None) None#
Invoke a callback, catching exceptions that would be swallowed by external event buses.
Ignores
ReferenceError(from garbage-collected weakref proxies). All other exceptions are forwarded to physics_manager.``store_callback_exception`` when available (see note below), or re-raised immediately otherwise.- Note (Octi):
The carb event bus used by PhysX/Omniverse silently swallows exceptions raised inside callbacks.
PhysxManagerworks around this by storing the exception and re-raising it after event dispatch completes (inreset()/step()). Backends that dispatch events directly (e.g. Newton) don’t need this — exceptions propagate normally — sostore_callback_exceptionis not called for them. This is a known wart; a cleaner solution is actively being explored.
- classmethod set_decimation(decimation: int) None#
Set the decimation count and re-capture the CUDA graph.
When all actuators are graphable the entire decimation loop (actuators + solver substeps, repeated decimation times) is captured as a single CUDA graph.
If a CUDA graph was previously captured, it is automatically re-captured with the new decimation count using the same strategy as
start_simulation(): standardwp.ScopedCapturewhen no USDRT stage is active, or deferred relaxed capture when RTX is running.
- classmethod start_simulation() None#
Start simulation by finalizing model and initializing state.
This function finalizes the model and initializes the simulation state. Note: Collision pipeline is initialized later in initialize_solver() after we determine whether the solver needs external collision detection.
TODO: Subclass should not override this method, missing piece is having Newton bind a surface mesh to volume deformable tetrahedral mesh in addition to removing the deformable_registry data structure.
- classmethod sync_particles_to_usd() None#
Write Newton particle positions to USD/Fabric for Kit viewport rendering.
Two prim families are synced from
state_0.particle_q:Fabric mesh prims tagged with
newton:particleOffset/newton:particleCount(deformable visual meshes) receive local-frame points on the GPU via_sync_fabric_mesh_particles().UsdGeom.Pointsprims registered throughregister_particle_visual_prim()(MPM particle clouds) receive world-frame points via_sync_particle_points_prims().
No-op when there is no particle state or nothing changed since the last sync.
- classmethod sync_transforms_to_usd() None#
Write Newton body_q to USD Fabric world matrices for Kit viewport / RTX rendering.
No-op when
_usdrt_stageis None (i.e. Kit visualizer is not active) or when transforms have not changed since the last sync.Called at render cadence by
pre_render()(viarender()). Physics stepping marks transforms dirty via_mark_transforms_dirty()so that the expensive Fabric hierarchy update only runs once per render frame rather than after every physics step.Uses
wp.fabricarraydirectly (noisaacsim.physics.newtonextension needed). The Warp kernel readsstate_0.body_q[newton_index[i]]and writes the correspondingmat44dtoomni:fabric:worldMatrixfor each prim.When cubric is available the method mirrors PhysX’s
DirectGpuHelperpattern: pause Fabric change tracking, write transforms, resume tracking, then callIAdapter::computeon the GPU to propagate the hierarchy and notify the Fabric Scene Delegate. Otherwise it falls back to the CPUupdate_world_xforms()path.
- classmethod unregister_post_step_callback(callback: Callable[[], None]) None#
Remove a previously registered post-step callback.
Symmetric to
register_post_step_callback(), this lets an articulation deregister its republish hook when its callbacks are cleared so the bound method does not linger on the class-level list after the articulation is gone. Removing a callback that was never registered (or was already removed) is a safe no-op, matching the tolerant deregistration of other handles.
- classmethod update_visualization_state(scene_data_provider: SceneDataProvider | None = None) None#
Refresh visualization state for the active sim backend.
Newton sim backend: no-op —
_state_0is the live, authoritative state already advanced bystep()/ forward kinematics.PhysX sim backend: pull rigid-body transforms from the
SceneDataProviderand write them into the shadow_state_0.body_qso Newton-native consumers (Newton renderer, Newton/Rerun/Viser visualizers, OVRTX renderer, Newton GL video) see fresh poses.Invoked lazily from
get_state()so consumers do not need to coordinate the sync explicitly.
- class isaaclab_contrib.deformable.coupled_featherstone_vbd_manager.NewtonCoupledFeatherstoneVBDManager[source]#
Bases:
NewtonVBDManagerNewtonVBDManagerspecialization for the coupled Featherstone + VBD solver. Reuses the VBD manager’s deformable stage handling and adds a custom rigid/soft coupling step.Always uses Newton’s
CollisionPipelinefor contact handling.Methods:
step()Step the physics simulation.
Opt an articulation into the Newton actuator fast path.
add_contact_sensor([body_names_expr, ...])Add a contact sensor for reporting contacts between bodies/shapes.
add_frame_transform_sensor(shapes, ...)Add a frame transform sensor for measuring relative transforms.
add_imu_sensor(sites)Add an IMU sensor for measuring acceleration and angular velocity at sites.
add_model_change(change)Register a model change to notify the solver.
Hook after visualizers have stepped during
render().cl_register_site(body_pattern, xform, *[, ...])Register a site request for injection into prototypes before replication.
clear()Clear all Newton-specific state (callbacks cleared by super().close()).
Remove all registered callbacks.
close()Clean up Newton physics resources.
create_builder([up_axis])Create a
ModelBuilderconfigured with default settings.deregister_callback(callback_id)Remove a registered callback.
dispatch_event(event[, payload])Dispatch an event to all registered callbacks.
fix_articulation_root(articulation_prim[, stage])Ensure that an articulation root has one enabled world fixed joint.
forward()Update articulation kinematics without stepping physics.
Get the tensor backend being used ("numpy" or "torch").
Get the current Newton contact buffer, if the active solver exposes one.
Get the control object.
Get the physics simulation device.
get_dt()Get the physics timestep.
Get the Newton model.
Get the physics timestep in seconds.
Get the list of registered views.
Return the SceneDataBackend for the SceneDataProvider.
Return the active scene data provider.
Get the current simulation time in seconds.
Get the solver substep timestep.
get_state([scene_data_provider])Get the current Newton state for visualization.
Get the current state.
Get the next state.
Truewhenstep()executes the full decimation loop internally.initialize(sim_context)Initialize the manager with simulation context.
Initialize the solver and collision pipeline.
Create builder from USD stage with special treatment for deformable bodies, as these are not read from USD yet.
invalidate_fk([env_mask, env_ids, ...])Mark environments as needing FK recomputation and solver reset.
Check if fabric interface is enabled (not applicable for Newton).
pause()Pause physics simulation.
play()Start or resume physics simulation.
Refresh derived Newton state before cameras and visualizers read it.
Whether this backend's integrator has implicit numerical damping.
register_callback(callback, event[, order, ...])Register a callback.
register_particle_visual_prim(prim_path, ...)Register a
UsdGeom.Pointsprim whose points mirror a slice of Newton's particle state.register_post_actuator_callback(callback)Append a hook to the list invoked after the actuator step on every iteration.
register_post_step_callback(callback)Append a hook to the list invoked after the last solver substep on every step.
Request an extended contact attribute (e.g.
"force").Request an extended state attribute (e.g.
"body_qdd").reset([soft])Reset physics simulation.
safe_callback_invoke(fn, *args[, ...])Invoke a callback, catching exceptions that would be swallowed by external event buses.
set_builder(builder)Set the Newton model builder.
set_decimation(decimation)Set the decimation count and re-capture the CUDA graph.
Start simulation by finalizing model and initializing state.
stop()Stop physics simulation.
Write Newton particle positions to USD/Fabric for Kit viewport rendering.
Write Newton body_q to USD Fabric world matrices for Kit viewport / RTX rendering.
unregister_post_step_callback(callback)Remove a previously registered post-step callback.
update_visualization_state([scene_data_provider])Refresh visualization state for the active sim backend.
Block until the timeline is playing.
- classmethod activate_newton_actuator_path() None#
Opt an articulation into the Newton actuator fast path.
Idempotent — called by every Newton-fast-path articulation’s
_process_actuators_cfg:Sets
_use_newton_actuators_active, which_is_all_graphable()checks (adapter presence alone cannot distinguish the fast path from the standard Lab path).On first call, builds the single sim-level
NewtonActuatorAdapterover the full flat DOF layout; later calls reuse it.
- classmethod add_contact_sensor(body_names_expr: str | list[str] | None = None, shape_names_expr: str | list[str] | None = None, contact_partners_body_expr: str | list[str] | None = None, contact_partners_shape_expr: str | list[str] | None = None, verbose: bool = False) tuple[str | list[str] | None, str | list[str] | None, str | list[str] | None, str | list[str] | None]#
Add a contact sensor for reporting contacts between bodies/shapes.
Converts Isaac Lab pattern conventions (
.*regex, full USD paths) to fnmatch globs and delegates tonewton.sensors.SensorContact.- Parameters:
- classmethod add_frame_transform_sensor(shapes: list[int], reference_sites: list[int]) int#
Add a frame transform sensor for measuring relative transforms.
Creates a
SensorFrameTransformfrom pre-resolved shape and reference site indices, appends it to the internal list, and returns its index.
- classmethod add_imu_sensor(sites: list[int]) int#
Add an IMU sensor for measuring acceleration and angular velocity at sites.
Creates a
newton.sensors.SensorIMUfrom pre-resolved site indices, appends it to the internal list, and returns its index.- Parameters:
sites¶ – Ordered list of site indices (one per environment).
- Returns:
Index of the newly created sensor in the internal IMU sensor list.
- classmethod add_model_change(change: newton.ModelFlags) None#
Register a model change to notify the solver.
- classmethod after_visualizers_render() None#
Hook after visualizers have stepped during
render().Use for physics-backend sync (e.g. fabric) if needed. Recording pipelines (Kit/RTX, Newton GL video, etc.) run from
isaaclab.envs.utils.recording_hooksso they are not tied to a specific physics manager. Default is a no-op.
- classmethod cl_register_site(body_pattern: str | None, xform: warp.transform, *, per_world: bool = False) str#
Register a site request for injection into prototypes before replication.
Sensors call this during
__init__. Sites are injected into prototype builders by_cl_inject_sites()(called fromnewton_replicate) beforeadd_builder, so they replicate correctly per-world.Identical
(body_pattern, per_world, transform)registrations share sites.The body_pattern is matched against prototype-local body labels (e.g.
"Robot/link.*") when replication is active, or against the flat builder’s body labels in the fallback path. Wildcard patterns that match multiple bodies create one site per matched body.- Parameters:
body_pattern¶ – Regex pattern matched against body labels in the prototype builder (e.g.
"Robot/link0"or"Robot/finger.*"for multi-body wildcards), orNonefor global sites (world-origin reference, etc.).xform¶ – Site transform relative to body.
per_world¶ – When
True,body_patternmust beNoneand one bodyless site is created in each cloned world’s frame.
- Returns:
Assigned site label suffix.
- classmethod clear()#
Clear all Newton-specific state (callbacks cleared by super().close()).
- classmethod clear_callbacks() None#
Remove all registered callbacks.
Do NOT reset
_callback_id— handle IDs must remain monotonically unique across the lifetime of the process. Resetting the counter would let a futureregister_callback()hand out an ID that an old, still-aliveCallbackHandle(e.g. on a sensor that has not been garbage-collected yet) holds, so when the old object eventually finalizes its__del__would deregister the new callback. This bit ovphysx’s kitless multi-context tests where twoInteractiveScene``s are created in sequence: the first scene's sensor would post-GC deregister the second scene's ``_initialize_callbackby ID collision, leaving the second sensor forever uninitialized.
- classmethod create_builder(up_axis: str | None = None, **kwargs) newton.ModelBuilder#
Create a
ModelBuilderconfigured with default settings.Forwards
NewtonShapeCfgdefaults onto Newton’s upstreamModelBuilder.default_shape_cfgviachecked_apply(). Falls back to wrapper defaults when no Newton config is active so rough-terrain margin/gap still apply during early construction.
- classmethod deregister_callback(callback_id: int | CallbackHandle) None#
Remove a registered callback.
- Parameters:
callback_id¶ – The ID or CallbackHandle returned by register_callback().
- classmethod dispatch_event(event: PhysicsEvent, payload: Any = None) None#
Dispatch an event to all registered callbacks.
This is the default implementation using simple callback lists. Subclasses may override or extend with platform-specific dispatch.
- classmethod fix_articulation_root(articulation_prim: Any, stage: Any = None) Any#
Ensure that an articulation root has one enabled world fixed joint.
The base implementation leaves the root in place. Backends whose parser requires a different root topology may relocate it and return the resulting root prim.
- Parameters:
- Returns:
The articulation-root prim after backend normalization.
- Raises:
NotImplementedError – If a new joint is needed and the root is not a rigid body.
- classmethod forward() None#
Update articulation kinematics without stepping physics.
Update body poses from joint coordinates via the solver-specialized FK delegate (
_eval_fk, bound to the active subclass’s_eval_fk_impl()ininitialize_solver()). Only the articulations flagged dirty in_fk_reset_maskand_world_reset_mask(seeinvalidate_fk()) are updated. The masks are consumed (zeroed) afterwards so the nextstep()does not redundantly re-solve them.The delegate (rather than a direct
cls._eval_fk_implcall) is required because the data layer invokesNewtonManager.forward()on the base class, whereclsis the baseNewtonManager; the bound delegate dispatches to the concrete subclass override.
- classmethod get_contacts() Contacts | None#
Get the current Newton contact buffer, if the active solver exposes one.
- classmethod get_control() newton.Control#
Get the control object.
- classmethod get_model() newton.Model#
Get the Newton model.
When the active sim backend is Newton this returns the manager’s own authoritative model. When the active sim backend is PhysX a shadow Newton model is built lazily (from the visualizer prebuilt artifact) so renderers/visualizers that operate on Newton
ModelandStatecan still drive a PhysX-simulated scene.
- classmethod get_physics_sim_view() list#
Get the list of registered views.
Assets can append their views to this list, and sensors can access them. Returns a list that callers can append to.
- Returns:
List of registered views (e.g., NewtonArticulationView instances).
- classmethod get_scene_data_backend() SceneDataBackend | None#
Return the SceneDataBackend for the SceneDataProvider.
- classmethod get_scene_data_provider() SceneDataProvider#
Return the active scene data provider.
- classmethod get_state(scene_data_provider: SceneDataProvider | None = None) newton.State#
Get the current Newton state for visualization.
Use this method from visualizers/renderers/video recorders that need a backend-agnostic Newton
State. When the sim backend is PhysX this refreshes the shadow_state_0.body_qfrom the live PhysX scene viaupdate_visualization_state()before returning, so callers never observe stale transforms. Under the Newton sim backend, pending forward kinematics is applied before returning the live state.
- classmethod get_state_0() newton.State#
Get the current state.
- classmethod get_state_1() newton.State#
Get the next state.
- classmethod handles_decimation() bool#
Truewhenstep()executes the full decimation loop internally.This is the case when all Newton actuators are CUDA-graph-safe. The full decimation loop (including the trivial
decimation=1case) is folded into a singlestep()call.
- classmethod initialize(sim_context: SimulationContext) None#
Initialize the manager with simulation context.
- Parameters:
sim_context¶ – Parent simulation context.
TODO: Subclass should not override this method, once deformables supported on Newton import_usd, this can be unified with NewtonManager’s implementation.
- classmethod initialize_solver() None#
Initialize the solver and collision pipeline.
Thin orchestrator: delegates solver construction to
_build_solver()(overridden by each solver subclass), allocates the collision pipeline (when applicable) via_initialize_contacts(), then sets up cubric bindings and either captures the CUDA graph immediately or defers capture until the firststep()call (RTX-active path).Warning
When using a CUDA-enabled device, the simulation is graphed. This means the function steps the simulation once to capture the graph, so it should only be called after everything else in the simulation is initialized.
- classmethod instantiate_builder_from_stage()#
Create builder from USD stage with special treatment for deformable bodies, as these are not read from USD yet.
Detects env Xforms (e.g.
/World/Env_0,/World/Env_1) and builds each as a separate Newton world viabegin_world/end_world. Falls back to a flatadd_usdwhen no env Xforms are found.TODO: Subclass should not override this method, once deformables supported on Newton import_usd, this can be unified with NewtonManager’s implementation.
- classmethod invalidate_fk(env_mask: wp.array | None = None, env_ids: wp.array | None = None, articulation_ids: wp.array | None = None) None#
Mark environments as needing FK recomputation and solver reset.
Called by asset write methods that modify joint coordinates or root transforms. The masks are consumed by the next forward, raw-state, rendering, or physics-step boundary.
- Parameters:
env_mask¶ – Boolean mask of dirtied environments. Shape
(num_envs,). Used by_maskwrite methods.env_ids¶ – Integer indices of dirtied environments. Used by
_indexwrite methods.articulation_ids¶ – Mapping from
(world, arti)to model articulation index. Shape(world_count, count_per_world). Obtained fromArticulationView.articulation_ids.
- classmethod is_fabric_enabled() bool#
Check if fabric interface is enabled (not applicable for Newton).
- classmethod provides_implicit_damping() bool#
Whether this backend’s integrator has implicit numerical damping.
With implicit damping (PhysX, OV-PhysX) a camera policy can infer velocity from a single frame. Without it (Newton’s symplectic integrator) the policy needs a temporal cue in the observation (e.g. frame stacking).
The base default is
True; backends without implicit damping override toFalse.- Returns:
Whether the backend’s integrator has implicit numerical damping.
- classmethod register_callback(callback: Callable, event: PhysicsEvent, order: int = 0, name: str | None = None, wrap_weak_ref: bool = True) CallbackHandle#
Register a callback. Passes event to parent class.
- classmethod register_particle_visual_prim(prim_path: str, particle_offset: int, particle_count: int, sync_frequency: int = 1) None#
Register a
UsdGeom.Pointsprim whose points mirror a slice of Newton’s particle state.
- classmethod register_post_actuator_callback(callback: Callable[[], None]) None#
Append a hook to the list invoked after the actuator step on every iteration.
Each callback runs inside the captured CUDA graph (when
_is_all_graphable()isTrue) right afterNewtonActuatorAdapter.step()and before the solver substeps, so kernel writes tostate/controlare visible to the integrator on the same iteration. Multiple articulations register their own implicit-DOF telemetry / FF-routing kernels here; all registered callbacks fire in registration order each step.
- classmethod register_post_step_callback(callback: Callable[[], None]) None#
Append a hook to the list invoked after the last solver substep on every step.
Each callback runs inside the stepped (and, when
_is_all_graphable()isTrue, captured) region right after the final solver substep of the decimation loop and before_update_sensors(), so the launches it issues are recorded into every captured CUDA graph and replayed on each tick. Callbacks must be graph-safe (fixed shapes, no host branching on device data) and must be registered before capture. Articulations with non-identity ordering register their backend-to-user state republish here; all registered callbacks fire in registration order each step.
- classmethod request_extended_contact_attribute(attr: str) None#
Request an extended contact attribute (e.g.
"force").Sensors call this during
__init__, before model finalization. Attributes are forwarded to the model instart_simulation()so that subsequentContactscreation includes them.- Parameters:
attr¶ – Contact attribute name.
- classmethod request_extended_state_attribute(attr: str) None#
Request an extended state attribute (e.g.
"body_qdd").Sensors call this during
__init__, before model finalization. Attributes are forwarded to the builder instart_simulation()so that subsequentmodel.state()calls allocate them.- Parameters:
attr¶ – State attribute name (must be in
State.EXTENDED_ATTRIBUTES).
- classmethod reset(soft: bool = False) None#
Reset physics simulation.
A hard reset (
soft=False) re-finalizes the Newton model, reallocating its device arrays. The cached collision pipeline, contacts and any captured CUDA graph reference the old buffers, so they are released here and rebuilt against the re-finalized model byinitialize_solver(). This avoids the illegal CUDA memory access (CUDA error 700) that would otherwise occur on the first step after a hard reset.A soft reset (
soft=True) skips this full reinitialization and reuses the existing model, solver, collision pipeline and CUDA graph.- Parameters:
soft¶ – If True, skip full reinitialization.
- static safe_callback_invoke(fn: Callable, *args, physics_manager: type[PhysicsManager] | None = None) None#
Invoke a callback, catching exceptions that would be swallowed by external event buses.
Ignores
ReferenceError(from garbage-collected weakref proxies). All other exceptions are forwarded to physics_manager.``store_callback_exception`` when available (see note below), or re-raised immediately otherwise.- Note (Octi):
The carb event bus used by PhysX/Omniverse silently swallows exceptions raised inside callbacks.
PhysxManagerworks around this by storing the exception and re-raising it after event dispatch completes (inreset()/step()). Backends that dispatch events directly (e.g. Newton) don’t need this — exceptions propagate normally — sostore_callback_exceptionis not called for them. This is a known wart; a cleaner solution is actively being explored.
- classmethod set_decimation(decimation: int) None#
Set the decimation count and re-capture the CUDA graph.
When all actuators are graphable the entire decimation loop (actuators + solver substeps, repeated decimation times) is captured as a single CUDA graph.
If a CUDA graph was previously captured, it is automatically re-captured with the new decimation count using the same strategy as
start_simulation(): standardwp.ScopedCapturewhen no USDRT stage is active, or deferred relaxed capture when RTX is running.
- classmethod start_simulation() None#
Start simulation by finalizing model and initializing state.
This function finalizes the model and initializes the simulation state. Note: Collision pipeline is initialized later in initialize_solver() after we determine whether the solver needs external collision detection.
TODO: Subclass should not override this method, missing piece is having Newton bind a surface mesh to volume deformable tetrahedral mesh in addition to removing the deformable_registry data structure.
- classmethod sync_particles_to_usd() None#
Write Newton particle positions to USD/Fabric for Kit viewport rendering.
Two prim families are synced from
state_0.particle_q:Fabric mesh prims tagged with
newton:particleOffset/newton:particleCount(deformable visual meshes) receive local-frame points on the GPU via_sync_fabric_mesh_particles().UsdGeom.Pointsprims registered throughregister_particle_visual_prim()(MPM particle clouds) receive world-frame points via_sync_particle_points_prims().
No-op when there is no particle state or nothing changed since the last sync.
- classmethod sync_transforms_to_usd() None#
Write Newton body_q to USD Fabric world matrices for Kit viewport / RTX rendering.
No-op when
_usdrt_stageis None (i.e. Kit visualizer is not active) or when transforms have not changed since the last sync.Called at render cadence by
pre_render()(viarender()). Physics stepping marks transforms dirty via_mark_transforms_dirty()so that the expensive Fabric hierarchy update only runs once per render frame rather than after every physics step.Uses
wp.fabricarraydirectly (noisaacsim.physics.newtonextension needed). The Warp kernel readsstate_0.body_q[newton_index[i]]and writes the correspondingmat44dtoomni:fabric:worldMatrixfor each prim.When cubric is available the method mirrors PhysX’s
DirectGpuHelperpattern: pause Fabric change tracking, write transforms, resume tracking, then callIAdapter::computeon the GPU to propagate the hierarchy and notify the Fabric Scene Delegate. Otherwise it falls back to the CPUupdate_world_xforms()path.
- classmethod unregister_post_step_callback(callback: Callable[[], None]) None#
Remove a previously registered post-step callback.
Symmetric to
register_post_step_callback(), this lets an articulation deregister its republish hook when its callbacks are cleared so the bound method does not linger on the class-level list after the articulation is gone. Removing a callback that was never registered (or was already removed) is a safe no-op, matching the tolerant deregistration of other handles.
- classmethod update_visualization_state(scene_data_provider: SceneDataProvider | None = None) None#
Refresh visualization state for the active sim backend.
Newton sim backend: no-op —
_state_0is the live, authoritative state already advanced bystep()/ forward kinematics.PhysX sim backend: pull rigid-body transforms from the
SceneDataProviderand write them into the shadow_state_0.body_qso Newton-native consumers (Newton renderer, Newton/Rerun/Viser visualizers, OVRTX renderer, Newton GL video) see fresh poses.Invoked lazily from
get_state()so consumers do not need to coordinate the sync explicitly.