isaaclab_contrib.deformable#
Sub-package for externally contributed assets.
This package contains contributed code that depends on Isaac Lab’s public API but is not required for core functionality. This includes implementations of Newton solvers for deformables.
Classes
A deformable object asset class (Newton backend). |
|
Data container for a deformable object (Newton backend). |
|
Configuration for the Vertex Block Descent (VBD) solver. |
|
Configuration for the coupled rigid-body MJWarp + VBD solver. |
|
Configuration for the coupled rigid-body Featherstone + VBD solver. |
|
Global Newton model parameters. |
|
|
|
|
|
|
|
Deformable Object#
- class isaaclab_contrib.deformable.deformable_object.DeformableObject[source]#
Bases:
BaseDeformableObjectA deformable object asset class (Newton backend).
This class manages cloth/deformable bodies in the Newton physics engine. Newton stores all particles in flat arrays (
state.particle_q,state.particle_qd). This class builds a per-instance indexing layer on top of those flat arrays, enabling the standardBaseDeformableObjectinterface for reading/writing nodal state.The cloth mesh is added to the Newton
ModelBuilderduring theMODEL_INITphase. The mesh data is read from the USD prim atcfg.prim_path, and cloth simulation parameters (density, stiffness, etc.) come fromDeformableObjectCfg.Attributes:
Configuration instance for the deformable object.
Data container for the deformable object.
Number of instances of the asset.
Number of bodies in the asset.
The maximum number of simulation mesh vertices per deformable body.
Memory device for computation.
Whether the asset has a debug visualization implemented.
Whether the asset is initialized.
Methods:
__init__(cfg)Initialize the deformable object.
reset([env_ids, env_mask])Reset the deformable object.
Apply kinematic targets to the Newton simulation.
update(dt)Update the internal buffers.
write_nodal_pos_to_sim_index(nodal_pos[, ...])Set the nodal positions over selected environment indices into the simulation.
write_nodal_velocity_to_sim_index(nodal_vel)Set the nodal velocity over selected environment indices into the simulation.
Set the kinematic targets of the simulation mesh for the deformable bodies.
write_nodal_state_to_sim_mask(nodal_state[, ...])Set the nodal state over selected environment mask into the simulation.
write_nodal_pos_to_sim_mask(nodal_pos[, ...])Set the nodal positions over selected environment mask into the simulation.
write_nodal_velocity_to_sim_mask(nodal_vel)Set the nodal velocity over selected environment mask into the simulation.
Set the kinematic targets over selected environment mask into the target buffer.
assert_shape_and_dtype(tensor, shape, dtype)Assert the shape and dtype of a tensor or warp array.
assert_shape_and_dtype_mask(tensor, masks, dtype)Assert the shape of a tensor or warp array against mask dimensions.
set_debug_vis(debug_vis)Sets whether to visualize the asset data.
set_visibility(visible[, env_ids])Set the visibility of the prims corresponding to the asset.
transform_nodal_pos(nodal_pos[, pos, quat])Transform the nodal positions based on the pose transformation.
write_nodal_kinematic_target_to_sim(targets)Deprecated.
write_nodal_pos_to_sim(nodal_pos[, env_ids])Deprecated.
write_nodal_state_to_sim(nodal_state[, env_ids])Deprecated.
write_nodal_state_to_sim_index(nodal_state)Set the nodal state over selected environment indices into the simulation.
write_nodal_velocity_to_sim(nodal_vel[, env_ids])Deprecated.
- cfg: DeformableObjectCfg#
Configuration instance for the deformable object.
- __init__(cfg: DeformableObjectCfg)[source]#
Initialize the deformable object.
- Parameters:
cfg – A configuration instance.
- property data: DeformableObjectData#
Data container for the deformable object.
- property num_bodies: int#
Number of bodies in the asset.
This is always 1 since each object is a single deformable body.
- property max_sim_vertices_per_body: int#
The maximum number of simulation mesh vertices per deformable body.
- reset(env_ids: Sequence[int] | None = None, env_mask: wp.array | None = None) None[source]#
Reset the deformable object.
No-op to match the PhysX deformable object convention.
- Parameters:
env_ids – Environment indices. If None, then all indices are used.
env_mask – Environment mask. If None, then all the instances are updated. Shape is (num_instances,).
- write_data_to_sim()[source]#
Apply kinematic targets to the Newton simulation.
Reads the stored kinematic target buffer and enforces it on particles: kinematic particles (flag=0) get inv_mass=0, particle_flags=0, target position, and zero velocity; free particles (flag=1) get their original inv_mass and particle_flags=1 (ACTIVE) restored.
Writes to both
state_0andstate_1so kinematic positions survive the state swaps that happen between substeps.
- update(dt: float)[source]#
Update the internal buffers.
- Parameters:
dt – The amount of time passed from last
update()call [s].
- write_nodal_pos_to_sim_index(nodal_pos: torch.Tensor | wp.array | ProxyArray, env_ids: Sequence[int] | torch.Tensor | wp.array | None = None, full_data: bool = False) None[source]#
Set the nodal positions over selected environment indices into the simulation.
- Parameters:
nodal_pos – Nodal positions in simulation frame [m]. Shape is (len(env_ids), max_sim_vertices_per_body, 3) or (num_instances, max_sim_vertices_per_body, 3).
env_ids – Environment indices. If None, then all indices are used.
full_data – Whether to expect full data. Defaults to False.
- write_nodal_velocity_to_sim_index(nodal_vel: torch.Tensor | wp.array | ProxyArray, env_ids: Sequence[int] | torch.Tensor | wp.array | None = None, full_data: bool = False) None[source]#
Set the nodal velocity over selected environment indices into the simulation.
- Parameters:
nodal_vel – Nodal velocities in simulation frame [m/s]. Shape is (len(env_ids), max_sim_vertices_per_body, 3) or (num_instances, max_sim_vertices_per_body, 3).
env_ids – Environment indices. If None, then all indices are used.
full_data – Whether to expect full data. Defaults to False.
- write_nodal_kinematic_target_to_sim_index(targets: torch.Tensor | wp.array | ProxyArray, env_ids: Sequence[int] | torch.Tensor | wp.array | None = None, full_data: bool = False) None[source]#
Set the kinematic targets of the simulation mesh for the deformable bodies.
Newton has no native kinematic target API. Instead: - Kinematic (flag=0.0): set
particle_inv_massto 0, write target pos, zero vel - Free (flag=1.0): restore originalparticle_inv_mass- Parameters:
targets – The kinematic targets comprising of nodal positions and flags [m]. Shape is (len(env_ids), max_sim_vertices_per_body, 4) or (num_instances, max_sim_vertices_per_body, 4).
env_ids – Environment indices. If None, then all indices are used.
full_data – Whether to expect full data. Defaults to False.
- write_nodal_state_to_sim_mask(nodal_state: torch.Tensor | wp.array | ProxyArray, env_mask: wp.array | torch.Tensor | None = None) None[source]#
Set the nodal state over selected environment mask into the simulation.
- Parameters:
nodal_state – Nodal state in simulation frame [m, m/s]. Shape is (num_instances, max_sim_vertices_per_body, 6).
env_mask – Environment mask. If None, then all indices are used. Shape is (num_instances,).
- write_nodal_pos_to_sim_mask(nodal_pos: torch.Tensor | wp.array | ProxyArray, env_mask: wp.array | torch.Tensor | None = None) None[source]#
Set the nodal positions over selected environment mask into the simulation.
- Parameters:
nodal_pos – Nodal positions in simulation frame [m]. Shape is (num_instances, max_sim_vertices_per_body, 3).
env_mask – Environment mask. If None, then all indices are used. Shape is (num_instances,).
- write_nodal_velocity_to_sim_mask(nodal_vel: torch.Tensor | wp.array | ProxyArray, env_mask: wp.array | torch.Tensor | None = None) None[source]#
Set the nodal velocity over selected environment mask into the simulation.
- Parameters:
nodal_vel – Nodal velocities in simulation frame [m/s]. Shape is (num_instances, max_sim_vertices_per_body, 3).
env_mask – Environment mask. If None, then all indices are used. Shape is (num_instances,).
- write_nodal_kinematic_target_to_sim_mask(targets: torch.Tensor | wp.array | ProxyArray, env_mask: wp.array | torch.Tensor | None = None) None[source]#
Set the kinematic targets over selected environment mask into the target buffer.
- Parameters:
targets – The kinematic targets comprising of nodal positions and flags [m]. Shape is (num_instances, max_sim_vertices_per_body, 4).
env_mask – Environment mask. If None, then all indices are used. Shape is (num_instances,).
- assert_shape_and_dtype(tensor: float | torch.Tensor | wp.array, shape: tuple[int, ...], dtype: type, name: str = '') None#
Assert the shape and dtype of a tensor or warp array.
Controlled by
AssetBaseCfg.disable_shape_checks. When checks are disabled this method is a no-op.- Parameters:
tensor – The tensor or warp array to assert the shape of. Floats are skipped.
shape – The expected leading dimensions (e.g.
(num_envs, num_joints)).dtype – The expected warp dtype.
name – Optional parameter name for error messages.
- assert_shape_and_dtype_mask(tensor: float | torch.Tensor | wp.array, masks: tuple[wp.array, ...], dtype: type, name: str = '', trailing_dims: tuple[int, ...] = ()) None#
Assert the shape of a tensor or warp array against mask dimensions.
Mask-based write methods expect full-sized data — one element per entry in each mask dimension, regardless of how many entries are
True. The expected leading shape is therefore(mask_0.shape[0], mask_1.shape[0], ...)(i.e. the total size of each dimension, not the number of selected entries).Controlled by
AssetBaseCfg.disable_shape_checks. When checks are disabled this method is a no-op.- Parameters:
tensor – The tensor or warp array to assert the shape of. Floats are skipped.
masks – Tuple of mask arrays whose
shape[0]dimensions form the expected leading shape.dtype – The expected warp dtype.
name – Optional parameter name for error messages.
trailing_dims – Extra trailing dimensions to append (e.g.
(9,)for inertias withwp.float32).
- property has_debug_vis_implementation: bool#
Whether the asset has a debug visualization implemented.
- property is_initialized: bool#
Whether the asset is initialized.
Returns True if the asset is initialized, False otherwise.
- set_debug_vis(debug_vis: bool) bool#
Sets whether to visualize the asset data.
- Parameters:
debug_vis – Whether to visualize the asset data.
- Returns:
Whether the debug visualization was successfully set. False if the asset does not support debug visualization.
- set_visibility(visible: bool, env_ids: Sequence[int] | None = None)#
Set the visibility of the prims corresponding to the asset.
This operation affects the visibility of the prims corresponding to the asset in the USD stage. It is useful for toggling the visibility of the asset in the simulator. For instance, one can hide the asset when it is not being used to reduce the rendering overhead.
Note
This operation uses the PXR API to set the visibility of the prims. Thus, the operation may have an overhead if the number of prims is large.
- Parameters:
visible – Whether to make the prims visible or not.
env_ids – The indices of the object to set visibility. Defaults to None (all instances).
- transform_nodal_pos(nodal_pos: torch.Tensor, pos: torch.Tensor | None = None, quat: torch.Tensor | None = None) torch.Tensor#
Transform the nodal positions based on the pose transformation.
This function computes the transformation of the nodal positions based on the pose transformation. It multiplies the nodal positions with the rotation matrix of the pose and adds the translation. Internally, it calls the
isaaclab.utils.math.transform_points()function.- Parameters:
nodal_pos – The nodal positions in the simulation frame [m]. Shape is (N, max_sim_vertices_per_body, 3).
pos – The position transformation [m]. Shape is (N, 3). Defaults to None, in which case the position is assumed to be zero.
quat – The orientation transformation as quaternion (x, y, z, w). Shape is (N, 4). Defaults to None, in which case the orientation is assumed to be identity.
- Returns:
The transformed nodal positions [m]. Shape is (N, max_sim_vertices_per_body, 3).
- write_nodal_kinematic_target_to_sim(targets: torch.Tensor | wp.array | ProxyArray, env_ids: Sequence[int] | torch.Tensor | wp.array | None = None) None#
Deprecated. Please use
write_nodal_kinematic_target_to_sim_index()instead.
- write_nodal_pos_to_sim(nodal_pos: torch.Tensor | wp.array | ProxyArray, env_ids: Sequence[int] | torch.Tensor | wp.array | None = None) None#
Deprecated. Please use
write_nodal_pos_to_sim_index()instead.
- write_nodal_state_to_sim(nodal_state: torch.Tensor | wp.array | ProxyArray, env_ids: Sequence[int] | torch.Tensor | wp.array | None = None) None#
Deprecated. Please use
write_nodal_state_to_sim_index()instead.
- write_nodal_state_to_sim_index(nodal_state: torch.Tensor | wp.array | ProxyArray, env_ids: Sequence[int] | torch.Tensor | wp.array | None = None, full_data: bool = False) None#
Set the nodal state over selected environment indices into the simulation.
The nodal state comprises of the nodal positions and velocities. Since these are nodes, the velocity only has a translational component. All the quantities are in the simulation frame.
- Parameters:
nodal_state – Nodal state in simulation frame [m, m/s]. Shape is (len(env_ids), max_sim_vertices_per_body, 6) or (num_instances, max_sim_vertices_per_body, 6).
env_ids – Environment indices. If None, then all indices are used.
full_data – Whether to expect full data. Defaults to False.
- write_nodal_velocity_to_sim(nodal_vel: torch.Tensor | wp.array | ProxyArray, env_ids: Sequence[int] | torch.Tensor | wp.array | None = None) None#
Deprecated. Please use
write_nodal_velocity_to_sim_index()instead.
- class isaaclab_contrib.deformable.deformable_object_data.DeformableObjectData[source]#
Bases:
BaseDeformableObjectDataData container for a deformable object (Newton backend).
Newton stores all particles in flat arrays (
model.particle_q,state.particle_qd). This data class builds a per-instance view by gathering from the flat arrays using precomputed offsets.The data is lazily updated, meaning that the data is only updated when it is accessed.
Attributes:
Default nodal state
[nodal_pos, nodal_vel]in simulation world frame.Simulation mesh kinematic targets for the deformable bodies.
Nodal positions in simulation world frame [m].
Nodal velocities in simulation world frame [m/s].
Nodal state
[nodal_pos, nodal_vel]in simulation world frame [m, m/s].Root position from nodal positions [m].
Root velocity from nodal velocities [m/s].
Methods:
update(dt)Update the data for the deformable object.
- default_nodal_state_w: ProxyArray = None#
Default nodal state
[nodal_pos, nodal_vel]in simulation world frame. Shape is (num_instances, particles_per_body) with dtype vec6f.
- nodal_kinematic_target: ProxyArray = None#
Simulation mesh kinematic targets for the deformable bodies. Shape is (num_instances, particles_per_body) with dtype vec4f.
- property nodal_pos_w: ProxyArray#
Nodal positions in simulation world frame [m]. Shape is (num_instances, particles_per_body) vec3f.
- property nodal_vel_w: ProxyArray#
Nodal velocities in simulation world frame [m/s]. Shape is (num_instances, particles_per_body) vec3f.
- property nodal_state_w: ProxyArray#
Nodal state
[nodal_pos, nodal_vel]in simulation world frame [m, m/s].Shape is (num_instances, particles_per_body) vec6f.
- property root_pos_w: ProxyArray#
Root position from nodal positions [m]. Shape is (num_instances,) vec3f.
This quantity is computed as the mean of the nodal positions.
- update(dt: float)#
Update the data for the deformable object.
- Parameters:
dt – The time step for the update [s]. This must be a positive value.
- property root_vel_w: ProxyArray#
Root velocity from nodal velocities [m/s]. Shape is (num_instances,) vec3f.
This quantity is computed as the mean of the nodal velocities.
Newton Solver Configurations#
- class isaaclab_contrib.deformable.newton_manager_cfg.VBDSolverCfg[source]#
Bases:
NewtonSolverCfgConfiguration for the Vertex Block Descent (VBD) solver.
Supports particle simulation (cloth, soft bodies) and coupled rigid-body systems. Requires
ModelBuilder.color()to be called beforefinalize()to build the parallel vertex colouring needed by the solver.Attributes:
Manager class for the VBD solver.
Solver type metadata (deprecated).
Number of VBD iterations per substep.
Whether rigid bodies are integrated by an external solver (one-way coupling).
Whether to enable VBD deformable's self-contact.
Particle radius used for self-contact detection [m].
Self-contact detection margin [m].
Controls how frequently particle self-contact detection is applied.
Preallocation size for each vertex's vertex-triangle collision buffer.
Preallocation size for each edge's edge-edge collision buffer.
Maximum topological distance (in rings) below which self-contacts are discarded.
World-space distance threshold for filtering topologically close primitives [m].
Initial stiffness seed for all rigid body contacts (body-body and body-particle) [N/m].
- class_type: type[NewtonManager] | str#
Manager class for the VBD solver.
- solver_type: str#
Solver type metadata (deprecated).
Deprecated since version Manager: dispatch is now driven by
class_type; this field is retained as metadata for logging and debugging only. Do not branch onsolver_typein new code.
- integrate_with_external_rigid_solver: bool#
Whether rigid bodies are integrated by an external solver (one-way coupling).
Set to
Truewhen coupling cloth with a separate rigid-body solver (e.g.SolverFeatherstone) so that VBD only integrates the cloth particles.
- particle_self_contact_margin: float#
Self-contact detection margin [m]. Should be >= particle_self_contact_radius.
- particle_collision_detection_interval: int#
Controls how frequently particle self-contact detection is applied.
If set to a value < 0, collision detection is only performed once before the initialization step. If set to 0, collision detection is applied twice: once before and once immediately after initialization. If set to a value
k>= 1, collision detection is applied before everykVBD iterations.
- particle_vertex_contact_buffer_size: int#
Preallocation size for each vertex’s vertex-triangle collision buffer.
- particle_edge_contact_buffer_size: int#
Preallocation size for each edge’s edge-edge collision buffer.
- particle_topological_contact_filter_threshold: int#
Maximum topological distance (in rings) below which self-contacts are discarded.
Only used when
particle_enable_self_contactisTrue. Increase to suppress contacts between closely connected mesh elements. Values > 3 significantly increase computation time.
- class isaaclab_contrib.deformable.newton_manager_cfg.CoupledMJWarpVBDSolverCfg[source]#
Bases:
NewtonSolverCfgConfiguration for the coupled rigid-body MJWarp + VBD solver.
Alternates a rigid-body solver (
MJWarpSolverCfg) and a soft-body solver (SolverVBD) per substep. The coupling direction is controlled bycoupling_mode:"one_way"(default): Rigid solver advances first, then VBD reads the updated body poses. The rigid solver does not feel particle contacts."two_way": Same-substep two-way coupling with normal + Coulomb friction. Contact detection runs first, reaction forces are injected intobody_f, then the rigid solver readsbody_fand feels resistance from the deformable object. The friction reaction lets actuators carry the object against gravity during a lift.
Attributes:
Manager class for the VBD solver.
Solver type metadata (deprecated).
Rigid-body sub-solver configuration for
MJWarpSolverCfg.VBD sub-solver configuration for cloth/particle dynamics.
Coupling direction between the rigid and VBD solvers.
- class_type: type[NewtonManager] | str#
Manager class for the VBD solver.
- solver_type: str#
Solver type metadata (deprecated).
Deprecated since version Manager: dispatch is now driven by
class_type; this field is retained as metadata for logging and debugging only. Do not branch onsolver_typein new code.
- rigid_solver_cfg: MJWarpSolverCfg#
Rigid-body sub-solver configuration for
MJWarpSolverCfg.
- soft_solver_cfg: VBDSolverCfg#
VBD sub-solver configuration for cloth/particle dynamics.
- class isaaclab_contrib.deformable.newton_manager_cfg.CoupledFeatherstoneVBDSolverCfg[source]#
Bases:
NewtonSolverCfgConfiguration for the coupled rigid-body Featherstone + VBD solver.
Alternates a rigid-body solver (
FeatherstoneSolverCfg) and a soft-body solver (SolverVBD) per substep. The coupling direction is controlled bycoupling_mode:"kinematic"(default): Rigid -> soft only. Rigid bodies are kinematically updated by the rigid solver, then VBD reads the updated body poses and reacts to them. The rigid solver does not feel particle contacts."one_way": Rigid solver advances first, then VBD reads the updated body poses. The rigid solver does not feel particle contacts."two_way": Same-substep two-way coupling with normal + Coulomb friction. Contact detection runs first, reaction forces are injected intobody_f, then the rigid solver readsbody_fand feels resistance from the deformable object. The friction reaction lets actuators carry the object against gravity during a lift.
Attributes:
Manager class for the VBD solver.
Solver type metadata (deprecated).
Rigid-body sub-solver configuration for
FeatherstoneSolverCfg.VBD sub-solver configuration for cloth/particle dynamics.
Coupling direction between the rigid and VBD solvers.
- class_type: type[NewtonManager] | str#
Manager class for the VBD solver.
- solver_type: str#
Solver type metadata (deprecated).
Deprecated since version Manager: dispatch is now driven by
class_type; this field is retained as metadata for logging and debugging only. Do not branch onsolver_typein new code.
- rigid_solver_cfg: FeatherstoneSolverCfg#
Rigid-body sub-solver configuration for
FeatherstoneSolverCfg.
- soft_solver_cfg: VBDSolverCfg#
VBD sub-solver configuration for cloth/particle dynamics.
- class isaaclab_contrib.deformable.newton_manager_cfg.NewtonModelCfg[source]#
Bases:
objectGlobal Newton model parameters.
These parameters are applied to the
newton.Modelafter finalization. They control model-level contact behavior shared across all objects.Attributes:
Body-particle contact stiffness [N/m].
Body-particle contact damping [N*s/m].
Body-particle contact friction coefficient.
Per-shape contact stiffness override [N/m].
Per-shape contact damping override [N*s/m].
Per-shape friction coefficient override [dimensionless].
- soft_contact_ke: float#
Body-particle contact stiffness [N/m].
Controls the stiffness of the penalty force of contacts between cloth/soft-body particles and rigid body shapes, and self-contacts of cloth/soft-body particles. The effective stiffness per contact is the average of this value and the rigid shape’s material stiffness.
- soft_contact_mu: float#
Body-particle contact friction coefficient.
The effective friction per contact is
sqrt(soft_contact_mu * shape_material_mu). Increase for better grip (e.g. gripper picking up cloth).
- shape_material_ke: float | None#
Per-shape contact stiffness override [N/m].
When set, all collision shapes in the model will have their contact stiffness overwritten to this value. If
None(default), the per-shape values parsed from USD/MJCF are kept.
Newton Solver Managers#
- class isaaclab_contrib.deformable.vbd_manager.NewtonVBDManager[source]#
Bases:
NewtonManagerNewtonManagerspecialization for the VBD solver.Always uses Newton’s
CollisionPipelinefor contact handling.Methods:
initialize(sim_context)Initialize the manager with simulation context.
Start simulation by finalizing model and initializing state.
Create builder from USD stage with special treatment for deformable bodies, as these are not read from USD yet.
Opt an articulation into the Newton actuator fast path.
add_contact_sensor([body_names_expr, ...])Add a contact sensor for reporting contacts between bodies/shapes.
add_frame_transform_sensor(shapes, ...)Add a frame transform sensor for measuring relative transforms.
add_imu_sensor(sites)Add an IMU sensor for measuring acceleration and angular velocity at sites.
add_model_change(change)Register a model change to notify the solver.
Hook after visualizers have stepped during
render().cl_register_site(body_pattern, xform)Register a site request for injection into prototypes before replication.
clear()Clear all Newton-specific state (callbacks cleared by super().close()).
Remove all registered callbacks.
close()Clean up Newton physics resources.
create_builder([up_axis])Create a
ModelBuilderconfigured with default settings.deregister_callback(callback_id)Remove a registered callback.
dispatch_event(event[, payload])Dispatch an event to all registered callbacks.
forward()Update articulation kinematics without stepping physics.
Get the tensor backend being used ("numpy" or "torch").
Get the control object.
Get the physics simulation device.
get_dt()Get the physics timestep.
Get the Newton model.
Get the physics timestep in seconds.
Get the list of registered views.
Return the SceneDataBackend for the SceneDataProvider.
Get the current simulation time in seconds.
Get the solver substep timestep.
get_state([scene_data_provider])Get the current Newton state for visualization.
Get the current state.
Get the next state.
Truewhenstep()executes the full decimation loop internally.Initialize the solver and collision pipeline.
invalidate_fk([env_mask, env_ids, ...])Mark environments as needing FK recomputation and solver reset.
Check if fabric interface is enabled (not applicable for Newton).
pause()Pause physics simulation.
play()Start or resume physics simulation.
Flush deferred Fabric writes before cameras/visualizers read the scene.
register_callback(callback, event[, order, ...])Register a callback.
register_post_actuator_callback(callback)Append a hook to the list invoked after the actuator step on every iteration.
Request an extended contact attribute (e.g.
"force").Request an extended state attribute (e.g.
"body_qdd").reset([soft])Reset physics simulation.
safe_callback_invoke(fn, *args[, ...])Invoke a callback, catching exceptions that would be swallowed by external event buses.
set_builder(builder)Set the Newton model builder.
set_decimation(decimation)Set the decimation count and re-capture the CUDA graph.
step()Step the physics simulation.
stop()Stop physics simulation.
Write Newton particle_q to Fabric mesh point arrays for Kit viewport rendering.
Write Newton body_q to USD Fabric world matrices for Kit viewport / RTX rendering.
update_visualization_state([scene_data_provider])Refresh visualization state for the active sim backend.
Block until the timeline is playing.
- classmethod initialize(sim_context: SimulationContext) None[source]#
Initialize the manager with simulation context.
- Parameters:
sim_context – Parent simulation context.
TODO: Subclass should not override this method, once deformables supported on Newton import_usd, this can be unified with NewtonManager’s implementation.
- classmethod start_simulation() None[source]#
Start simulation by finalizing model and initializing state.
This function finalizes the model and initializes the simulation state. Note: Collision pipeline is initialized later in initialize_solver() after we determine whether the solver needs external collision detection.
TODO: Subclass should not override this method, missing piece is having Newton bind a surface mesh to volume deformable tetrahedral mesh in addition to removing the deformable_registry data structure.
- classmethod instantiate_builder_from_stage()[source]#
Create builder from USD stage with special treatment for deformable bodies, as these are not read from USD yet.
Detects env Xforms (e.g.
/World/Env_0,/World/Env_1) and builds each as a separate Newton world viabegin_world/end_world. Falls back to a flatadd_usdwhen no env Xforms are found.TODO: Subclass should not override this method, once deformables supported on Newton import_usd, this can be unified with NewtonManager’s implementation.
- classmethod activate_newton_actuator_path() None#
Opt an articulation into the Newton actuator fast path.
Idempotent — called by every Newton-fast-path articulation’s
_process_actuators_cfg:Sets
_use_newton_actuators_active, which_is_all_graphable()checks (adapter presence alone cannot distinguish the fast path from the standard Lab path).On first call, builds the single sim-level
NewtonActuatorAdapterover the full flat DOF layout; later calls reuse it.
- classmethod add_contact_sensor(body_names_expr: str | list[str] | None = None, shape_names_expr: str | list[str] | None = None, contact_partners_body_expr: str | list[str] | None = None, contact_partners_shape_expr: str | list[str] | None = None, verbose: bool = False) tuple[str | list[str] | None, str | list[str] | None, str | list[str] | None, str | list[str] | None]#
Add a contact sensor for reporting contacts between bodies/shapes.
Converts Isaac Lab pattern conventions (
.*regex, full USD paths) to fnmatch globs and delegates tonewton.sensors.SensorContact.- Parameters:
body_names_expr – Expression for body names to sense.
shape_names_expr – Expression for shape names to sense.
contact_partners_body_expr – Expression for contact partner body names.
contact_partners_shape_expr – Expression for contact partner shape names.
verbose – Print verbose information.
- classmethod add_frame_transform_sensor(shapes: list[int], reference_sites: list[int]) int#
Add a frame transform sensor for measuring relative transforms.
Creates a
SensorFrameTransformfrom pre-resolved shape and reference site indices, appends it to the internal list, and returns its index.- Parameters:
shapes – Ordered list of shape indices to measure.
reference_sites – 1:1 list of reference site indices (same length as shapes).
- Returns:
Index of the newly created sensor in
_newton_frame_transform_sensors.
- classmethod add_imu_sensor(sites: list[int]) int#
Add an IMU sensor for measuring acceleration and angular velocity at sites.
Creates a
newton.sensors.SensorIMUfrom pre-resolved site indices, appends it to the internal list, and returns its index.- Parameters:
sites – Ordered list of site indices (one per environment).
- Returns:
Index of the newly created sensor in the internal IMU sensor list.
- classmethod add_model_change(change: newton.solvers.SolverNotifyFlags) None#
Register a model change to notify the solver.
- classmethod after_visualizers_render() None#
Hook after visualizers have stepped during
render().Use for physics-backend sync (e.g. fabric) if needed. Recording pipelines (Kit/RTX, Newton GL video, etc.) run from
isaaclab.envs.utils.recording_hooksso they are not tied to a specific physics manager. Default is a no-op.
- classmethod cl_register_site(body_pattern: str | None, xform: warp.transform) str#
Register a site request for injection into prototypes before replication.
Sensors call this during
__init__. Sites are injected into prototype builders by_cl_inject_sites()(called fromnewton_replicate) beforeadd_builder, so they replicate correctly per-world.Identical
(body_pattern, transform)registrations share sites.The body_pattern is matched against prototype-local body labels (e.g.
"Robot/link.*") when replication is active, or against the flat builder’s body labels in the fallback path. Wildcard patterns that match multiple bodies create one site per matched body.- Parameters:
body_pattern – Regex pattern matched against body labels in the prototype builder (e.g.
"Robot/link0"or"Robot/finger.*"for multi-body wildcards), orNonefor global sites (world-origin reference, etc.).xform – Site transform relative to body.
- Returns:
Assigned site label suffix.
- classmethod clear()#
Clear all Newton-specific state (callbacks cleared by super().close()).
- classmethod clear_callbacks() None#
Remove all registered callbacks.
Do NOT reset
_callback_id— handle IDs must remain monotonically unique across the lifetime of the process. Resetting the counter would let a futureregister_callback()hand out an ID that an old, still-aliveCallbackHandle(e.g. on a sensor that has not been garbage-collected yet) holds, so when the old object eventually finalizes its__del__would deregister the new callback. This bit ovphysx’s kitless multi-context tests where twoInteractiveScene``s are created in sequence: the first scene's sensor would post-GC deregister the second scene's ``_initialize_callbackby ID collision, leaving the second sensor forever uninitialized.
- classmethod create_builder(up_axis: str | None = None, **kwargs) newton.ModelBuilder#
Create a
ModelBuilderconfigured with default settings.Forwards
NewtonShapeCfgdefaults onto Newton’s upstreamModelBuilder.default_shape_cfgviachecked_apply(). Falls back to wrapper defaults when no Newton config is active so rough-terrain margin/gap still apply during early construction.- Parameters:
up_axis – Override for the up-axis. Defaults to
None, which uses the manager’s_up_axis.**kwargs – Forwarded to
ModelBuilder.
- Returns:
New builder with up-axis and per-shape defaults (gap, margin) applied.
- classmethod deregister_callback(callback_id: int | CallbackHandle) None#
Remove a registered callback.
- Parameters:
callback_id – The ID or CallbackHandle returned by register_callback().
- classmethod dispatch_event(event: PhysicsEvent, payload: Any = None) None#
Dispatch an event to all registered callbacks.
This is the default implementation using simple callback lists. Subclasses may override or extend with platform-specific dispatch.
- Parameters:
event – The event to dispatch.
payload – Optional data to pass to callbacks.
- classmethod forward() None#
Update articulation kinematics without stepping physics.
Runs Newton’s generic forward kinematics (
eval_fk) over all articulations to compute body poses from joint coordinates. This is the full (unmasked) FK path used during initial setup. For incremental per-environment updates after resets, seeinvalidate_fk()which accumulates masks consumed bystep().
- classmethod get_control() newton.Control#
Get the control object.
- classmethod get_model() newton.Model#
Get the Newton model.
When the active sim backend is Newton this returns the manager’s own authoritative model. When the active sim backend is PhysX a shadow Newton model is built lazily (from the visualizer prebuilt artifact) so renderers/visualizers that operate on Newton
ModelandStatecan still drive a PhysX-simulated scene.
- classmethod get_physics_sim_view() list#
Get the list of registered views.
Assets can append their views to this list, and sensors can access them. Returns a list that callers can append to.
- Returns:
List of registered views (e.g., NewtonArticulationView instances).
- classmethod get_scene_data_backend() SceneDataBackend#
Return the SceneDataBackend for the SceneDataProvider.
- classmethod get_state(scene_data_provider=None) newton.State#
Get the current Newton state for visualization.
Use this method from visualizers/renderers/video recorders that need a backend-agnostic Newton
State. When the sim backend is PhysX this refreshes the shadow_state_0.body_qfrom the live PhysX scene viaupdate_visualization_state()before returning, so callers never observe stale transforms. Under the Newton sim backendupdate_visualization_state()is a no-op and this is equivalent toget_state_0().
- classmethod get_state_0() newton.State#
Get the current state.
- classmethod get_state_1() newton.State#
Get the next state.
- classmethod handles_decimation() bool#
Truewhenstep()executes the full decimation loop internally.This is the case when all Newton actuators are CUDA-graph-safe. The full decimation loop (including the trivial
decimation=1case) is folded into a singlestep()call.
- classmethod initialize_solver() None#
Initialize the solver and collision pipeline.
Thin orchestrator: delegates solver construction to
_build_solver()(overridden by each solver subclass), allocates the collision pipeline (when applicable) via_initialize_contacts(), then sets up cubric bindings and either captures the CUDA graph immediately or defers capture until the firststep()call (RTX-active path).Warning
When using a CUDA-enabled device, the simulation is graphed. This means the function steps the simulation once to capture the graph, so it should only be called after everything else in the simulation is initialized.
- classmethod invalidate_fk(env_mask: wp.array | None = None, env_ids: wp.array | None = None, articulation_ids: wp.array | None = None) None#
Mark environments as needing FK recomputation and solver reset.
Called by asset write methods that modify joint coordinates or root transforms. The masks are consumed in
step()before physics stepping.- Parameters:
env_mask – Boolean mask of dirtied environments. Shape
(num_envs,). Used by_maskwrite methods.env_ids – Integer indices of dirtied environments. Used by
_indexwrite methods.articulation_ids – Mapping from
(world, arti)to model articulation index. Shape(world_count, count_per_world). Obtained fromArticulationView.articulation_ids.
- classmethod is_fabric_enabled() bool#
Check if fabric interface is enabled (not applicable for Newton).
- classmethod pre_render() None#
Flush deferred Fabric writes before cameras/visualizers read the scene.
- classmethod register_callback(callback: Callable, event: PhysicsEvent, order: int = 0, name: str | None = None, wrap_weak_ref: bool = True) CallbackHandle#
Register a callback. Passes event to parent class.
- classmethod register_post_actuator_callback(callback: Callable[[], None]) None#
Append a hook to the list invoked after the actuator step on every iteration.
Each callback runs inside the captured CUDA graph (when
_is_all_graphable()isTrue) right afterNewtonActuatorAdapter.step()and before the solver substeps, so kernel writes tostate/controlare visible to the integrator on the same iteration. Multiple articulations register their own implicit-DOF telemetry / FF-routing kernels here; all registered callbacks fire in registration order each step.
- classmethod request_extended_contact_attribute(attr: str) None#
Request an extended contact attribute (e.g.
"force").Sensors call this during
__init__, before model finalization. Attributes are forwarded to the model instart_simulation()so that subsequentContactscreation includes them.- Parameters:
attr – Contact attribute name.
- classmethod request_extended_state_attribute(attr: str) None#
Request an extended state attribute (e.g.
"body_qdd").Sensors call this during
__init__, before model finalization. Attributes are forwarded to the builder instart_simulation()so that subsequentmodel.state()calls allocate them.- Parameters:
attr – State attribute name (must be in
State.EXTENDED_ATTRIBUTES).
- classmethod reset(soft: bool = False) None#
Reset physics simulation.
- Parameters:
soft – If True, skip full reinitialization.
- static safe_callback_invoke(fn: Callable, *args, physics_manager: type[PhysicsManager] | None = None) None#
Invoke a callback, catching exceptions that would be swallowed by external event buses.
Ignores
ReferenceError(from garbage-collected weakref proxies). All other exceptions are forwarded to physics_manager.``store_callback_exception`` when available (see note below), or re-raised immediately otherwise.- Note (Octi):
The carb event bus used by PhysX/Omniverse silently swallows exceptions raised inside callbacks.
PhysxManagerworks around this by storing the exception and re-raising it after event dispatch completes (inreset()/step()). Backends that dispatch events directly (e.g. Newton) don’t need this — exceptions propagate normally — sostore_callback_exceptionis not called for them. This is a known wart; a cleaner solution is actively being explored.
- classmethod set_decimation(decimation: int) None#
Set the decimation count and re-capture the CUDA graph.
When all actuators are graphable the entire decimation loop (actuators + solver substeps, repeated decimation times) is captured as a single CUDA graph.
If a CUDA graph was previously captured, it is automatically re-captured with the new decimation count using the same strategy as
start_simulation(): standardwp.ScopedCapturewhen no USDRT stage is active, or deferred relaxed capture when RTX is running.
- classmethod step() None#
Step the physics simulation.
The stepping logic follows one of two paths depending on whether all actuators are CUDA-graph-safe:
All-graphable path (
_simulate_full()):Actuators and solver substeps are captured together in a single CUDA graph containing the full
decimation x (actuators + solver substeps)loop.Eager-actuator path (fallback, some actuators not graph-safe):
Actuators are stepped eagerly on the CPU timeline (outside the graph), then a graph containing only the solver substeps is launched via
_simulate_physics_only().In both paths the sequence within one physics step is:
zero actuated DOFs in control.joint_f -> actuator.step (computes effort, writes to control.joint_f) -> solver.step x num_substeps (integrates, reads control.joint_f) -> sensors.update
- classmethod sync_particles_to_usd() None#
Write Newton particle_q to Fabric mesh point arrays for Kit viewport rendering.
For each deformable body whose mesh prim carries a
newton:particleOffsetattribute, this function copies the corresponding slice ofstate_0.particle_qinto the Fabricpointsarray so the Kit viewport reflects the current deformation.No-op when there is no
_usdrt_stage, no simulation state, or no deformable bodies registered.
- classmethod sync_transforms_to_usd() None#
Write Newton body_q to USD Fabric world matrices for Kit viewport / RTX rendering.
No-op when
_usdrt_stageis None (i.e. Kit visualizer is not active) or when transforms have not changed since the last sync.Called at render cadence by
pre_render()(viarender()). Physics stepping marks transforms dirty via_mark_transforms_dirty()so that the expensive Fabric hierarchy update only runs once per render frame rather than after every physics step.Uses
wp.fabricarraydirectly (noisaacsim.physics.newtonextension needed). The Warp kernel readsstate_0.body_q[newton_index[i]]and writes the correspondingmat44dtoomni:fabric:worldMatrixfor each prim.When cubric is available the method mirrors PhysX’s
DirectGpuHelperpattern: pause Fabric change tracking, write transforms, resume tracking, then callIAdapter::computeon the GPU to propagate the hierarchy and notify the Fabric Scene Delegate. Otherwise it falls back to the CPUupdate_world_xforms()path.
- classmethod update_visualization_state(scene_data_provider=None) None#
Refresh visualization state for the active sim backend.
Newton sim backend: no-op —
_state_0is the live, authoritative state already advanced bystep()/ forward kinematics.PhysX sim backend: pull rigid-body transforms from the
SceneDataProviderand write them into the shadow_state_0.body_qso Newton-native consumers (Newton renderer, Newton/Rerun/Viser visualizers, OVRTX renderer, Newton GL video) see fresh poses.Invoked lazily from
get_state()so consumers do not need to coordinate the sync explicitly.
- class isaaclab_contrib.deformable.coupled_mjwarp_vbd_manager.NewtonCoupledMJWarpVBDManager[source]#
Bases:
NewtonManagerNewtonManagerspecialization for the coupled MJWarp + VBD solver. Due to Newton deformables not being properly integrated yet, this manager uses the same temporary solutions from VBD Manager.Always uses Newton’s
CollisionPipelinefor contact handling.Methods:
initialize(sim_context)Initialize the manager with simulation context.
step()Step the physics simulation.
Start simulation by finalizing model and initializing state.
Create builder from USD stage with special treatment for deformable bodies, as these are not read from USD yet.
Opt an articulation into the Newton actuator fast path.
add_contact_sensor([body_names_expr, ...])Add a contact sensor for reporting contacts between bodies/shapes.
add_frame_transform_sensor(shapes, ...)Add a frame transform sensor for measuring relative transforms.
add_imu_sensor(sites)Add an IMU sensor for measuring acceleration and angular velocity at sites.
add_model_change(change)Register a model change to notify the solver.
Hook after visualizers have stepped during
render().cl_register_site(body_pattern, xform)Register a site request for injection into prototypes before replication.
clear()Clear all Newton-specific state (callbacks cleared by super().close()).
Remove all registered callbacks.
close()Clean up Newton physics resources.
create_builder([up_axis])Create a
ModelBuilderconfigured with default settings.deregister_callback(callback_id)Remove a registered callback.
dispatch_event(event[, payload])Dispatch an event to all registered callbacks.
forward()Update articulation kinematics without stepping physics.
Get the tensor backend being used ("numpy" or "torch").
Get the control object.
Get the physics simulation device.
get_dt()Get the physics timestep.
Get the Newton model.
Get the physics timestep in seconds.
Get the list of registered views.
Return the SceneDataBackend for the SceneDataProvider.
Get the current simulation time in seconds.
Get the solver substep timestep.
get_state([scene_data_provider])Get the current Newton state for visualization.
Get the current state.
Get the next state.
Truewhenstep()executes the full decimation loop internally.Initialize the solver and collision pipeline.
invalidate_fk([env_mask, env_ids, ...])Mark environments as needing FK recomputation and solver reset.
Check if fabric interface is enabled (not applicable for Newton).
pause()Pause physics simulation.
play()Start or resume physics simulation.
Flush deferred Fabric writes before cameras/visualizers read the scene.
register_callback(callback, event[, order, ...])Register a callback.
register_post_actuator_callback(callback)Append a hook to the list invoked after the actuator step on every iteration.
Request an extended contact attribute (e.g.
"force").Request an extended state attribute (e.g.
"body_qdd").reset([soft])Reset physics simulation.
safe_callback_invoke(fn, *args[, ...])Invoke a callback, catching exceptions that would be swallowed by external event buses.
set_builder(builder)Set the Newton model builder.
set_decimation(decimation)Set the decimation count and re-capture the CUDA graph.
stop()Stop physics simulation.
Write Newton particle_q to Fabric mesh point arrays for Kit viewport rendering.
Write Newton body_q to USD Fabric world matrices for Kit viewport / RTX rendering.
update_visualization_state([scene_data_provider])Refresh visualization state for the active sim backend.
Block until the timeline is playing.
- classmethod initialize(sim_context: SimulationContext) None[source]#
Initialize the manager with simulation context.
- Parameters:
sim_context – Parent simulation context.
TODO: Subclass should not override this method, once deformables supported on Newton import_usd, this can be unified with NewtonManager’s implementation.
- classmethod start_simulation() None[source]#
Start simulation by finalizing model and initializing state.
This function finalizes the model and initializes the simulation state. Note: Collision pipeline is initialized later in initialize_solver() after we determine whether the solver needs external collision detection.
TODO: Subclass should not override this method, missing piece is having Newton bind a surface mesh to volume deformable tetrahedral mesh in addition to removing the deformable_registry data structure.
- classmethod instantiate_builder_from_stage()[source]#
Create builder from USD stage with special treatment for deformable bodies, as these are not read from USD yet.
Detects env Xforms (e.g.
/World/Env_0,/World/Env_1) and builds each as a separate Newton world viabegin_world/end_world. Falls back to a flatadd_usdwhen no env Xforms are found.TODO: Subclass should not override this method, once deformables supported on Newton import_usd, this can be unified with NewtonManager’s implementation.
- classmethod activate_newton_actuator_path() None#
Opt an articulation into the Newton actuator fast path.
Idempotent — called by every Newton-fast-path articulation’s
_process_actuators_cfg:Sets
_use_newton_actuators_active, which_is_all_graphable()checks (adapter presence alone cannot distinguish the fast path from the standard Lab path).On first call, builds the single sim-level
NewtonActuatorAdapterover the full flat DOF layout; later calls reuse it.
- classmethod add_contact_sensor(body_names_expr: str | list[str] | None = None, shape_names_expr: str | list[str] | None = None, contact_partners_body_expr: str | list[str] | None = None, contact_partners_shape_expr: str | list[str] | None = None, verbose: bool = False) tuple[str | list[str] | None, str | list[str] | None, str | list[str] | None, str | list[str] | None]#
Add a contact sensor for reporting contacts between bodies/shapes.
Converts Isaac Lab pattern conventions (
.*regex, full USD paths) to fnmatch globs and delegates tonewton.sensors.SensorContact.- Parameters:
body_names_expr – Expression for body names to sense.
shape_names_expr – Expression for shape names to sense.
contact_partners_body_expr – Expression for contact partner body names.
contact_partners_shape_expr – Expression for contact partner shape names.
verbose – Print verbose information.
- classmethod add_frame_transform_sensor(shapes: list[int], reference_sites: list[int]) int#
Add a frame transform sensor for measuring relative transforms.
Creates a
SensorFrameTransformfrom pre-resolved shape and reference site indices, appends it to the internal list, and returns its index.- Parameters:
shapes – Ordered list of shape indices to measure.
reference_sites – 1:1 list of reference site indices (same length as shapes).
- Returns:
Index of the newly created sensor in
_newton_frame_transform_sensors.
- classmethod add_imu_sensor(sites: list[int]) int#
Add an IMU sensor for measuring acceleration and angular velocity at sites.
Creates a
newton.sensors.SensorIMUfrom pre-resolved site indices, appends it to the internal list, and returns its index.- Parameters:
sites – Ordered list of site indices (one per environment).
- Returns:
Index of the newly created sensor in the internal IMU sensor list.
- classmethod add_model_change(change: newton.solvers.SolverNotifyFlags) None#
Register a model change to notify the solver.
- classmethod after_visualizers_render() None#
Hook after visualizers have stepped during
render().Use for physics-backend sync (e.g. fabric) if needed. Recording pipelines (Kit/RTX, Newton GL video, etc.) run from
isaaclab.envs.utils.recording_hooksso they are not tied to a specific physics manager. Default is a no-op.
- classmethod cl_register_site(body_pattern: str | None, xform: warp.transform) str#
Register a site request for injection into prototypes before replication.
Sensors call this during
__init__. Sites are injected into prototype builders by_cl_inject_sites()(called fromnewton_replicate) beforeadd_builder, so they replicate correctly per-world.Identical
(body_pattern, transform)registrations share sites.The body_pattern is matched against prototype-local body labels (e.g.
"Robot/link.*") when replication is active, or against the flat builder’s body labels in the fallback path. Wildcard patterns that match multiple bodies create one site per matched body.- Parameters:
body_pattern – Regex pattern matched against body labels in the prototype builder (e.g.
"Robot/link0"or"Robot/finger.*"for multi-body wildcards), orNonefor global sites (world-origin reference, etc.).xform – Site transform relative to body.
- Returns:
Assigned site label suffix.
- classmethod clear()#
Clear all Newton-specific state (callbacks cleared by super().close()).
- classmethod clear_callbacks() None#
Remove all registered callbacks.
Do NOT reset
_callback_id— handle IDs must remain monotonically unique across the lifetime of the process. Resetting the counter would let a futureregister_callback()hand out an ID that an old, still-aliveCallbackHandle(e.g. on a sensor that has not been garbage-collected yet) holds, so when the old object eventually finalizes its__del__would deregister the new callback. This bit ovphysx’s kitless multi-context tests where twoInteractiveScene``s are created in sequence: the first scene's sensor would post-GC deregister the second scene's ``_initialize_callbackby ID collision, leaving the second sensor forever uninitialized.
- classmethod create_builder(up_axis: str | None = None, **kwargs) newton.ModelBuilder#
Create a
ModelBuilderconfigured with default settings.Forwards
NewtonShapeCfgdefaults onto Newton’s upstreamModelBuilder.default_shape_cfgviachecked_apply(). Falls back to wrapper defaults when no Newton config is active so rough-terrain margin/gap still apply during early construction.- Parameters:
up_axis – Override for the up-axis. Defaults to
None, which uses the manager’s_up_axis.**kwargs – Forwarded to
ModelBuilder.
- Returns:
New builder with up-axis and per-shape defaults (gap, margin) applied.
- classmethod deregister_callback(callback_id: int | CallbackHandle) None#
Remove a registered callback.
- Parameters:
callback_id – The ID or CallbackHandle returned by register_callback().
- classmethod dispatch_event(event: PhysicsEvent, payload: Any = None) None#
Dispatch an event to all registered callbacks.
This is the default implementation using simple callback lists. Subclasses may override or extend with platform-specific dispatch.
- Parameters:
event – The event to dispatch.
payload – Optional data to pass to callbacks.
- classmethod forward() None#
Update articulation kinematics without stepping physics.
Runs Newton’s generic forward kinematics (
eval_fk) over all articulations to compute body poses from joint coordinates. This is the full (unmasked) FK path used during initial setup. For incremental per-environment updates after resets, seeinvalidate_fk()which accumulates masks consumed bystep().
- classmethod get_control() newton.Control#
Get the control object.
- classmethod get_model() newton.Model#
Get the Newton model.
When the active sim backend is Newton this returns the manager’s own authoritative model. When the active sim backend is PhysX a shadow Newton model is built lazily (from the visualizer prebuilt artifact) so renderers/visualizers that operate on Newton
ModelandStatecan still drive a PhysX-simulated scene.
- classmethod get_physics_sim_view() list#
Get the list of registered views.
Assets can append their views to this list, and sensors can access them. Returns a list that callers can append to.
- Returns:
List of registered views (e.g., NewtonArticulationView instances).
- classmethod get_scene_data_backend() SceneDataBackend#
Return the SceneDataBackend for the SceneDataProvider.
- classmethod get_state(scene_data_provider=None) newton.State#
Get the current Newton state for visualization.
Use this method from visualizers/renderers/video recorders that need a backend-agnostic Newton
State. When the sim backend is PhysX this refreshes the shadow_state_0.body_qfrom the live PhysX scene viaupdate_visualization_state()before returning, so callers never observe stale transforms. Under the Newton sim backendupdate_visualization_state()is a no-op and this is equivalent toget_state_0().
- classmethod get_state_0() newton.State#
Get the current state.
- classmethod get_state_1() newton.State#
Get the next state.
- classmethod handles_decimation() bool#
Truewhenstep()executes the full decimation loop internally.This is the case when all Newton actuators are CUDA-graph-safe. The full decimation loop (including the trivial
decimation=1case) is folded into a singlestep()call.
- classmethod initialize_solver() None#
Initialize the solver and collision pipeline.
Thin orchestrator: delegates solver construction to
_build_solver()(overridden by each solver subclass), allocates the collision pipeline (when applicable) via_initialize_contacts(), then sets up cubric bindings and either captures the CUDA graph immediately or defers capture until the firststep()call (RTX-active path).Warning
When using a CUDA-enabled device, the simulation is graphed. This means the function steps the simulation once to capture the graph, so it should only be called after everything else in the simulation is initialized.
- classmethod invalidate_fk(env_mask: wp.array | None = None, env_ids: wp.array | None = None, articulation_ids: wp.array | None = None) None#
Mark environments as needing FK recomputation and solver reset.
Called by asset write methods that modify joint coordinates or root transforms. The masks are consumed in
step()before physics stepping.- Parameters:
env_mask – Boolean mask of dirtied environments. Shape
(num_envs,). Used by_maskwrite methods.env_ids – Integer indices of dirtied environments. Used by
_indexwrite methods.articulation_ids – Mapping from
(world, arti)to model articulation index. Shape(world_count, count_per_world). Obtained fromArticulationView.articulation_ids.
- classmethod is_fabric_enabled() bool#
Check if fabric interface is enabled (not applicable for Newton).
- classmethod pre_render() None#
Flush deferred Fabric writes before cameras/visualizers read the scene.
- classmethod register_callback(callback: Callable, event: PhysicsEvent, order: int = 0, name: str | None = None, wrap_weak_ref: bool = True) CallbackHandle#
Register a callback. Passes event to parent class.
- classmethod register_post_actuator_callback(callback: Callable[[], None]) None#
Append a hook to the list invoked after the actuator step on every iteration.
Each callback runs inside the captured CUDA graph (when
_is_all_graphable()isTrue) right afterNewtonActuatorAdapter.step()and before the solver substeps, so kernel writes tostate/controlare visible to the integrator on the same iteration. Multiple articulations register their own implicit-DOF telemetry / FF-routing kernels here; all registered callbacks fire in registration order each step.
- classmethod request_extended_contact_attribute(attr: str) None#
Request an extended contact attribute (e.g.
"force").Sensors call this during
__init__, before model finalization. Attributes are forwarded to the model instart_simulation()so that subsequentContactscreation includes them.- Parameters:
attr – Contact attribute name.
- classmethod request_extended_state_attribute(attr: str) None#
Request an extended state attribute (e.g.
"body_qdd").Sensors call this during
__init__, before model finalization. Attributes are forwarded to the builder instart_simulation()so that subsequentmodel.state()calls allocate them.- Parameters:
attr – State attribute name (must be in
State.EXTENDED_ATTRIBUTES).
- classmethod reset(soft: bool = False) None#
Reset physics simulation.
- Parameters:
soft – If True, skip full reinitialization.
- static safe_callback_invoke(fn: Callable, *args, physics_manager: type[PhysicsManager] | None = None) None#
Invoke a callback, catching exceptions that would be swallowed by external event buses.
Ignores
ReferenceError(from garbage-collected weakref proxies). All other exceptions are forwarded to physics_manager.``store_callback_exception`` when available (see note below), or re-raised immediately otherwise.- Note (Octi):
The carb event bus used by PhysX/Omniverse silently swallows exceptions raised inside callbacks.
PhysxManagerworks around this by storing the exception and re-raising it after event dispatch completes (inreset()/step()). Backends that dispatch events directly (e.g. Newton) don’t need this — exceptions propagate normally — sostore_callback_exceptionis not called for them. This is a known wart; a cleaner solution is actively being explored.
- classmethod set_decimation(decimation: int) None#
Set the decimation count and re-capture the CUDA graph.
When all actuators are graphable the entire decimation loop (actuators + solver substeps, repeated decimation times) is captured as a single CUDA graph.
If a CUDA graph was previously captured, it is automatically re-captured with the new decimation count using the same strategy as
start_simulation(): standardwp.ScopedCapturewhen no USDRT stage is active, or deferred relaxed capture when RTX is running.
- classmethod sync_particles_to_usd() None#
Write Newton particle_q to Fabric mesh point arrays for Kit viewport rendering.
For each deformable body whose mesh prim carries a
newton:particleOffsetattribute, this function copies the corresponding slice ofstate_0.particle_qinto the Fabricpointsarray so the Kit viewport reflects the current deformation.No-op when there is no
_usdrt_stage, no simulation state, or no deformable bodies registered.
- classmethod sync_transforms_to_usd() None#
Write Newton body_q to USD Fabric world matrices for Kit viewport / RTX rendering.
No-op when
_usdrt_stageis None (i.e. Kit visualizer is not active) or when transforms have not changed since the last sync.Called at render cadence by
pre_render()(viarender()). Physics stepping marks transforms dirty via_mark_transforms_dirty()so that the expensive Fabric hierarchy update only runs once per render frame rather than after every physics step.Uses
wp.fabricarraydirectly (noisaacsim.physics.newtonextension needed). The Warp kernel readsstate_0.body_q[newton_index[i]]and writes the correspondingmat44dtoomni:fabric:worldMatrixfor each prim.When cubric is available the method mirrors PhysX’s
DirectGpuHelperpattern: pause Fabric change tracking, write transforms, resume tracking, then callIAdapter::computeon the GPU to propagate the hierarchy and notify the Fabric Scene Delegate. Otherwise it falls back to the CPUupdate_world_xforms()path.
- classmethod update_visualization_state(scene_data_provider=None) None#
Refresh visualization state for the active sim backend.
Newton sim backend: no-op —
_state_0is the live, authoritative state already advanced bystep()/ forward kinematics.PhysX sim backend: pull rigid-body transforms from the
SceneDataProviderand write them into the shadow_state_0.body_qso Newton-native consumers (Newton renderer, Newton/Rerun/Viser visualizers, OVRTX renderer, Newton GL video) see fresh poses.Invoked lazily from
get_state()so consumers do not need to coordinate the sync explicitly.
- class isaaclab_contrib.deformable.coupled_featherstone_vbd_manager.NewtonCoupledFeatherstoneVBDManager[source]#
Bases:
NewtonManagerNewtonManagerspecialization for the coupled Featherstone + VBD solver. Due to Newton deformables not being properly integrated yet, this manager uses the same temporary solutions from VBD Manager.Always uses Newton’s
CollisionPipelinefor contact handling.Methods:
initialize(sim_context)Initialize the manager with simulation context.
step()Step the physics simulation.
Start simulation by finalizing model and initializing state.
Create builder from USD stage with special treatment for deformable bodies, as these are not read from USD yet.
Opt an articulation into the Newton actuator fast path.
add_contact_sensor([body_names_expr, ...])Add a contact sensor for reporting contacts between bodies/shapes.
add_frame_transform_sensor(shapes, ...)Add a frame transform sensor for measuring relative transforms.
add_imu_sensor(sites)Add an IMU sensor for measuring acceleration and angular velocity at sites.
add_model_change(change)Register a model change to notify the solver.
Hook after visualizers have stepped during
render().cl_register_site(body_pattern, xform)Register a site request for injection into prototypes before replication.
clear()Clear all Newton-specific state (callbacks cleared by super().close()).
Remove all registered callbacks.
close()Clean up Newton physics resources.
create_builder([up_axis])Create a
ModelBuilderconfigured with default settings.deregister_callback(callback_id)Remove a registered callback.
dispatch_event(event[, payload])Dispatch an event to all registered callbacks.
forward()Update articulation kinematics without stepping physics.
Get the tensor backend being used ("numpy" or "torch").
Get the control object.
Get the physics simulation device.
get_dt()Get the physics timestep.
Get the Newton model.
Get the physics timestep in seconds.
Get the list of registered views.
Return the SceneDataBackend for the SceneDataProvider.
Get the current simulation time in seconds.
Get the solver substep timestep.
get_state([scene_data_provider])Get the current Newton state for visualization.
Get the current state.
Get the next state.
Truewhenstep()executes the full decimation loop internally.Initialize the solver and collision pipeline.
invalidate_fk([env_mask, env_ids, ...])Mark environments as needing FK recomputation and solver reset.
Check if fabric interface is enabled (not applicable for Newton).
pause()Pause physics simulation.
play()Start or resume physics simulation.
Flush deferred Fabric writes before cameras/visualizers read the scene.
register_callback(callback, event[, order, ...])Register a callback.
register_post_actuator_callback(callback)Append a hook to the list invoked after the actuator step on every iteration.
Request an extended contact attribute (e.g.
"force").Request an extended state attribute (e.g.
"body_qdd").reset([soft])Reset physics simulation.
safe_callback_invoke(fn, *args[, ...])Invoke a callback, catching exceptions that would be swallowed by external event buses.
set_builder(builder)Set the Newton model builder.
set_decimation(decimation)Set the decimation count and re-capture the CUDA graph.
stop()Stop physics simulation.
Write Newton particle_q to Fabric mesh point arrays for Kit viewport rendering.
Write Newton body_q to USD Fabric world matrices for Kit viewport / RTX rendering.
update_visualization_state([scene_data_provider])Refresh visualization state for the active sim backend.
Block until the timeline is playing.
- classmethod initialize(sim_context: SimulationContext) None[source]#
Initialize the manager with simulation context.
- Parameters:
sim_context – Parent simulation context.
TODO: Subclass should not override this method, once deformables supported on Newton import_usd, this can be unified with NewtonManager’s implementation.
- classmethod start_simulation() None[source]#
Start simulation by finalizing model and initializing state.
This function finalizes the model and initializes the simulation state. Note: Collision pipeline is initialized later in initialize_solver() after we determine whether the solver needs external collision detection.
TODO: Subclass should not override this method, missing piece is having Newton bind a surface mesh to volume deformable tetrahedral mesh in addition to removing the deformable_registry data structure.
- classmethod instantiate_builder_from_stage()[source]#
Create builder from USD stage with special treatment for deformable bodies, as these are not read from USD yet.
Detects env Xforms (e.g.
/World/Env_0,/World/Env_1) and builds each as a separate Newton world viabegin_world/end_world. Falls back to a flatadd_usdwhen no env Xforms are found.TODO: Subclass should not override this method, once deformables supported on Newton import_usd, this can be unified with NewtonManager’s implementation.
- classmethod activate_newton_actuator_path() None#
Opt an articulation into the Newton actuator fast path.
Idempotent — called by every Newton-fast-path articulation’s
_process_actuators_cfg:Sets
_use_newton_actuators_active, which_is_all_graphable()checks (adapter presence alone cannot distinguish the fast path from the standard Lab path).On first call, builds the single sim-level
NewtonActuatorAdapterover the full flat DOF layout; later calls reuse it.
- classmethod add_contact_sensor(body_names_expr: str | list[str] | None = None, shape_names_expr: str | list[str] | None = None, contact_partners_body_expr: str | list[str] | None = None, contact_partners_shape_expr: str | list[str] | None = None, verbose: bool = False) tuple[str | list[str] | None, str | list[str] | None, str | list[str] | None, str | list[str] | None]#
Add a contact sensor for reporting contacts between bodies/shapes.
Converts Isaac Lab pattern conventions (
.*regex, full USD paths) to fnmatch globs and delegates tonewton.sensors.SensorContact.- Parameters:
body_names_expr – Expression for body names to sense.
shape_names_expr – Expression for shape names to sense.
contact_partners_body_expr – Expression for contact partner body names.
contact_partners_shape_expr – Expression for contact partner shape names.
verbose – Print verbose information.
- classmethod add_frame_transform_sensor(shapes: list[int], reference_sites: list[int]) int#
Add a frame transform sensor for measuring relative transforms.
Creates a
SensorFrameTransformfrom pre-resolved shape and reference site indices, appends it to the internal list, and returns its index.- Parameters:
shapes – Ordered list of shape indices to measure.
reference_sites – 1:1 list of reference site indices (same length as shapes).
- Returns:
Index of the newly created sensor in
_newton_frame_transform_sensors.
- classmethod add_imu_sensor(sites: list[int]) int#
Add an IMU sensor for measuring acceleration and angular velocity at sites.
Creates a
newton.sensors.SensorIMUfrom pre-resolved site indices, appends it to the internal list, and returns its index.- Parameters:
sites – Ordered list of site indices (one per environment).
- Returns:
Index of the newly created sensor in the internal IMU sensor list.
- classmethod add_model_change(change: newton.solvers.SolverNotifyFlags) None#
Register a model change to notify the solver.
- classmethod after_visualizers_render() None#
Hook after visualizers have stepped during
render().Use for physics-backend sync (e.g. fabric) if needed. Recording pipelines (Kit/RTX, Newton GL video, etc.) run from
isaaclab.envs.utils.recording_hooksso they are not tied to a specific physics manager. Default is a no-op.
- classmethod cl_register_site(body_pattern: str | None, xform: warp.transform) str#
Register a site request for injection into prototypes before replication.
Sensors call this during
__init__. Sites are injected into prototype builders by_cl_inject_sites()(called fromnewton_replicate) beforeadd_builder, so they replicate correctly per-world.Identical
(body_pattern, transform)registrations share sites.The body_pattern is matched against prototype-local body labels (e.g.
"Robot/link.*") when replication is active, or against the flat builder’s body labels in the fallback path. Wildcard patterns that match multiple bodies create one site per matched body.- Parameters:
body_pattern – Regex pattern matched against body labels in the prototype builder (e.g.
"Robot/link0"or"Robot/finger.*"for multi-body wildcards), orNonefor global sites (world-origin reference, etc.).xform – Site transform relative to body.
- Returns:
Assigned site label suffix.
- classmethod clear()#
Clear all Newton-specific state (callbacks cleared by super().close()).
- classmethod clear_callbacks() None#
Remove all registered callbacks.
Do NOT reset
_callback_id— handle IDs must remain monotonically unique across the lifetime of the process. Resetting the counter would let a futureregister_callback()hand out an ID that an old, still-aliveCallbackHandle(e.g. on a sensor that has not been garbage-collected yet) holds, so when the old object eventually finalizes its__del__would deregister the new callback. This bit ovphysx’s kitless multi-context tests where twoInteractiveScene``s are created in sequence: the first scene's sensor would post-GC deregister the second scene's ``_initialize_callbackby ID collision, leaving the second sensor forever uninitialized.
- classmethod create_builder(up_axis: str | None = None, **kwargs) newton.ModelBuilder#
Create a
ModelBuilderconfigured with default settings.Forwards
NewtonShapeCfgdefaults onto Newton’s upstreamModelBuilder.default_shape_cfgviachecked_apply(). Falls back to wrapper defaults when no Newton config is active so rough-terrain margin/gap still apply during early construction.- Parameters:
up_axis – Override for the up-axis. Defaults to
None, which uses the manager’s_up_axis.**kwargs – Forwarded to
ModelBuilder.
- Returns:
New builder with up-axis and per-shape defaults (gap, margin) applied.
- classmethod deregister_callback(callback_id: int | CallbackHandle) None#
Remove a registered callback.
- Parameters:
callback_id – The ID or CallbackHandle returned by register_callback().
- classmethod dispatch_event(event: PhysicsEvent, payload: Any = None) None#
Dispatch an event to all registered callbacks.
This is the default implementation using simple callback lists. Subclasses may override or extend with platform-specific dispatch.
- Parameters:
event – The event to dispatch.
payload – Optional data to pass to callbacks.
- classmethod forward() None#
Update articulation kinematics without stepping physics.
Runs Newton’s generic forward kinematics (
eval_fk) over all articulations to compute body poses from joint coordinates. This is the full (unmasked) FK path used during initial setup. For incremental per-environment updates after resets, seeinvalidate_fk()which accumulates masks consumed bystep().
- classmethod get_control() newton.Control#
Get the control object.
- classmethod get_model() newton.Model#
Get the Newton model.
When the active sim backend is Newton this returns the manager’s own authoritative model. When the active sim backend is PhysX a shadow Newton model is built lazily (from the visualizer prebuilt artifact) so renderers/visualizers that operate on Newton
ModelandStatecan still drive a PhysX-simulated scene.
- classmethod get_physics_sim_view() list#
Get the list of registered views.
Assets can append their views to this list, and sensors can access them. Returns a list that callers can append to.
- Returns:
List of registered views (e.g., NewtonArticulationView instances).
- classmethod get_scene_data_backend() SceneDataBackend#
Return the SceneDataBackend for the SceneDataProvider.
- classmethod get_state(scene_data_provider=None) newton.State#
Get the current Newton state for visualization.
Use this method from visualizers/renderers/video recorders that need a backend-agnostic Newton
State. When the sim backend is PhysX this refreshes the shadow_state_0.body_qfrom the live PhysX scene viaupdate_visualization_state()before returning, so callers never observe stale transforms. Under the Newton sim backendupdate_visualization_state()is a no-op and this is equivalent toget_state_0().
- classmethod get_state_0() newton.State#
Get the current state.
- classmethod get_state_1() newton.State#
Get the next state.
- classmethod handles_decimation() bool#
Truewhenstep()executes the full decimation loop internally.This is the case when all Newton actuators are CUDA-graph-safe. The full decimation loop (including the trivial
decimation=1case) is folded into a singlestep()call.
- classmethod initialize_solver() None#
Initialize the solver and collision pipeline.
Thin orchestrator: delegates solver construction to
_build_solver()(overridden by each solver subclass), allocates the collision pipeline (when applicable) via_initialize_contacts(), then sets up cubric bindings and either captures the CUDA graph immediately or defers capture until the firststep()call (RTX-active path).Warning
When using a CUDA-enabled device, the simulation is graphed. This means the function steps the simulation once to capture the graph, so it should only be called after everything else in the simulation is initialized.
- classmethod invalidate_fk(env_mask: wp.array | None = None, env_ids: wp.array | None = None, articulation_ids: wp.array | None = None) None#
Mark environments as needing FK recomputation and solver reset.
Called by asset write methods that modify joint coordinates or root transforms. The masks are consumed in
step()before physics stepping.- Parameters:
env_mask – Boolean mask of dirtied environments. Shape
(num_envs,). Used by_maskwrite methods.env_ids – Integer indices of dirtied environments. Used by
_indexwrite methods.articulation_ids – Mapping from
(world, arti)to model articulation index. Shape(world_count, count_per_world). Obtained fromArticulationView.articulation_ids.
- classmethod is_fabric_enabled() bool#
Check if fabric interface is enabled (not applicable for Newton).
- classmethod pre_render() None#
Flush deferred Fabric writes before cameras/visualizers read the scene.
- classmethod register_callback(callback: Callable, event: PhysicsEvent, order: int = 0, name: str | None = None, wrap_weak_ref: bool = True) CallbackHandle#
Register a callback. Passes event to parent class.
- classmethod register_post_actuator_callback(callback: Callable[[], None]) None#
Append a hook to the list invoked after the actuator step on every iteration.
Each callback runs inside the captured CUDA graph (when
_is_all_graphable()isTrue) right afterNewtonActuatorAdapter.step()and before the solver substeps, so kernel writes tostate/controlare visible to the integrator on the same iteration. Multiple articulations register their own implicit-DOF telemetry / FF-routing kernels here; all registered callbacks fire in registration order each step.
- classmethod request_extended_contact_attribute(attr: str) None#
Request an extended contact attribute (e.g.
"force").Sensors call this during
__init__, before model finalization. Attributes are forwarded to the model instart_simulation()so that subsequentContactscreation includes them.- Parameters:
attr – Contact attribute name.
- classmethod request_extended_state_attribute(attr: str) None#
Request an extended state attribute (e.g.
"body_qdd").Sensors call this during
__init__, before model finalization. Attributes are forwarded to the builder instart_simulation()so that subsequentmodel.state()calls allocate them.- Parameters:
attr – State attribute name (must be in
State.EXTENDED_ATTRIBUTES).
- classmethod reset(soft: bool = False) None#
Reset physics simulation.
- Parameters:
soft – If True, skip full reinitialization.
- static safe_callback_invoke(fn: Callable, *args, physics_manager: type[PhysicsManager] | None = None) None#
Invoke a callback, catching exceptions that would be swallowed by external event buses.
Ignores
ReferenceError(from garbage-collected weakref proxies). All other exceptions are forwarded to physics_manager.``store_callback_exception`` when available (see note below), or re-raised immediately otherwise.- Note (Octi):
The carb event bus used by PhysX/Omniverse silently swallows exceptions raised inside callbacks.
PhysxManagerworks around this by storing the exception and re-raising it after event dispatch completes (inreset()/step()). Backends that dispatch events directly (e.g. Newton) don’t need this — exceptions propagate normally — sostore_callback_exceptionis not called for them. This is a known wart; a cleaner solution is actively being explored.
- classmethod set_decimation(decimation: int) None#
Set the decimation count and re-capture the CUDA graph.
When all actuators are graphable the entire decimation loop (actuators + solver substeps, repeated decimation times) is captured as a single CUDA graph.
If a CUDA graph was previously captured, it is automatically re-captured with the new decimation count using the same strategy as
start_simulation(): standardwp.ScopedCapturewhen no USDRT stage is active, or deferred relaxed capture when RTX is running.
- classmethod sync_particles_to_usd() None#
Write Newton particle_q to Fabric mesh point arrays for Kit viewport rendering.
For each deformable body whose mesh prim carries a
newton:particleOffsetattribute, this function copies the corresponding slice ofstate_0.particle_qinto the Fabricpointsarray so the Kit viewport reflects the current deformation.No-op when there is no
_usdrt_stage, no simulation state, or no deformable bodies registered.
- classmethod sync_transforms_to_usd() None#
Write Newton body_q to USD Fabric world matrices for Kit viewport / RTX rendering.
No-op when
_usdrt_stageis None (i.e. Kit visualizer is not active) or when transforms have not changed since the last sync.Called at render cadence by
pre_render()(viarender()). Physics stepping marks transforms dirty via_mark_transforms_dirty()so that the expensive Fabric hierarchy update only runs once per render frame rather than after every physics step.Uses
wp.fabricarraydirectly (noisaacsim.physics.newtonextension needed). The Warp kernel readsstate_0.body_q[newton_index[i]]and writes the correspondingmat44dtoomni:fabric:worldMatrixfor each prim.When cubric is available the method mirrors PhysX’s
DirectGpuHelperpattern: pause Fabric change tracking, write transforms, resume tracking, then callIAdapter::computeon the GPU to propagate the hierarchy and notify the Fabric Scene Delegate. Otherwise it falls back to the CPUupdate_world_xforms()path.
- classmethod update_visualization_state(scene_data_provider=None) None#
Refresh visualization state for the active sim backend.
Newton sim backend: no-op —
_state_0is the live, authoritative state already advanced bystep()/ forward kinematics.PhysX sim backend: pull rigid-body transforms from the
SceneDataProviderand write them into the shadow_state_0.body_qso Newton-native consumers (Newton renderer, Newton/Rerun/Viser visualizers, OVRTX renderer, Newton GL video) see fresh poses.Invoked lazily from
get_state()so consumers do not need to coordinate the sync explicitly.