It might be challenging in sequential mode. Rays are expected to move forward along the optical axis direction (it makes the ray tracing more straightforward under the hood). I would stick to non-sequential for the prism design if I were you. What kind of analysis you need from sequential mode? You could use OpticStudio mixed mode, where the prism is made in non-sequential and introduced in a sequential system with a Non-Sequential Component surface (see post below).
Also, its not totally relevant, but you might take something away from the accepted answer of this post:
It might be challenging in sequential mode. Rays are expected to move forward along the optical axis direction (it makes the ray tracing more straightforward under the hood). I would stick to non-sequential if I were you. What kind of analysis you need from sequential mode? You could use OpticStudio mixed mode, where the prism is made in non-sequential and introduced in a sequential system with a Non-Sequential Component surface (see post below).
Also, its not totally relevant, but you might take something away from the accepted answer of this post: