FrameShift-CAD: Executable Coordinate-Frame Interventions for Diagnosing Text-to-CAD Generation
Published in Research Square (preprint), 2026
A controlled diagnostic extension of a deterministic primitive-based CAD benchmark, studying whether text-to-CAD models can transport the same design through a specified coordinate operation. FrameShift-CAD derives matched active-object and passive-frame prompts from the same base specification and compares each generated shape set against programmatically constructed correct, inverse, unchanged, partial, component-only, and wrong-order counterfactuals. Across a prospectively frozen confirmation over 12 CAD families, exact translation was correct in 66.7% of outputs whereas pure rotation was correct in only 8.3%, a gap that persisted across axis-aligned and diagonal-axis rotations.
Recommended citation: Sun, S. (2026). "FrameShift-CAD: Executable Coordinate-Frame Interventions for Diagnosing Text-to-CAD Generation." Research Square. doi:10.21203/rs.3.rs-10904095/v1
Download Paper