SysMoBench: Evaluating AI on Formally Specifying Complex Real-World Systems
Formal models are essential to specifying large, complex computer systems and verifying their correctness, but are notoriously expensive to write and maintain. Recent advances in generative AI show promise in generating certain forms of specifications. However, existing work mostly targets small cod…