yjyddq/RiOSWorld

Provides a comprehensive benchmark for evaluating safety risks in multimodal computer-use agents through realistic desktop environment interactions, with evaluation trajectories released on HuggingFace. Uses virtualized desktop environments (VMware or Docker) as execution sandboxes and integrates with OSWorld's infrastructure for standardized task setup and metrics collection. Includes attack simulation utilities and automated risk evaluation pipelines to assess how agents respond to phishing, credential theft, and other adversarial scenarios.

117 stars.