microsoft/psi

A .NET Standard framework for building real-time multimodal AI systems that processes streaming sensor data (audio, video, depth) through composable pipeline components with temporal synchronization. Built around a dataflow architecture with first-class support for time-stamped streams, it integrates sensor hardware (Kinect, HoloLens), AI models, and provides PsiStudio for visualization and annotation. Targets embodied conversational agents, mixed-reality applications, and ambient intelligence systems operating under strict latency constraints.

570 stars.