SikuliX

SikuliX is an open-source automation tool that automates GUI interactions on desktop computers using image recognition. It allows users to create scripts to control mouse and keyboard actions based on what is visible on the screen, supporting various scripting languages like Python, Ruby, and JavaScript.

SikuliX is a strong match for the concept of an AI-driven desktop assistant. It explicitly states its core function is to "automate anything you see on the screen of your desktop computer running Windows, Mac or some Linux/Unix" using image recognition to identify GUI components and interact with them. This directly aligns with 'workflow-observation' and 'task-automation'. The ability to create and run scripts (macros) for repetitive tasks covers 'macro-recording'. The documentation and help features can be seen as a form of 'contextual-inline-help' and 'knowledge-sharing'. While it doesn't explicitly mention 'AI algorithms' for 'pattern-analysis' in the same way as the concept, its image recognition and automation capabilities imply a form of pattern detection for automation. The support for various scripting languages and integration with Java programming environments also suggests 'integration-apis'.