simular - Software Engineer, CUA Control

• Work on the low-level computer control stack: mouse/keyboard injection, screen capture, coordinate mapping, input simulation • Implement UI element detection using accessibility APIs (AXUIElement, UI Automation), DOM/a11y trees, and visual grounding • Help build the abstraction layer that lets our agent operate across OS platforms and application types • Tackle reliability problems: element targeting under UI changes, window occlusion, resolution scaling, cross-app focus management • Contribute to feedback loops: how does the agent know its action worked? How does it recover when something unexpected happens? • Work closely with the model and planning team on the interface between intent and execution • You might be a fit if • You've built OS-level input automation (CGEvent, SendInput, xdotool, or similar) • You understand accessibility frameworks - AXUIElement on macOS, UI Automation on Windows, AT-SPI on Linux • You've dealt with flaky element selectors, timing issues, resolution-dependent coordinates • You think carefully about reliability and edge cases • You've worked with tools like Playwright, Appium, PyAutoGUI, Hammerspoon, or similar • Experience with screen reader internals, remote desktop protocols (RDP/VNC), game automation, LLM agent tool-use systems, or mobile device automation (iOS UIAutomation / XCTest, Android UIAutomator / Accessibility).