Comment by jackienotchan 3 days ago
Would you mind sharing the story behind your pivot from on-demand photorealistic vision datasets[0] to browser automation?
[0] https://www.ycombinator.com/launches/Lbx-simplex-on-demand-p...
It's quite a crowded market, browser workflow automation. What are you guys trying to do differently? For me, as someone who does a bunch of browser automation tasks, the real issue is stability. So many tools fall over on non-trivial workflows like complex forms with tabs. Fix that and you may open up a large testing automation market.
Some of the things we're trying to differently are 1) making flows deterministic by using vision models that have a consistent output given an image and an input query and 2) breaking up flows into these smaller atomic actions in order to improve consistency as well.
RE: workflows w/ complex forms and tabs -- do you have some sites that are good examples of this? We'd love to see how Simplex does.
Yeah sure! We mentioned a little bit in the post that we stumbled upon this problem when working on a synthetic data contract. Internally, we were building software at the time to fully automate the process of creating synthetic data, all the way from purchasing assets to building scene layouts to rendering images. We realized after 2 months of building that there wasn't a great need for this problem nor could we build something minimal but feature-complete that we could give to people and iterate off of. We also saw the writing on the wall re: building 3D world models (see WorldLabs and NVIDIA's new 3D world models). We're excited to see where this goes!