Comment by threeseed

Comment by threeseed 10 months ago

2 replies

> So it makes sense to centralize data somewhere

Modelling and integrating datasets that you don't own is extremely hard.

Shopify for example updates their API every 3 months.

How much time and money do you think an SMB can afford to spend on this before the ROI becomes so poor that they abandon it entirely.

mceoin 10 months ago

There is a separate answer here which is many (most?) SMBs can't afford technical folk, so the ability integrate data at all, talk to it and model it (using SQL or AI), is already a big step forward for them.

My personal use case tends to involve a lot of Postgres data and transaction events for my reporting. We see "simple" businesses like parts manufacturers, print shops, vineyards, etc. all doing something similar.

mceoin 10 months ago

Yes some integrations are excellent (hey Stripe : ), some are terrible (no comment on who). We're finding that LLMs increasingly able to fill the gap around organizing data schema for that initial data prep piece where someone has to build the data tables that others consume. To your specific question/problem set, when a schema updates you end up with a "fuzzy schema matching problem"; we are solving that separately anyways for a separate product feature requirement.

Strong note here that the current state of technology is much better for SMB scale data and not enterprise scale data with messy schemas.