Comment by dahcryn
because it's recommended by nearly all consultants and Microsoft.
Simple as that, it's consulting Heaven. Much like SAS and SAP. Everybody happy. Now to be far to databricks, if used properly and ignore the cost, it does actually function pretty well. Compared to Synapse, PowerBI Tabular, Fabric, Azure ML, ... that's already a big big big step forward.
Databricks is janky, but so much better than the Azure services for data.
If you're buying from microsoft, it won't be cheap either way, might as well treat yourself a little bit.