Comment by sureglymop

Comment by sureglymop 18 hours ago

3 replies

That's one thing. Another would be introducing homomorphic encryption in order for companies and people using their models to stay compliant and private. I can't believe it's such an under-researched area in AI.

catoc 10 hours ago

That is the only implementation I can think of that might make me trust a third party with confidential data. Of course these massive transformers are already insanely computer intensive and adding FHE would make that orders of magnitude worse.

  • sureglymop 6 hours ago

    I agree but that's why it needs to be researched more. Some changes in architecture may be able to address some performance problems. It could lead to algorithmic optimizations or even specialized hardware for this.

    • catoc 6 hours ago

      100% on board. This would be a paradigm shift for cloud services.

      (And take away a, for many significant, source of income - data they can sell, train on, etc - So I’m afraid the incentive to research an implement it will be lacking)