Comment by thusjustin
Comment by thusjustin 7 days ago
I love the vision. From what I can tell, you're building something that I think should exist and we have the technology for now. I think we need a place to put our 3, 5, 10 year goals, and some kind of process to keep us on track for that. And it's so personal, of course the LLM aspect needs to be local-only.
One concern I have is that I think I will need more than an empty "add Journal entry" nudge or prompt. I think I would want what a real coach would do/say. Something like, "How's the meditation/exercise/calling friends/making stuff going?"
Thanks for the positive feedback! The LLM aspect is using enterprise API from openAI, their policy is to not train on user data; I've used it extensively for the last year with my own personal diary Dlog data; pretty dry stuff to be sure. However, I will be working on allowing the user to use their own on device models; at the moment running local models is too memory intensive for most users so I need to do this once the models are more compact. Apple have recently allowed developers to integrate AI through their foundation model LLM but the token window is too short, 8K only if I recall correctly; and the responses just aren't that useful. The technology will improve and trust in openAI's systems should increase; we're early days here, but for now the main mechanisms for LLM we are has to be the enterprise openAI; there's nothing better IMO. Another thing I am working on in the short term is mechanisms to anonymise content and approve the prompt before it is sent; as well as a simple toggle that when switched on removes that journal from being included in Coach analysis. Thanks again. If you DM or email me and let me know the email you used to sign up with Dlog then I'll send you a free perpetual license so DLog is free to use forever, excluding the AI tokens; and I'll give you 1 million free tokens. Have a wonderful day. Dr J.