Comment by peddling-brink

Comment by peddling-brink 5 days ago

3 replies

I got really excited when I saw that you were releasing your model.

> Today we're releasing our new model* - Lemon Slice 2, a 20B-parameter diffusion transformer that generates infinite-length video at 20fps on a single GPU - and opening up our API.

But after digging around for a while, searching for a huggingface link, I’m guessing this was just a unfortunate turn of phrase, and you are not in fact, releasing an open weights model that people can run themselves?

Oh well, this looks very cool regardless and congratulations on the release.

andrew-w 5 days ago

Thanks! And sorry! I can see how our wording there could be misconstrued. With a real-time model, the streaming infrastructure matters almost as much as the weights themselves. It will be interesting to see how easily they can be commoditized in the future.

sid-the-kid 5 days ago

Thank you! We are considering to release an open-source version of the model. Somebody will do it soon. Might as well be us. We are mostly concerned with the additional overhead of releasing and then supporting it. So, TBD.

  • js4ever 5 days ago

    Overhead? None Your real concern is: will potential customers run the model by themselves and skipping us?

    Answer is no because you will eventually release a subpar model not your sorta model.

    Also people don't have infrastructure to run this at scale (100-500 concurrent users) at best they can run it for 1-2 concurrent users.

    This could be a good way for peoples to test it then use your infra.

    Ah but you do have an online demo, so you might think this is enough, WRONG.