Skip to content

can WebLLM compile to WASM? #78

@lonnietc

Description

@lonnietc

Hello,

I am seeking to be able to compile the WebLLM Chat application into a wasm application so that it will be a single module that can be downloaded to the user's browser on demand and am investigating what may, or may not, be possible.

My project is to have a number of different WebLLM Chat wasm modules that will run on small specialized LLM's different machines and then use an MoA to query them and aggregate the results back to the calling user.

I really like WebLLM and it s capabilities so far and want to get some ideas on how to best accomplish this effort.

Thanks and have a great day,

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions