Anonymous access is the default type of access, with no configuration needed. However, anonymous access is only available for a limited set of datasets, and comes with a much lower quality of service.

So far, running LLMs has required a large amount of computing resources, mainly GPUs. Running locally, a simple prompt with a typical LLM takes on an average Mac ...