A model hub router sends open model blocks through provider switches into application endpoints
A model hub router sends open model blocks through provider switches into application endpoints
+ Large Language Models News

Hugging Face adds Baseten as an Inference Provider

Hugging Face added Baseten as an Inference Provider, giving developers routed serverless access to open-weight text and chat models from Hub model pages and SDKs.

Hugging Face has added Baseten as an Inference Provider on the Hub.

The August 6 post says Baseten initially supports conversational and text-generation tasks through Hugging Face’s provider system. Developers can access supported models from model pages, from Hugging Face client SDKs, and through OpenAI-compatible calls routed via https://router.huggingface.co/v1.

The model examples in the post include Kimi K3, DeepSeek V4 Flash, GLM-5.2, and other open-weight LLMs. Hugging Face says additional tasks will roll out later.

Provider choice is becoming part of the model page

Hugging Face’s Inference Providers turn the model page into more than a catalog entry. A developer can choose a provider preference, bring a provider API key, or let requests route through Hugging Face billing when that mode is available.

That matters because open-weight model adoption has two separate bottlenecks. The first is model availability: can a team find the right weights, license, and model card? The second is operational access: can the team run the model with acceptable latency, cost, reliability, and governance without building an inference platform first?

Baseten sits in that second layer. The integration lets a developer test hosted open-weight inference from the same Hub surface where they already inspect models.

The integration is useful because it is bounded

The post does not say Baseten is the default host for every model on Hugging Face, and it does not say every task type is covered. The initial scope is conversational and text generation.

That boundary is important. Provider routing is powerful only if developers can see which provider is compatible with which model and task, where billing happens, what API key is used, and which service receives the request.

For enterprise users, the useful review is provider-specific. Open-weight does not automatically mean local, private, or cheap. A hosted open-weight call still has a provider, a routing path, a billing account, and a data-handling policy.

Sources

The AI Feed Desk

The AI Feed Desk

Editorial desk

The AI Feed Desk tracks AI provider updates, model releases, agent tooling, and enterprise adoption, turning fast-moving announcements into source-linked context for builders and operators.

Noticed a typo, incorrect information, or translation error?

Tell us so we can fix it.

Help Improve This Article

Related Articles

A command-line prompt launches an inference endpoint on a small GPU cluster

Hugging Face makes vLLM serving a one-command Jobs workflow

HF Jobs can now spin up a private OpenAI-compatible vLLM endpoint for tests, evals, and batch generation without provisioning servers or managing Kubernetes.

The AI Feed Desk

By The AI Feed Desk

A metallic chip tile connects to flowing local model tokens and a small speed gauge

BaseRT makes Apple Silicon LLM speed a runtime-design question

BaseRT's paper and release argue that native Metal kernels, unified-memory-aware layout, and custom dispatch can raise local LLM throughput on Apple Silicon.

The AI Feed Desk

By The AI Feed Desk

A testing gauge compares a clean tool path with a longer tangled debugging path

Hugging Face measures whether tools are agent-friendly

Hugging Face's agent-focused benchmark tests whether software changes help coding agents finish tasks with fewer errors, tokens, and detours.

The AI Feed Desk

By The AI Feed Desk

A microphone waveform passes through a fast inference core and exits as a speaker waveform

Hugging Face and Cerebras make open voice AI a latency problem

A Hugging Face and Cerebras speech-to-speech demo uses Parakeet, Gemma 4, Cerebras inference, and Qwen3TTS to show where voice AI latency actually lives.

The AI Feed Desk

By The AI Feed Desk

A signed native-code module sits on a technical workbench beside accelerator cards

Hugging Face Kernels adds trusted native-code rails

Hugging Face updated Kernels with trusted publishers, signatures, reproducible builds, and provenance checks for optimized native code on the Hub.

The AI Feed Desk

By The AI Feed Desk