Field notes: running an AI gateway in front of every model call
A gateway is a single door that every model request walks through. After six months with one in production, here is what it actually bought us.
Topic
Topic
A gateway is a single door that every model request walks through. After six months with one in production, here is what it actually bought us.