changelog / post

gRPC support

Go back

We now support calling models via gRPC! gRPC is type-safe, supports streaming, and is language interoperable, making it great for:

  • Low-latency applications (e.g., video processing)

  • Microservices

Read the docs to get started.