Dynamic Request Routing
Traffic sent to multi-region Fly.io apps is automatically routed to the region nearest to the client, thanks to Anycast-enabled IP addresses. Read more about Anycast on Wikipedia.
Sometimes it’s useful, or necessary, to route requests to other regions, other apps, or both. You can use custom request and response HTTP headers to achieve this.
Apps may append a
fly-replay header to responses. This instructs the Fly proxy to redeliver (replay) the original request in another region, or to replay it to another app in the same Fly organization.
The content of the
fly-replay header fields tells our proxy which magic to perform, and the proxy takes it from there. If the target region doesn’t host any healthy instances for the target app, the proxy throws an error.
||The 3-letter code for a region to which the request should be routed.|
||ID of a specific instance to which the request should be routed.|
||The name of an app within the same organization, to which the request should be routed.
fly-proxy will choose the nearest instance if no region is specified.
||Optional arbitrary string to include in the
Attempting to replay requests larger than 1MB will throw an error. If you need certain requests - like file uploads - to be handled by a specific region, consider the following workarounds.
If you can perform uploads via
XMLHTTPRequest (aja Ajax), you can prepend the fly-prefer-region header to send the request directly to that region.
Here are a few example use cases for the
fly-replay response header.
Fly.io Postgres supports global read replicas for speeding up reads in regions close to users.
Replay a request to the region where the HA database leader lives:
The proxy will get the request to an instance in that region and let the instances in the cluster take care of getting it to the writeable leader.
fly-replay can replay requests across apps in the same organization. Think of a router app for a FaaS that wants to spin up a customer VM on demand.
To send the request to an instance of a different app in the same organization, in the nearest region that has one:
Replay the request to a specific VM by ID:
The request replay target may need to know why the request was routed to it.
Fields can be stacked; for instance, to send the request on to an instance of the app “app-in-same-org” in the sjc region:
Some combinations of fields can conflict: e.g. don’t specify an app name and an instance ID that doesn’t belong to that app.
When replaying an HTTP request, our proxy appends the
fly-replay-src header with information about the instance that sent the
||The ID of the instance emitting
||A timestamp: microseconds since the Unix epoch.|
||The contents of the
Clients accessing Fly.io apps may append the
fly-prefer-region header to attempt sending the request directly to a desired target region. This is useful for cases where
fly-replay isn’t practical, such as large file uploads which can’t be replayed once buffered by the proxy.
If the target regions hosts no healthy instances, the nearest region with healthy instances will field the request.