GraphQL subscriptions provide real-time functionality to applications by allowing clients to subscribe to specific events. When these events trigger, the server immediately sends updates to the subscribed clients.
Transport Mechanisms for GraphQL Subscriptions
The method of how these updates are delivered is determined by the transport mechanism. In this section, we will discuss two popular transport mechanisms: GraphQL over WebSockets and GraphQL over Server-Sent Events (SSE).
GraphQL over WebSockets
WebSockets provide a full-duplex communication channel over a single TCP connection. This means data can be sent and received simultaneously. With GraphQL, this means both queries/mutations and subscription operations can be sent over the same connection.
WebSockets are widely supported in browsers and have been the de facto standard for real-time data transport in GraphQL. There are two popular protocols for GraphQL over WebSockets: graphql-ws and subscription-transport-ws. Hot Chocolate, supports both protocols.
In terms of specific protocols, the recommendation is to use graphql-ws or graphql-sse over the legacy subscription-transport-ws.
Key Features:
- Full-duplex: Both the client and server can initiate communication, allowing real-time bidirectional communication.
- Persistent connection: The connection between client and server remains open, allowing for real-time data transfer.
- Well-supported: There are several libraries available for managing WebSocket connections and GraphQL subscriptions.
GraphQL over Server-Sent Events (SSE)
Server-Sent Events (SSE) is a standard that allows a server to push real-time updates to clients over HTTP. Unlike WebSockets, SSE is a half-duplex communication channel, which means the server can send messages to the client, but not the other way around. This makes it a good fit for one-way real-time data like updates or notifications.
With GraphQL, you can send regular queries and mutations over HTTP/2 and subscription updates over SSE. This combination leverages the strengths of both HTTP/2 (efficient for request-response communication) and SSE (efficient for server-to-client streaming).
Another advantage of SSE is its better compatibility with firewalls compared to WebSockets. However, if you're using HTTP/1, keep in mind that SSE inherits its limitations, such as supporting no more than 7 parallel requests in the browser.
graphql-sse is a popular library for GraphQL over SSE.
Key Features:
- Efficient for one-way real-time data: The server can push updates to the client as soon as they occur.
- Built on HTTP: SSE is built on HTTP, simplifying handling and compatibility. It benefits from HTTP features such as automatic reconnection, HTTP/2 multiplexing, and headers/cookies support.
- Less Complex: SSE is less complex than WebSockets as it only allows for one-way communication.
- Better Firewall Compatibility: SSE generally encounters fewer issues with firewalls.
Choosing between GraphQL over WebSockets and GraphQL over SSE depends on the specific needs of your application. If you need full-duplex, real-time communication, WebSockets may be the best choice. If you only need server-to-client real-time communication and want to take advantage of existing HTTP infrastructure, SSE could be a better option.
Special thanks to Denis Badurina, @enisdenjo on Twitter and GitHub. He is the creator of graphql-http, graphql-ws and graphql-sse.
Usage
Subscribing to an event is like writing a standard query. The only difference is the operation keyword and that we are only allowed to have one root field.
type Subscription { bookAdded: Book! bookPublished(author: String!): Book!}
subscription { bookAdded { title }}
A subscription type can be defined like the following.
public class Subscription{ [Subscribe] public Book BookAdded([EventMessage] Book book) => book;}
builder.Services .AddGraphQLServer() .AddSubscriptionType<Subscription>();
Only one subscription type can be registered using AddSubscriptionType()
. If we want to split up our subscription type into multiple classes, we can do so using type extensions.
A subscription type is just a regular object type, so everything that applies to an object type also applies to the subscription type (this is true for all all root types).
Transport
After defining the subscription type, we need to add the WebSockets middleware to our request pipeline.
app.UseRouting();
app.UseWebSockets();
app.UseEndpoints(endpoints =>{ endpoints.MapGraphQL();});
To make pub/sub work, we also have to register a subscription provider. A subscription provider represents a pub/sub implementation used to handle events. Out of the box we support two subscription providers.
In-Memory Provider
The In-Memory subscription provider does not need any configuration and is easily setup.
builder.Services .AddGraphQLServer() .AddInMemorySubscriptions();
Redis Provider
The Redis subscription provider enables us to run multiple instances of our Hot Chocolate GraphQL server and handle subscription events reliably.
In order to use the Redis provider we have to add the HotChocolate.Subscriptions.Redis
package.
dotnet add package HotChocolate.Subscriptions.Redis
HotChocolate.*
packages need to have the same version.After we have added the package we can setup the Redis subscription provider.
builder.Services .AddGraphQLServer() .AddRedisSubscriptions((sp) => ConnectionMultiplexer.Connect("host:port"));
Our Redis subscription provider uses the StackExchange.Redis Redis client underneath.
Postgres Provider
The PostgreSQL Subscription Provider enables your GraphQL server to provide real-time updates to your clients using PostgreSQL's native LISTEN/NOTIFY
mechanism. This provider is ideal for applications that already use PostgreSQL and want to avoid the overhead of running a separate pub/sub service.
In order to use the PostgreSQL provider we have to add the HotChocolate.Subscriptions.Postgres
package.
dotnet add package HotChocolate.Subscriptions.Postgres
To enable Postgres subscriptions with your HotChocolate server, add AddPostgresSubscriptions
to your GraphQL server configuration:
builder.Services .AddGraphQLServer() .AddQueryType<Query>() // every GraphQL server needs a query .AddSubscriptionType<Subscriptions>() .AddPostgresSubscriptions((sp, options) => options.ConnectionFactory = ct => /*create you connection*/);
Options
PostgresSubscriptionOptions
encapsulates options for configuring the Postgres subscription provider. The properties included in this class are:
ConnectionFactory
: A function used to create a new, long-lived connection. The connection should have the following configuration to work optimally:KeepAlive=30
: Sets a keep alive interval to keep the connection alivePooling=false
: Disables pooling as it is not neededEnlist=false
: Ensures subscriptions run in the background and are not enlisted into any transaction
ChannelName
: Specifies the name of the Postgres channel used to send/receive messages. The default value is "hotchocolate_subscriptions".MaxSendBatchSize
: Sets the maximum number of messages sent in one batch. The default value is 256.MaxSendQueueSize
: Determines the maximum number of messages that can be queued for sending. If the queue is full, the subscription will wait until there is available space. The default value is 2048.SubscriptionOptions
: Options used to configure the subscriptions.
Here's an example of creating a connection factory suitable for long-lived connections:
var builder = new NpgsqlDataSourceBuilder(connectionString);
// we do not need pooling for long running connectionsbuilder.ConnectionStringBuilder.Pooling = false;// we set the keep alive to 30 secondsbuilder.ConnectionStringBuilder.KeepAlive = 30;// as these tasks often run in the background we do not want to enlist them so they do not// interfere with the main transactionbuilder.ConnectionStringBuilder.Enlist = false;
var dataSource = builder.Build();
Publishing Events
To publish events and trigger subscriptions, we can use the ITopicEventSender
. The ITopicEventSender
is an abstraction for the registered event publishing provider. Using this abstraction allows us to seamlessly switch between subscription providers, when necessary.
Most of the time we will be publishing events for successful mutations. Therefore we can simply inject the ITopicEventSender
into our mutations like we would with every other Service
. Of course we can not only publish events from mutations, but everywhere we have access to the ITopicEventSender
through the DI Container.
public class Mutation{ public async Book AddBook(Book book, ITopicEventSender sender) { await sender.SendAsync("BookAdded", book);
// Omitted code for brevity }}
In the example the "BookAdded"
is the topic we want to publish to, and book
is our payload. Even though we have used a string as the topic, we do not have to. Any other type works just fine.
But where is the connection between "BookAdded"
as a topic and the subscription type? By default, Hot Chocolate will try to map the topic to a field of the subscription type. If we want to make this binding less error-prone, we could do the following.
await sender.SendAsync(nameof(Subscription.BookAdded), book);
If we do not want to use the method name, we could use the Topic
attribute.
public class Subscription{ [Subscribe] [Topic("ExampleTopic")] public Book BookAdded([EventMessage] Book book) => book;}
public async Book AddBook(Book book, ITopicEventSender sender){ await sender.SendAsync("ExampleTopic", book);
// Omitted code for brevity}
Dynamic Topics
We can even use the Topic
attribute on dynamic arguments of the subscription field.
public class Subscription{ [Subscribe] // The topic argument must be in the format "{argument}" // Using string interpolation and nameof is a good way to reference the argument name properly [Topic($"{{{nameof(author)}}}")] public Book BookPublished(string author, [EventMessage] Book book) => book;}
public async Book PublishBook(Book book, ITopicEventSender sender){ await sender.SendAsync(book.Author, book);
// Omitted code for brevity}
ITopicEventReceiver
If more complex topics are required, we can use the ITopicEventReceiver
.
public class Subscription{ public ValueTask<ISourceStream<Book>> SubscribeToBooks(ITopicEventReceiver receiver) => receiver.SubscribeAsync<Book>("ExampleTopic");
[Subscribe(With = nameof(SubscribeToBooks))] public Book BookAdded([EventMessage] Book book) => book;}