YSQL scalability?

General
1

Hello,

What scalability strategies are possible with YSQL?
This question because the Postgre drivers allow you to connect to a single server. I am looking for information and examples.

I think it can behave correctly in Kubernetes (I have not tried).
May be a connections pool?

All feedback and infos are welcome

2

hi @Nico
Currently we don’t offer a cluster aware client (like in YCQL).
We’re actively working on recommended ways to support this.

For now, there are several ways:

  1. haproxy HAProxy version 2.2.22 - Configuration Manual providing the list of servers and using pgsql-check to see if servers are up
  2. GitHub - awslabs/pgbouncer-fast-switchover: Adds query routing and rewriting extensions to pgbouncer
    by providing a list of ips to tservers and using a routing function (example: returning a random server)
  3. implementing on the client, keeping a connection pooler for each tserver and randomly using one on each session
  4. GitHub - yandex/odyssey: Scalable PostgreSQL connection pooler as connection pooler
  5. https://www.pgbouncer.org/

Any Postgresql connection pooler/proxy that can work with 1+ servers will work. The most efficient config will be with autocommit=true.

3

@Nico @dorian_yugabyte

To clarify the architecture, yugabyte is a sharded database with different nodes responsible for portions of the database. More information is available at https://docs.yugabyte.com/latest/architecture/docdb/sharding/

Another design feature is that each yugabyte node runs a proxy that can forward requests to the appropriate node responsible for the rows involved in that query.

@dorian_yugabyte has already listed different ways in which queries can be routed in a round-robin or other fashion to multiple nodes in the database (which will then forward requests to the right node for the query internally). For Kubernetes specifically, another option is to use the inbuilt service load balancer as described in the Helm chart documention for yugabyte. This eliminates the need to install separate loadbalancer software.

4

Ok thanks to you 2, I will look at the side of Kubernetes