Comment by physix

Comment by physix 8 days ago

7 replies

This is a great idea. I really like it!

We considered reaching out in May, but held back because we want to run on bare metal.

Any chance to get this provisioned on bare metal at Hetzner?

We have K8S running on bare metal there. It's a slog to get it all working, but for our use case, having a dedicated 10G LAN between nodes (and a bare metal Cassandra cluster in the same rack) makes a big difference in performance.

Also, from a cost perspective. We run AX41-NVMe dedicated servers that cost us about EUR 64 per server with a 10G LAN, all in the same rack. Getting the same horsepower using Cloud instances I guess would be a CCX43, which costs almost double.

adamcharnock 8 days ago

We're setting up a data-heavy client at the moment who has a similar need. We're working with Hetzner's custom solutions team to provision a multi-AZ setup, with 25G networking and 100G AZ interconnects. Link in bio if you want to chat, email is adam@...

oriettaxx 7 days ago

I have a docker swarm in Hetzner with cloud instances and VM in bare metal (proxmox host): the good is that I am using almost the same cloud init script to create those Ubuntu nodes (both Proxmox and Hetzner cloud instances support cloud-init).

I use wireguard to have those nodes connected together

VoidWhisperer 8 days ago

Are you asking if it can provision bare metal servers with hetzner in a similar way to what it is doing with cloud servers, or if it can manage clusters on your hetzner bare metal servers (in the case of the second, a tool like Rancher might be better)

  • physix 8 days ago

    I was thinking more of the former, whereby I "bring my own servers".

    I haven't really thought it through yet, whether that even makes sense.

    • VoidWhisperer 8 days ago

      That might be a bit challenging unless they sort out an integration directly with hetzner as I don't think their API supports anything related to bare metal provisioning, just cloud and 'storage boxes'

    • moondev 8 days ago

      Cluster-api project is what you want. It's the holy grail of cluster lifecycle.