#dev | Logs for 2024-12-09
« return
[15:53:13] -!- robc207 [robc207!~robc207@62-19-913-880.static.firstlight.net] has joined #dev
[15:54:02] <robc207> @kolie recommended this as a quieter forum where we might talk about Kubernetes
[15:54:48] <kolie> Yea the commit messages go here from github
[15:55:18] <kolie> Probably appropriate it doesn't get used for convo really so don't see why it wouldn't fit.
[15:56:32] <kolie> The gist of it is I have a three node system that's idle, The fourth is a non-idle node with the Soylent news docker container host as a proxmox VM.
[15:57:03] <kolie> So I got four total nodes, All with proxmox, three are greenfield
[15:58:26] <kolie> I've got public BGP feeds, I've got plenty of address space, we can definitely if k8s is the way, experiment on that and come up with something
[15:58:40] <janrinok> hi robc207 - I'll butt out now
[15:58:50] <robc207> Kubernetes ~ do you recall the first time you opened a word processor and the cursor just sat there taunting you "Well, what do you want to write?!" That's kind of the problem with k8s in my experience.
[15:59:23] <kolie> Yeah. I've set up probably 30 organizations with k&s
[15:59:24] <robc207> Hey janirok - the onboarding experience has been a bit spotty. Now both you and kolie have deferred to each other for the one-time-pass creation
[15:59:31] <kolie> Most of it hand, some of it GKE
[16:00:48] <robc207> Cool, my experience has mostly been on premises bare metal. After a long journey, including kubespray, kubeadm, and various others, I've grown to like k3s as my easiest to build recommendation
[16:01:10] <robc207> And for the last couple of years I've been working mostly with EKS Fargate
[16:01:28] <janrinok> robc207, email password in PM
[16:10:47] <robc207> Build your three VMs with private IP space and at least 2 CPU, 4 GB, then use the Quick-Start Guide https://docks.k3s.io
[16:11:36] <robc207> You should also disable swap and firewalld if it's present in the base OS.
[16:13:15] <kolie> Ok I'll probably allocate more then that.
[16:14:05] <kolie> 4th for control panel or just place the third?
[16:15:24] <kolie> Yea I'm sure these new developments and stuff my k8s knowledge probably is at least a 2 year vintage rn.
[16:24:03] <robc207> I'd recommend creating an upstream cluster where Rancher runs and then we create downstream clusters for our workload. The minimum for quorum is 3, and k3s bootstraps the first node with the needed .kube/config
[16:24:50] <robc207> A lot of teams will copy and modify that config to a "bastion" node so that when you're running kubectl and helm, you do it from bastion so that none of the other k3s nodes are special. No Pets!
[16:25:52] <robc207> On the other hand, if you want to keep the minimum number of nodes then "bastion" is optional. The idea being you do cluster maintenance from Bastion so that your workflow is the same for all the other nodes.
[16:26:39] <robc207> If you do not want an upstream/downsteam configuration you can run your user-facing workloads from the same cluster where Rancher lives. There are plusses and minuses for each
[16:27:31] <robc207> Once the cluster is alive, if you are running a private repo, you will probably need to configure that https://docs.k3s.io
[16:27:31] <systemd> ^ 03Private Registry Configuration
[17:53:37] <kolie> Well what I'll do is get three base systems running with ssh. if you are comfortable with it I can let you on and your welcome to document the setup as you go.
[17:54:52] <kolie> pm a pubkey and I'll likely have time together to set them up and get them on a vlan
[17:56:10] <kolie> There was a docker repo on the old staff box but its defunct now, will likely need to stand one up in addition to the nodes.
[19:53:35] -!- robc207 has quit [Quit: Client closed]
[20:29:47] -!- robc207 [robc207!~robc207p2@62-19-913-880.static.firstlight.net] has joined #dev
[21:40:30] <kolie> pulling up that cluster rn.
[21:40:45] <kolie> tired as all fuck
[21:44:41] <kolie> pulling up the drac on one of the machine.
[22:10:46] <kolie> Yea thought I could focus but im just not awake.
[22:10:50] <kolie> goign back home.