This was a very nerve racking experience as I’d never gone through a major version Proxmox update before and I had spent a lot of time getting everything just so with lots of config around disk and VLANs. The instructions were also a big long page, which never fills me with confidence as it normally means there’s a lot of holes to fall in to.
My initial issue was that it says to perform the upgrade with no VM’s running, but it requires an internet connection and my router is Opnsense in a VM. Thankfully apt dist-upgrade --download-only, shutdown the Opnsense VM and then apt dist-upgrade did the trick.
A few config files changed and I always hate this part of Debian upgrades, but nothing major or of importance was impacted.
A nervous reboot and everything was back up running the new Proxmox with the new kernel. Surprisingly smooth overall and the most time consuming part by far was backing up my VM’s just in case. The upgrade itself including reboot was probably 15 mins, the backups and making sure I was prepared and mentally ready was about an hour.
Compared to upgrading ESXi on old hardware like I was doing last year, it was a breeze.
Highly recommended, would upgrade again.
Like you I have OPNsense in a VM on one of my PVEs. But I only made sure the nigthly VM back up ran and didnt even bother shutting down the VMs during the upgrade. The VMs got restarted during the final reboot, as the would with every other reboot, and I was back in business.
It’s a bold strategy, Cotton. I’m glad it worked out for you.
:-)
But seriously, I was wondering about the requirement to shutdown the VM’s and couldn’t come up with a solid reason? I mean, even if QEMU/KVM/Kernel get replaced during a version upgrade or a more common update, all of these kick in only after the reboot? And how’s me shutting down VMs manually different from the OS shutting down during a reboot?
I know I am speculating and may not have the fill picture, probably a question for the Proxmox team, there may be some corner case where this is indeed important.
By the way, Mexican or US black strat? :-)
I have no idea why, but I thought there must be some good reason to document it and put the check in to the test tool.
I don’t yet have a black strat. I’m considering the Player series of a non-Fender option of a Vintage V6.
I don’t know why but figured the same as you. If they bothered to document it, I’d bother to follow it. I did the download only option too since I also run opnsense from a VM.
I did the same a few months ago and was extremely nervous. I have a 4 node cluster running 30 VMs in production. After migrating the VMS off of one node I quickly realized what a pleasure it was to do it. No muss no fuss. Migrated the VMs back and continued on with the other 3.
That’s pretty cool that it worked so well. Does migrating the VM’s result in any downtime or is it a seamless cross over?
I waited a few days before upgrading as I wanted to make sure I wasn’t going to get stung by any teething troubles. Would have ideally waited longer but had an ideal few hours available to do it without the family being annoyed by any downtime.
Sorry for the late reply. Using ZFS and replicating the VM first makes it really quick. Less than 5 minutes of downtime.
I’ve really come to appreciate having test systems working as a systems engineer. A simple virtualised install of Proxmox that replicates some small part of your environment is great to simply go through the upgrade once or twice.
I’d like to run a small cluster of mini PCs or have extra hardware running a mirror setup, but the cost has put me off.
I’m about to do the same thing. Thanks for sharing your experience.
I just did mine yesterday. One stopped responding mid-upgrade and I wasn’t able to reconnect, but I was able to log in at the console and run
dpkg --reconfigure -auntil I got the network back, thenapt install --reinstall proxmox-ve pve-managergot those packages to finish installing, then everything worked.This is one of the reasons I am very against virtualizing core foundational services like routers and NAS. It just causes way too many headaches.
