As a refinement, since you are satisfied with vesa as a universal driver after the framebuffer phase,
I suggest making the earlier phase just a scan to select a fb appropriate to the video hardware.
I've seen this in Ubuntu 10.04. Seems like one size doesn't fit all in frame buffers in Ubuntu, anyway.
In Ubuntu, one of the options is to suffer thru the framebuffer phase which doesn't last too long;
the subsequent X-session phase proceeds ok, then a brief fb phase on shut-down. I spent a month
on this because the initial Ubuntu 10.04 opted to not include SIS video's fb, which it turns out can
be made to work just as well as what those from what they call 'the big three' video suppliers.
Intel Core i7-4790K SR219 4.00GHZ 4Th Gen Used Desktop Processor CPU FCLGA1150
$64.99
Intel Core i5-9500T 2.20Ghz SRF4D 6-Core LGA1151 Socket CPU Processor
$49.99
Intel Core i5-8500 Six Core Desktop PC CPU Processor 3.00GHz LGA1151 SR3XE
$43.99
Intel - Core i9-14900K 14th Gen 24-Core 32-Thread - 4.4GHz (6.0GHz Turbo) Soc...
$619.99
Intel - Core i7-14700K 14th Gen 20-Core 28-Thread - 4.3GHz (5.6GHz Turbo) Soc...
$444.99
Intel Core i7 CPU Processors, I7 2600, i7 3770, i7 4770, i7 4790
$28.99
Intel - Core i5-14600K 14th Gen 14-Core 20-Thread - 4.0GHz (5.3GHz Turbo) Soc...
$339.99
Intel Core i3-6100 3.70 GHz LGA 1151 Desktop CPU Processor SR2HG
$9.99
Intel Core i7-12700K Unlocked Desktop Processor - 12 Cores And 20 Threads
$224.98
13th Gen Intel 14-Core i5-13500T Turbo Boost up to 4.6 GHz Processor 8K Support
$169.00