Revamp the Speed Build inventories to match that of how the build would be created.
For example, if a build only has one block at the starting layer, then make that the first block in your hotbar. As for other blocks in the build it is less important, but could match that of the importance of the area. Like on the Guardian, where you should start with the prismarine blocks, then could go into the slabs (to finish the base) and then to the blocks for the eye.
However right now, with many builds (but sticking to the Guardian as an example) you start with blocks that rely on a base being made before hand to place.
This idea would be majorly beneficial to console players, who have both slower sensitivity and slower movement on the hotbar. So if you’re looking at the wrong area or have the wrong block, you will be slowed down.
There is another solution to this, shown by this post here: Speed Build | Items in Inventory During Preview
But if that Hive doesn’t want to put that idea into place, please think about this. As a controller player, this is such an annoying bit of the game that if I had the chance I would fix all the orders of the hotbars myself. Because even though the game is fun, starting out slower because of my input device is extremely bothering.