How long has it been necessary to elevate the hot base idle speed? Something that happened suddenly or came on gradually? THAT might help indicate where the issue is.
"Crossed plug wires" don't happen by themselves, needing help by an installer. "Vacuum leaks" can happen by themselves, though, which alone can cause leaner mixtures, but seldom enough to seriously alter idle quality. A little rougher, but not to the level of a full miss.
"Retarded ign timing" normally does not happen by itself, but worn ignition points CAN affect ign timing.
"Fouled spark plugs" usually don't fire well, if at all. Resulting in a miss on that cyl. They normally don't happen quickly, but gradually, until they foul enough to not fire. Sometimes the plugs are just loose and can't make a good ground for the ign voltage to reach "ground". Sometimes due to spark plug wire failures/cracks that leak voltage "to ground" before the voltage can get to the spark plug.
When a spark plug that does not fire is removed, it will be obvious. The spark plug gap area will be covered in the fouling-deposit material, be it oil or gas. Running a gap gauge through that gap, to clean it off, can then make it fire again, YET a new plug is the best way to do things.
Many things MIGHT cause the issue the OP mentioned, but as "elevated idle speed" was all that was mentioned, we don't yet know if idle smoothness (which can relate to stalling) is an issue, OR if there is not enough idle fuel to support ANY idle activities.
Reason I know this is because I had a similar issue with the BBD on my 1980 Newport 360. It would act just fine when started, but as soon as the engine got warm enough to not be on fast idle, it would die. As long as idle speed was elevated, it would run and drive normally. But take my foot from the accel pedal to slow down for an exit ramp, it'd die at 60mph. Always restarted and ran as long as it was not using the idle circuit.
I rebuilt the carb, using spray B-12 to clean it and check for "flow" through the idle tubes. I could restart the engine and it would idle at the normal hot base idle speed . . . UNTIL all of the solvent in the idle tubes was depleted and then it would die. I kept seeing a spec for "Low Speed Jet" in the carb specs, but did not know where it was until I finally found it in an obscure place in the service manual illustrations. On that carb, it was in the bottom of the idle feed fuel tube. On a Holley 4bbl, it's in the metering block as "Idle Feed Restriction", and sealed. Unlike the Carter BBD, the channels leading to and from that IFR are not straight.
I got a bent-wire spark plug gap gauge and started to probe that recessed hole. Starting with the smallest size, each probe resulted in hard deposits breaking away. Finally I reached the largest size that would fit the hole and then I went in search of a "twist drill" selection at a hobby shop. With that finger/twist drill set, I went through the assortment until one size "hit brass", which is the size I used to enlarge the existing drilled orifice to. Cleaned out the residue with spray carb cleaner. That was the end of my problems with that carb. 4bbl Carters/Edelbrock 4bbls have similar idle circuits, but Holleys have the IFR for the same function. NOTE . . . "Hard Deposits" built-up in those passages, which carb cleaners/soak solutions would NOT remove, which is why I had to remove them mechanically!
So, as I had a Carter carb, I had to remove the hard deposits mechanically with a drill bit of appropriate size. Holleys will need a new primary metering block. Yes, there are provisions to change the IFR dimension, but it takes drilling out the seal plugs, modifying the IFR size, then re-sealing the plugs. More recent Holleys have screw-in "jets" to do the same function, in the primary metering block.
Holley 4bbls also have an idle circuit related to the secondary throttle bores, with an incognito set screw which adjusts how far open the secondary throttle bores are at hot base idle. Many are unaware of these things as they are not seen unless the carb is apart. The reason they are hidden is that they are NOT to be adjusted after the carb is originally assembled on its assy line. That little bit of idle fuel flow through the secondaries is supposed to keep the fuel in the secondary float bowl "more fresh" than not. Even if the vacuum secondaries remain closed all of the time.
Until we get more information from the OP . . .
CBODY67