Well, my take on it...
First off, I'm not willing to call all the ppl who still prefer mechanical 'luddites'.
A 'luddite' is someone who hates all new technology no matter what. While there are maybe a few ppl in the "6-speed friction was so great, why'd we ever change!" crowd (aka 'git off mah lawn'), most just see e-shifting and mechanical as options on a menu, and decide between them on the merits.
Compnonents Makers: Pssst! Hey buddy.
Consumer: Yeah? What?
CM: Got a new product for ya. Will significantly improve front shifting. Won't do much for rear shifting since it's so good already, but still, a little maybe. Will also let you shift better under power.
Consumer: Cool. How much more expensive?
CM: Oh, like $1000. And it needs batteries. And it’s a bit heavier.
Consumer: Uhh, I dunno. If I was like racing or rich or something, maybe...
CM: What?! You a luddite or somethin’, man? Get with the program! Don't you want to use the same stuff the PROS use?
Consumer: I don't really care what the pros use. My stuff already works very well, and I have a budget.
CM: You are dead to me. And my marketing team says you're a dork that we can't spend any more time or effort on anyways.
So, yeah..... 😕
I also don't really buy into the notion that EVERYTHING that comes from the components makers or bike manufacturers is automatically PROGRESS! or INNOVATION!!
I mean, sometimes it is, but sometimes it's just marketing driving a trend for the sake of having a talking point and making $$.
Can you remember the early '90s, when bike makers starting spec'ing their bikes with super-narrow tires? Not just the 49cm 'little guy' bikes, the whole LINE of sizes, spec'd with 700x20, 700x19, even 700x18 tires. Remember that?
Yeah, it was pinch-flat-palooza. Augh.
Was the STUPIDEST 'performance trend' EVER, but it got rammed down our throats for a couple of years, 'til everyone could see that super-narrow tires sucked, and the industry woke up and went back to 700x23 (and 25). And nowadays, thanks to the 'gravel' movement, plenty of ppl want tires much bigger than that.
Point is, it's not always about 'innovation'. A lot of times it's more like, "Gee, how can we drive more and more technology into our products so we can raise prices and demand and get higher margins and bigger profits?".
And then of course, there's just 'being different to be different', aka providing marketing talking points. Both things lead to 'solutions in search of a problem', or at least 'solutions that solve MINOR problems, for lots of money."
And bike-makers are right there in cahoots with the component makers on this, because more expensive (but accepted by the consumer) component groups allow bike makers to raise their prices/margins/profits too. Notice how expensive road bikes have become in recent years? Even before covid? Heck, even going back to the Lance days.
Point is, few ppl really want to sell you something that's relatively cheap, durable, reliable, and simple. Not if they can endlessly ram more technology in there and jack up the price... even if the benefit-to-cost ratio suffers as a result, and even if the spirit of the bicycle as a 'practical, simple, elegant machine' gets lost.
And thus 'progress' in bikes/components is the same as it is in so many other consumer-driven product fields... two steps forward, one step back, one step sideways, and a breakdance layout spin just for the hell of it.
Now, if you personally LOVE e-shifting, hydraulic disc 'breaks', and ever more more MOAR tech, great. Go to it. It's your money, not mine. But considering how relatively easy it would to sell mechanical groups alongside the 'bleeding edge, cost no object' ones, Shimano's (and so far, SRAM's) stance on 12-speed mechanical seems pretty obnoxious and $$$-myopic.
Yes, their product managers can say, "But mech doesn't sell", but that seems pretty self-serving, aka of course they'll say that. They have to. And it may even be true at the high end.
But I know hardly anyone who wanted mechanical Ultegra to go away completely, and get replaced by a much more expensive e-shifting-only version. And I suppose I'll know fewer ppl still who'll want the same thing to happen to 105, and eventually, Tiagra, Sora, etc. etc.
Given the aggressive tactics and attempted assaults on my wallet, you know what? Maybe those cranky luddites actually had it right all along.
Now, where'd I put my 6-speed friction shifters?... 🚴♂️