At one point in my life I made a point of removing as many 'filler' words and sounds as I could from my speech for public speaking (BTW/FWIW, standing on a stage in front of 10K people is not at all the same as in front of a couple hundred). It worked great for that - but I found that in conversational speech people were constantly 'talking over' me. As a datacomms guy who had been deep into CSMA/CD it was obvious what was going on: I was omitting the periodic 'hold the channel' signal that senders have to use to indicate they were still sending (in non-datacomms speak I wasn't 'holding the floor'). Since then, I've made an attempt to re-insert floor-holder words or sounds while I'm in mid thought. I also made an attempt to learn gestures to show I was still talking. I'm not Southern European' this did not come naturally.
As for 'literally', I have no idea. But if it goes back to the Bronte sisters, I'm not going to complain. My pet linguistic peeve is 'decimate' - and I suspect any students of Roman history will agree. But that word *literally* doesn't mean 'kill one in ten' anymore (or ever really, in English). See what I did there. :-)