What is the Greatest Barrier to Learning Math?

What if the problem has nothing to do with the teaching and learning of math?  What if the problem is unrelated to math?