That's certainly part of it, especially when surveys show that a quarter of all Americans read no books of any kind. Of those who do read, a lot have such specific tastes they may not take to your kind of book.

Ebooks and audio books have helped to keep book sales reasonably healthy--but, alas, they haven't increased the overall percentage of people who read.