1st-time authors: How long to get a bunch of followers

I am not having much success getting newsletter signups or blog subscribers. For those of you are working on your first book, how long did it take for you to get a lot of followers/subscribers? I’m wondering because my impression is that this issue is a deal-breaker. Few subscribers? No point in publishing. Thanks.