Do I need an Internet connection?

Yes. Continuous playback downloads and temporarily stores on your device a file containing a part of the book (e.g. a chapter); so offline playback is possible for a while, but will be interrupted at the end of the downloaded file if no connection is available.