The published books on speech analysis tend to provide a lot of mathematical detail. An old, established and still very useful book is . Two chapters of  cover this material well. More recently published is  which both covers this course and is useful for other courses. The book  covers low level signal processing, filtering, FFTs etc.