The point about GPUs is well taken. I have a decent graphic card and I expect that training on a data set of any significant size would make the card smoke.

I assume that this stuff is computationally intensive. Just as building one's own Google replacement or doing video rendering are both terribly CPU and IO bound both.

You have more advanced CS chops than me. I learned IT stuff on my own and my original degree is in electrical engineering.