You can walk from the first to the fifth village (5-6 hours), although some stretches can test your physical condition. Shown here is the first segment between Riomaggiore and Manarola (which you can just see peeking through at the very end). This segment is called Via Dell'Amore and has been the scene of many declarations of love :)
View of Manarola from the Via Dell'Amore