I am trying to understand Edmonds-Karp algorithm in more details and was curious to know what algorithm it uses to compute the shortest path (least number of edges) from s to t for each iteration
Breadth-first search. You might want to read the Wikipedia entry for details.